[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:03:35.174495 14293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.245.126:42903
I20260709 13:03:35.176800 14293 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:03:35.178288 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:35.202558 14299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:35.202548 14302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:35.204703 14293 server_base.cc:1061] running on GCE node
W20260709 13:03:35.202602 14300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:36.480371 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:36.480710 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:36.481004 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602216480951 us; error 0 us; skew 500 ppm
I20260709 13:03:36.482007 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:36.490324 14293 webserver.cc:533] Webserver started at http://127.13.245.126:34781/ using document root <none> and password file <none>
I20260709 13:03:36.491474 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:36.491865 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:36.492462 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:36.499596 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/master-0-root/instance:
uuid: "28366101d2fa4ae5ab850aabcc97303a"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-fc6v"
I20260709 13:03:36.511021 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:03:36.517917 14308 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.519658 14293 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:36.520190 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/master-0-root
uuid: "28366101d2fa4ae5ab850aabcc97303a"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-fc6v"
I20260709 13:03:36.520623 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:36.592082 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:36.594012 14293 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:03:36.594681 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:36.686548 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.126:42903
I20260709 13:03:36.686674 14359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.126:42903 every 8 connection(s)
I20260709 13:03:36.696965 14360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:36.726038 14360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a: Bootstrap starting.
I20260709 13:03:36.734383 14360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:36.737175 14360 log.cc:826] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a: Log is configured to *not* fsync() on all Append() calls
I20260709 13:03:36.743701 14360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a: No bootstrap required, opened a new log
I20260709 13:03:36.769539 14360 raft_consensus.cc:359] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28366101d2fa4ae5ab850aabcc97303a" member_type: VOTER }
I20260709 13:03:36.770267 14360 raft_consensus.cc:385] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:36.770625 14360 raft_consensus.cc:740] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28366101d2fa4ae5ab850aabcc97303a, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.771943 14360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28366101d2fa4ae5ab850aabcc97303a" member_type: VOTER }
I20260709 13:03:36.772585 14360 raft_consensus.cc:399] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:36.772961 14360 raft_consensus.cc:493] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:36.773368 14360 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:36.778463 14360 raft_consensus.cc:515] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28366101d2fa4ae5ab850aabcc97303a" member_type: VOTER }
I20260709 13:03:36.779502 14360 leader_election.cc:304] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28366101d2fa4ae5ab850aabcc97303a; no voters: 
I20260709 13:03:36.781808 14360 leader_election.cc:290] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:36.782266 14363 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:36.785143 14363 raft_consensus.cc:697] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 1 LEADER]: Becoming Leader. State: Replica: 28366101d2fa4ae5ab850aabcc97303a, State: Running, Role: LEADER
I20260709 13:03:36.786370 14363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28366101d2fa4ae5ab850aabcc97303a" member_type: VOTER }
I20260709 13:03:36.787860 14360 sys_catalog.cc:565] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:36.802798 14364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28366101d2fa4ae5ab850aabcc97303a. Latest consensus state: current_term: 1 leader_uuid: "28366101d2fa4ae5ab850aabcc97303a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28366101d2fa4ae5ab850aabcc97303a" member_type: VOTER } }
I20260709 13:03:36.803032 14365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28366101d2fa4ae5ab850aabcc97303a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28366101d2fa4ae5ab850aabcc97303a" member_type: VOTER } }
I20260709 13:03:36.804445 14364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:36.804551 14365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:36.810742 14372 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:36.826197 14372 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:36.829432 14293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:36.846833 14372 catalog_manager.cc:1383] Generated new cluster ID: 48e7faeb62b34385b86fa0247850bb83
I20260709 13:03:36.847257 14372 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:36.878891 14372 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:36.881078 14372 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:36.896977 14372 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a: Generated new TSK 0
I20260709 13:03:36.898584 14372 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:36.962039 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:36.972677 14382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.974148 14383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.980331 14385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:36.981292 14293 server_base.cc:1061] running on GCE node
I20260709 13:03:36.982403 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:36.982725 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:36.982941 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602216982920 us; error 0 us; skew 500 ppm
I20260709 13:03:36.983898 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:36.989256 14293 webserver.cc:533] Webserver started at http://127.13.245.65:36141/ using document root <none> and password file <none>
I20260709 13:03:36.990182 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:36.990474 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:36.990886 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:36.992717 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-0-root/instance:
uuid: "e528d66001e94fb492f62d211ef91a50"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-fc6v"
I20260709 13:03:37.001470 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.006s
I20260709 13:03:37.007931 14390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.009142 14293 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:03:37.009603 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "e528d66001e94fb492f62d211ef91a50"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-fc6v"
I20260709 13:03:37.010054 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:37.054878 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:37.057206 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:37.060768 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:37.067416 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:37.067863 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
I20260709 13:03:37.068236 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:37.068481 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.196666 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:45129
I20260709 13:03:37.196823 14452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:45129 every 8 connection(s)
I20260709 13:03:37.208240 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:37.221000 14457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:37.225459 14458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:37.237222 14293 server_base.cc:1061] running on GCE node
W20260709 13:03:37.238080 14460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:37.239713 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:37.240176 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:37.240483 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602217240455 us; error 0 us; skew 500 ppm
I20260709 13:03:37.241209 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:37.247187 14293 webserver.cc:533] Webserver started at http://127.13.245.66:33531/ using document root <none> and password file <none>
I20260709 13:03:37.247923 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:37.248196 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:37.248539 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:37.250186 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-1-root/instance:
uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
format_stamp: "Formatted at 2026-07-09 13:03:37 on dist-test-slave-fc6v"
I20260709 13:03:37.254918 14453 heartbeater.cc:344] Connected to a master server at 127.13.245.126:42903
I20260709 13:03:37.255599 14453 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:37.257153 14453 heartbeater.cc:507] Master 127.13.245.126:42903 requested a full tablet report, sending...
I20260709 13:03:37.257463 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:03:37.262537 14325 ts_manager.cc:194] Registered new tserver with Master: e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129)
I20260709 13:03:37.264019 14465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.265249 14293 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:03:37.265730 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-1-root
uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
format_stamp: "Formatted at 2026-07-09 13:03:37 on dist-test-slave-fc6v"
I20260709 13:03:37.266175 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:37.266947 14325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52838
I20260709 13:03:37.290624 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:37.292409 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:37.295450 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:37.299149 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:37.299435 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.299841 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:37.300015 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.430348 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.66:46345
I20260709 13:03:37.431082 14527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.66:46345 every 8 connection(s)
I20260709 13:03:37.439013 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:37.452952 14531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:37.456385 14532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:37.456928 14528 heartbeater.cc:344] Connected to a master server at 127.13.245.126:42903
I20260709 13:03:37.457546 14528 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:37.459363 14528 heartbeater.cc:507] Master 127.13.245.126:42903 requested a full tablet report, sending...
I20260709 13:03:37.463413 14325 ts_manager.cc:194] Registered new tserver with Master: b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:37.466307 14325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52844
I20260709 13:03:37.468719 14293 server_base.cc:1061] running on GCE node
W20260709 13:03:37.471648 14534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:37.473095 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:37.473460 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:37.473692 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602217473674 us; error 0 us; skew 500 ppm
I20260709 13:03:37.474704 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:37.478863 14293 webserver.cc:533] Webserver started at http://127.13.245.67:37771/ using document root <none> and password file <none>
I20260709 13:03:37.479713 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:37.480006 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:37.480374 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:37.482066 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-2-root/instance:
uuid: "cc85955fabf547be8853867e5b655467"
format_stamp: "Formatted at 2026-07-09 13:03:37 on dist-test-slave-fc6v"
I20260709 13:03:37.489593 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:03:37.494380 14539 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.495950 14293 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:03:37.496328 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-2-root
uuid: "cc85955fabf547be8853867e5b655467"
format_stamp: "Formatted at 2026-07-09 13:03:37 on dist-test-slave-fc6v"
I20260709 13:03:37.496749 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602214968311-14293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:37.537784 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:37.539377 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:37.541038 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:37.544590 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:37.544895 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.545233 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:37.545445 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.662362 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.67:43279
I20260709 13:03:37.662535 14601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.67:43279 every 8 connection(s)
I20260709 13:03:37.682600 14602 heartbeater.cc:344] Connected to a master server at 127.13.245.126:42903
I20260709 13:03:37.683135 14602 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:37.684396 14602 heartbeater.cc:507] Master 127.13.245.126:42903 requested a full tablet report, sending...
I20260709 13:03:37.687630 14325 ts_manager.cc:194] Registered new tserver with Master: cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:37.688370 14293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019955894s
I20260709 13:03:37.689875 14325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52850
I20260709 13:03:37.752796 14325 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52862:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:37.757355 14325 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:03:37.813735 14373 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:37.886189 14567 tablet_service.cc:1511] Processing CreateTablet for tablet 1d38931cd671415180052e38260c8b69 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:37.889577 14566 tablet_service.cc:1511] Processing CreateTablet for tablet 7a133c50d0744fc9b8a1946bf4f21aff (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:37.892715 14417 tablet_service.cc:1511] Processing CreateTablet for tablet 7a133c50d0744fc9b8a1946bf4f21aff (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:37.894619 14417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a133c50d0744fc9b8a1946bf4f21aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.894229 14416 tablet_service.cc:1511] Processing CreateTablet for tablet dd8cb687ae3b48c29f6636a0e1d452b4 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:37.892738 14418 tablet_service.cc:1511] Processing CreateTablet for tablet 1d38931cd671415180052e38260c8b69 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:37.897104 14415 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1973adcf694e948fadf3fbf5fae271 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:37.899873 14414 tablet_service.cc:1511] Processing CreateTablet for tablet 38addde16fdd4f82974dc39497c1efb4 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:37.900620 14564 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1973adcf694e948fadf3fbf5fae271 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:37.903000 14563 tablet_service.cc:1511] Processing CreateTablet for tablet 38addde16fdd4f82974dc39497c1efb4 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:37.904528 14565 tablet_service.cc:1511] Processing CreateTablet for tablet dd8cb687ae3b48c29f6636a0e1d452b4 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:37.904762 14413 tablet_service.cc:1511] Processing CreateTablet for tablet e853e410f11f4c37b988d6ea8704e940 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:37.907060 14416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8cb687ae3b48c29f6636a0e1d452b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.908461 14562 tablet_service.cc:1511] Processing CreateTablet for tablet e853e410f11f4c37b988d6ea8704e940 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:37.909291 14415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1973adcf694e948fadf3fbf5fae271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.908136 14567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d38931cd671415180052e38260c8b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.913879 14418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d38931cd671415180052e38260c8b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.914907 14412 tablet_service.cc:1511] Processing CreateTablet for tablet 204080e18f1348968d9b8a950a6e7e56 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:37.916501 14412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204080e18f1348968d9b8a950a6e7e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.919466 14413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e853e410f11f4c37b988d6ea8704e940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.922693 14561 tablet_service.cc:1511] Processing CreateTablet for tablet 204080e18f1348968d9b8a950a6e7e56 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:37.925680 14560 tablet_service.cc:1511] Processing CreateTablet for tablet 38ccb1a97c9c45e5aa67bbec180c8a8e (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:37.926714 14410 tablet_service.cc:1511] Processing CreateTablet for tablet c7c2470e057c4097a3c77fa2a2e297f0 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:37.928421 14410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c2470e057c4097a3c77fa2a2e297f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.928355 14411 tablet_service.cc:1511] Processing CreateTablet for tablet 38ccb1a97c9c45e5aa67bbec180c8a8e (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:37.930040 14411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ccb1a97c9c45e5aa67bbec180c8a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.932128 14414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38addde16fdd4f82974dc39497c1efb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.937855 14559 tablet_service.cc:1511] Processing CreateTablet for tablet c7c2470e057c4097a3c77fa2a2e297f0 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:37.950304 14563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38addde16fdd4f82974dc39497c1efb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.966264 14562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e853e410f11f4c37b988d6ea8704e940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.969130 14566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a133c50d0744fc9b8a1946bf4f21aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.972051 14565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8cb687ae3b48c29f6636a0e1d452b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.975265 14559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c2470e057c4097a3c77fa2a2e297f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.983168 14564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1973adcf694e948fadf3fbf5fae271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.009718 14560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ccb1a97c9c45e5aa67bbec180c8a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.032725 14561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204080e18f1348968d9b8a950a6e7e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.083477 14621 tablet_bootstrap.cc:492] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:38.084069 14620 tablet_bootstrap.cc:492] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:38.112171 14491 tablet_service.cc:1511] Processing CreateTablet for tablet dd8cb687ae3b48c29f6636a0e1d452b4 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:38.112074 14493 tablet_service.cc:1511] Processing CreateTablet for tablet 1d38931cd671415180052e38260c8b69 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:38.131428 14492 tablet_service.cc:1511] Processing CreateTablet for tablet 7a133c50d0744fc9b8a1946bf4f21aff (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:38.131616 14488 tablet_service.cc:1511] Processing CreateTablet for tablet e853e410f11f4c37b988d6ea8704e940 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:38.127394 14490 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1973adcf694e948fadf3fbf5fae271 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:38.147343 14491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8cb687ae3b48c29f6636a0e1d452b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.151226 14487 tablet_service.cc:1511] Processing CreateTablet for tablet 204080e18f1348968d9b8a950a6e7e56 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:38.119680 14489 tablet_service.cc:1511] Processing CreateTablet for tablet 38addde16fdd4f82974dc39497c1efb4 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:38.159510 14485 tablet_service.cc:1511] Processing CreateTablet for tablet c7c2470e057c4097a3c77fa2a2e297f0 (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:38.159518 14486 tablet_service.cc:1511] Processing CreateTablet for tablet 38ccb1a97c9c45e5aa67bbec180c8a8e (DEFAULT_TABLE table=test-workload [id=571da05ac6084189ba407d151c1a06a3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:38.184262 14490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1973adcf694e948fadf3fbf5fae271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.189007 14485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c2470e057c4097a3c77fa2a2e297f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.190994 14487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204080e18f1348968d9b8a950a6e7e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.192413 14488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e853e410f11f4c37b988d6ea8704e940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.195302 14493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d38931cd671415180052e38260c8b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.197140 14486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ccb1a97c9c45e5aa67bbec180c8a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.196535 14620 tablet_bootstrap.cc:654] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.206668 14492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a133c50d0744fc9b8a1946bf4f21aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.219271 14489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38addde16fdd4f82974dc39497c1efb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.252573 14621 tablet_bootstrap.cc:654] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.260950 14620 tablet_bootstrap.cc:492] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:38.261667 14620 ts_tablet_manager.cc:1403] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.178s	user 0.010s	sys 0.020s
I20260709 13:03:38.271948 14453 heartbeater.cc:499] Master 127.13.245.126:42903 was elected leader, sending a full tablet report...
I20260709 13:03:38.293224 14621 tablet_bootstrap.cc:492] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:38.293977 14621 ts_tablet_manager.cc:1403] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.211s	user 0.012s	sys 0.008s
I20260709 13:03:38.301345 14621 raft_consensus.cc:359] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.302299 14621 raft_consensus.cc:385] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.302628 14621 raft_consensus.cc:740] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.303535 14621 consensus_queue.cc:260] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.313563 14624 tablet_bootstrap.cc:492] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:38.297796 14620 raft_consensus.cc:359] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.314472 14620 raft_consensus.cc:385] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.323917 14620 raft_consensus.cc:740] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.331229 14621 ts_tablet_manager.cc:1434] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.037s	user 0.011s	sys 0.004s
I20260709 13:03:38.333698 14621 tablet_bootstrap.cc:492] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:38.340418 14620 consensus_queue.cc:260] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.341796 14626 raft_consensus.cc:493] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.342376 14626 raft_consensus.cc:515] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.344539 14624 tablet_bootstrap.cc:654] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.345532 14602 heartbeater.cc:499] Master 127.13.245.126:42903 was elected leader, sending a full tablet report...
I20260709 13:03:38.346024 14620 ts_tablet_manager.cc:1434] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.016s
I20260709 13:03:38.347112 14620 tablet_bootstrap.cc:492] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:38.349472 14621 tablet_bootstrap.cc:654] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.356003 14626 leader_election.cc:290] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:38.377457 14620 tablet_bootstrap.cc:654] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.382659 14624 tablet_bootstrap.cc:492] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
I20260709 13:03:38.386679 14624 ts_tablet_manager.cc:1403] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.000s
I20260709 13:03:38.392223 14624 raft_consensus.cc:359] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.393150 14624 raft_consensus.cc:385] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.393478 14624 raft_consensus.cc:740] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.397017 14624 consensus_queue.cc:260] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.404089 14621 tablet_bootstrap.cc:492] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:38.404690 14621 ts_tablet_manager.cc:1403] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.021s
I20260709 13:03:38.405252 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:38.406313 14503 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 0.
I20260709 13:03:38.408213 14542 leader_election.cc:304] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: 
I20260709 13:03:38.409247 14626 raft_consensus.cc:2804] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.409729 14626 raft_consensus.cc:493] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.410133 14626 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.411926 14620 tablet_bootstrap.cc:492] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:38.408480 14621 raft_consensus.cc:359] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.413465 14621 raft_consensus.cc:385] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.414386 14621 raft_consensus.cc:740] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.415366 14621 consensus_queue.cc:260] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.417671 14621 ts_tablet_manager.cc:1434] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:03:38.414048 14620 ts_tablet_manager.cc:1403] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.010s
I20260709 13:03:38.419086 14626 raft_consensus.cc:515] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
W20260709 13:03:38.421139 14603 tablet.cc:2406] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:38.421924 14626 leader_election.cc:290] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:38.423310 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:38.424018 14503 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.428243 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:38.429231 14428 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 0.
I20260709 13:03:38.433769 14503 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
I20260709 13:03:38.434850 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:38.435518 14428 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.436635 14620 raft_consensus.cc:359] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.437445 14620 raft_consensus.cc:385] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.437809 14620 raft_consensus.cc:740] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.438692 14620 consensus_queue.cc:260] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.435326 14542 leader_election.cc:304] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: 
I20260709 13:03:38.440644 14621 tablet_bootstrap.cc:492] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:38.444904 14428 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
I20260709 13:03:38.447711 14626 raft_consensus.cc:2804] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.448429 14620 ts_tablet_manager.cc:1434] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:03:38.448331 14626 raft_consensus.cc:697] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:38.449755 14620 tablet_bootstrap.cc:492] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:38.449998 14626 consensus_queue.cc:237] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.452559 14528 heartbeater.cc:499] Master 127.13.245.126:42903 was elected leader, sending a full tablet report...
I20260709 13:03:38.453053 14624 ts_tablet_manager.cc:1434] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.066s	user 0.014s	sys 0.000s
I20260709 13:03:38.454039 14624 tablet_bootstrap.cc:492] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:38.465421 14621 tablet_bootstrap.cc:654] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.474073 14624 tablet_bootstrap.cc:654] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.475836 14620 tablet_bootstrap.cc:654] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.479031 14324 catalog_manager.cc:5697] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.495458 14624 tablet_bootstrap.cc:492] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
I20260709 13:03:38.496129 14624 ts_tablet_manager.cc:1403] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.006s
I20260709 13:03:38.496565 14621 tablet_bootstrap.cc:492] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:38.497133 14621 ts_tablet_manager.cc:1403] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.012s
I20260709 13:03:38.499297 14624 raft_consensus.cc:359] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.501149 14624 raft_consensus.cc:385] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.500852 14621 raft_consensus.cc:359] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:38.501919 14621 raft_consensus.cc:385] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.501514 14624 raft_consensus.cc:740] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.502370 14621 raft_consensus.cc:740] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.503841 14624 consensus_queue.cc:260] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.503484 14621 consensus_queue.cc:260] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:38.506187 14624 ts_tablet_manager.cc:1434] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:38.506525 14621 ts_tablet_manager.cc:1434] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:03:38.507998 14621 tablet_bootstrap.cc:492] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:38.510725 14620 tablet_bootstrap.cc:492] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:38.511263 14620 ts_tablet_manager.cc:1403] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.011s
I20260709 13:03:38.514715 14620 raft_consensus.cc:359] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.515578 14620 raft_consensus.cc:385] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.515611 14621 tablet_bootstrap.cc:654] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.515980 14620 raft_consensus.cc:740] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.517185 14624 tablet_bootstrap.cc:492] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:38.522354 14620 consensus_queue.cc:260] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.526104 14620 ts_tablet_manager.cc:1434] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:38.528776 14620 tablet_bootstrap.cc:492] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:38.539966 14620 tablet_bootstrap.cc:654] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.541926 14624 tablet_bootstrap.cc:654] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.551872 14621 tablet_bootstrap.cc:492] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:38.552947 14621 ts_tablet_manager.cc:1403] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.035s
I20260709 13:03:38.557775 14621 raft_consensus.cc:359] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.559038 14621 raft_consensus.cc:385] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.559762 14621 raft_consensus.cc:740] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.561847 14621 consensus_queue.cc:260] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.564457 14621 ts_tablet_manager.cc:1434] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:03:38.569314 14621 tablet_bootstrap.cc:492] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:38.573906 14620 tablet_bootstrap.cc:492] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:38.574584 14620 ts_tablet_manager.cc:1403] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.007s
I20260709 13:03:38.578128 14620 raft_consensus.cc:359] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:38.579022 14620 raft_consensus.cc:385] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.579442 14620 raft_consensus.cc:740] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.580462 14620 consensus_queue.cc:260] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:38.583407 14620 ts_tablet_manager.cc:1434] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:03:38.585157 14621 tablet_bootstrap.cc:654] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.585361 14620 tablet_bootstrap.cc:492] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:38.593616 14620 tablet_bootstrap.cc:654] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.597056 14624 tablet_bootstrap.cc:492] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
I20260709 13:03:38.597715 14624 ts_tablet_manager.cc:1403] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.007s
I20260709 13:03:38.600078 14621 tablet_bootstrap.cc:492] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:38.600785 14621 ts_tablet_manager.cc:1403] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.008s
I20260709 13:03:38.602084 14624 raft_consensus.cc:359] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.602942 14624 raft_consensus.cc:385] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.603296 14624 raft_consensus.cc:740] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.604174 14624 consensus_queue.cc:260] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.604806 14620 tablet_bootstrap.cc:492] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:38.604585 14621 raft_consensus.cc:359] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.605353 14620 ts_tablet_manager.cc:1403] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:03:38.607616 14621 raft_consensus.cc:385] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.608140 14621 raft_consensus.cc:740] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.609248 14621 consensus_queue.cc:260] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.606674 14624 ts_tablet_manager.cc:1434] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:03:38.612494 14621 ts_tablet_manager.cc:1434] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:03:38.612600 14624 tablet_bootstrap.cc:492] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:38.613950 14621 tablet_bootstrap.cc:492] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:38.611367 14620 raft_consensus.cc:359] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.616559 14620 raft_consensus.cc:385] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.617214 14620 raft_consensus.cc:740] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.619305 14620 consensus_queue.cc:260] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.622450 14621 tablet_bootstrap.cc:654] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.627650 14633 raft_consensus.cc:493] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.628518 14633 raft_consensus.cc:515] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.635699 14633 leader_election.cc:290] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:38.639624 14625 raft_consensus.cc:493] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.640259 14625 raft_consensus.cc:515] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.642634 14620 ts_tablet_manager.cc:1434] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:03:38.643939 14620 tablet_bootstrap.cc:492] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:38.643348 14625 leader_election.cc:290] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:38.654321 14625 raft_consensus.cc:493] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.658526 14625 raft_consensus.cc:515] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.662781 14625 leader_election.cc:290] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:38.663620 14626 raft_consensus.cc:493] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.664191 14626 raft_consensus.cc:515] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.666548 14626 leader_election.cc:290] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:38.672326 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:38.675282 14625 raft_consensus.cc:493] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.676069 14625 raft_consensus.cc:515] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
W20260709 13:03:38.678187 14542 leader_election.cc:343] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.678930 14625 leader_election.cc:290] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc85955fabf547be8853867e5b655467 (127.13.245.67:43279), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:38.680358 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:38.681208 14428 raft_consensus.cc:2468] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 0.
I20260709 13:03:38.684994 14620 tablet_bootstrap.cc:654] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.686347 14469 leader_election.cc:304] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:38.689481 14633 raft_consensus.cc:2804] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.691797 14633 raft_consensus.cc:493] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.692368 14633 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.697863 14621 tablet_bootstrap.cc:492] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:38.699717 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:38.702854 14502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c2470e057c4097a3c77fa2a2e297f0" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:38.704401 14624 tablet_bootstrap.cc:654] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.702103 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
W20260709 13:03:38.715725 14393 leader_election.cc:343] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:38.718082 14393 leader_election.cc:343] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.719892 14621 ts_tablet_manager.cc:1403] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.008s
I20260709 13:03:38.719998 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:38.720898 14428 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 0.
I20260709 13:03:38.722529 14543 leader_election.cc:304] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:38.723658 14626 raft_consensus.cc:2804] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.724114 14626 raft_consensus.cc:493] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.724524 14626 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.737325 14633 raft_consensus.cc:515] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.739921 14503 raft_consensus.cc:2393] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e528d66001e94fb492f62d211ef91a50 in current term 1: Already voted for candidate b67f826ecc324d8db0fd6c337a08c7dd in this term.
I20260709 13:03:38.744355 14626 raft_consensus.cc:515] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.744786 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:38.745373 14428 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.742848 14621 raft_consensus.cc:359] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.747699 14621 raft_consensus.cc:385] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.748173 14621 raft_consensus.cc:740] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.749083 14633 leader_election.cc:290] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:38.754228 14620 tablet_bootstrap.cc:492] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:38.755740 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:38.756152 14620 ts_tablet_manager.cc:1403] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.112s	user 0.035s	sys 0.015s
I20260709 13:03:38.757748 14427 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.755684 14621 consensus_queue.cc:260] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.758327 14626 leader_election.cc:290] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:38.762418 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:38.768057 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:38.767463 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
W20260709 13:03:38.769145 14542 leader_election.cc:343] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.770591 14621 ts_tablet_manager.cc:1434] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.003s
W20260709 13:03:38.776808 14466 leader_election.cc:343] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc85955fabf547be8853867e5b655467 (127.13.245.67:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.776808 14624 tablet_bootstrap.cc:492] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
W20260709 13:03:38.778213 14466 leader_election.cc:343] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc85955fabf547be8853867e5b655467 (127.13.245.67:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.779222 14624 ts_tablet_manager.cc:1403] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.006s
I20260709 13:03:38.777267 14621 tablet_bootstrap.cc:492] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:38.778949 14620 raft_consensus.cc:359] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.787973 14428 raft_consensus.cc:2468] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 1.
I20260709 13:03:38.788259 14620 raft_consensus.cc:385] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.788745 14620 raft_consensus.cc:740] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.790297 14469 leader_election.cc:304] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: cc85955fabf547be8853867e5b655467
I20260709 13:03:38.791950 14633 raft_consensus.cc:2804] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.793222 14624 raft_consensus.cc:359] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.794214 14624 raft_consensus.cc:385] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.794629 14624 raft_consensus.cc:740] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.795105 14620 consensus_queue.cc:260] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.795715 14624 consensus_queue.cc:260] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.803426 14427 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
I20260709 13:03:38.801940 14633 raft_consensus.cc:697] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:38.803622 14620 ts_tablet_manager.cc:1434] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.002s
I20260709 13:03:38.805405 14543 leader_election.cc:304] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:38.806236 14626 raft_consensus.cc:2804] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.806664 14620 tablet_bootstrap.cc:492] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:38.806793 14626 raft_consensus.cc:697] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:38.807870 14626 consensus_queue.cc:237] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.808705 14621 tablet_bootstrap.cc:654] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.805001 14633 consensus_queue.cc:237] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
W20260709 13:03:38.820156 14373 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:38.826879 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
I20260709 13:03:38.829717 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
I20260709 13:03:38.831892 14575 raft_consensus.cc:2468] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 0.
I20260709 13:03:38.832719 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c2470e057c4097a3c77fa2a2e297f0" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
W20260709 13:03:38.835480 14391 leader_election.cc:343] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc85955fabf547be8853867e5b655467 (127.13.245.67:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.836259 14391 leader_election.cc:304] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e528d66001e94fb492f62d211ef91a50; no voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467
I20260709 13:03:38.837451 14624 ts_tablet_manager.cc:1434] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.058s	user 0.016s	sys 0.004s
I20260709 13:03:38.837910 14391 leader_election.cc:304] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:38.839597 14625 raft_consensus.cc:2749] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.839879 14624 tablet_bootstrap.cc:492] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:38.840842 14625 raft_consensus.cc:2804] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.841645 14625 raft_consensus.cc:493] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.842041 14625 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.841318 14323 catalog_manager.cc:5697] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.866333 14625 raft_consensus.cc:515] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:38.883176 14626 consensus_queue.cc:1048] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.889773 14624 tablet_bootstrap.cc:654] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.890682 14620 tablet_bootstrap.cc:654] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.894691 14323 catalog_manager.cc:5697] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 0 to 1, leader changed from <none> to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 1 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:38.897382 14391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43279, user_credentials={real_user=slave}} blocked reactor thread for 59549.4us
I20260709 13:03:38.901039 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:38.902271 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:38.900403 14625 leader_election.cc:290] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 election: Requested vote from peers cc85955fabf547be8853867e5b655467 (127.13.245.67:43279), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
W20260709 13:03:38.904024 14391 leader_election.cc:343] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc85955fabf547be8853867e5b655467 (127.13.245.67:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.904556 14391 leader_election.cc:304] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e528d66001e94fb492f62d211ef91a50; no voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467
I20260709 13:03:38.904851 14621 tablet_bootstrap.cc:492] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:38.906098 14626 raft_consensus.cc:493] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.906340 14393 leader_election.cc:343] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.902271 14576 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.906693 14626 raft_consensus.cc:515] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.909291 14626 leader_election.cc:290] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:38.905596 14621 ts_tablet_manager.cc:1403] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.129s	user 0.019s	sys 0.011s
I20260709 13:03:38.911309 14625 raft_consensus.cc:2749] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.917501 14620 tablet_bootstrap.cc:492] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:38.917448 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:38.918248 14620 ts_tablet_manager.cc:1403] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.002s
I20260709 13:03:38.919277 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:38.920918 14621 raft_consensus.cc:359] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
W20260709 13:03:38.923571 14542 leader_election.cc:343] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.922228 14621 raft_consensus.cc:385] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.924119 14621 raft_consensus.cc:740] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.921973 14620 raft_consensus.cc:359] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.924849 14620 raft_consensus.cc:385] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:38.926431 14543 leader_election.cc:343] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.926939 14543 leader_election.cc:304] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc85955fabf547be8853867e5b655467; no voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50
I20260709 13:03:38.925179 14620 raft_consensus.cc:740] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.931898 14627 raft_consensus.cc:2749] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.937894 14576 raft_consensus.cc:2468] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 1.
I20260709 13:03:38.936749 14624 tablet_bootstrap.cc:492] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
I20260709 13:03:38.933676 14620 consensus_queue.cc:260] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.941329 14624 ts_tablet_manager.cc:1403] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.008s
I20260709 13:03:38.942382 14391 leader_election.cc:304] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:38.943321 14625 raft_consensus.cc:2804] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.943886 14625 raft_consensus.cc:697] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 1 LEADER]: Becoming Leader. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:38.938438 14621 consensus_queue.cc:260] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.944820 14625 consensus_queue.cc:237] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:38.953644 14621 ts_tablet_manager.cc:1434] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:03:38.949477 14620 ts_tablet_manager.cc:1434] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:03:38.949345 14627 raft_consensus.cc:493] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.949823 14624 raft_consensus.cc:359] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.966632 14627 raft_consensus.cc:515] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.969794 14627 leader_election.cc:290] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:38.972280 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38addde16fdd4f82974dc39497c1efb4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:38.973337 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38addde16fdd4f82974dc39497c1efb4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:38.973591 14427 raft_consensus.cc:2468] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 0.
I20260709 13:03:38.974125 14503 raft_consensus.cc:2468] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 0.
I20260709 13:03:38.975773 14543 leader_election.cc:304] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:38.977097 14627 consensus_queue.cc:1048] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.977191 14323 catalog_manager.cc:5697] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to e528d66001e94fb492f62d211ef91a50 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "e528d66001e94fb492f62d211ef91a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.979000 14627 raft_consensus.cc:2804] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.979465 14627 raft_consensus.cc:493] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.979996 14627 raft_consensus.cc:3060] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.963949 14620 tablet_bootstrap.cc:492] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:38.966578 14624 raft_consensus.cc:385] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.982713 14624 raft_consensus.cc:740] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.983822 14624 consensus_queue.cc:260] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.988112 14624 ts_tablet_manager.cc:1434] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.001s
I20260709 13:03:38.963685 14621 tablet_bootstrap.cc:492] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:38.992177 14624 tablet_bootstrap.cc:492] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:39.000594 14620 tablet_bootstrap.cc:654] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.006379 14667 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.006994 14667 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:38.999331 14627 raft_consensus.cc:515] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.014254 14656 raft_consensus.cc:493] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.014817 14656 raft_consensus.cc:515] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.012774 14633 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.018077 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:39.019184 14633 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
W20260709 13:03:39.020263 14543 leader_election.cc:343] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:39.021934 14633 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:39.023494 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:39.023993 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:39.028046 14501 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 0.
W20260709 13:03:39.029049 14469 leader_election.cc:343] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:39.030032 14621 tablet_bootstrap.cc:654] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.031164 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
I20260709 13:03:39.031733 14627 leader_election.cc:290] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:39.032058 14576 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 0.
I20260709 13:03:39.032940 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204080e18f1348968d9b8a950a6e7e56" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:39.031116 14542 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: e528d66001e94fb492f62d211ef91a50
I20260709 13:03:39.033699 14428 raft_consensus.cc:2468] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 0.
I20260709 13:03:39.028599 14656 leader_election.cc:290] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:39.017565 14667 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:39.035715 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204080e18f1348968d9b8a950a6e7e56" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
I20260709 13:03:39.035862 14469 leader_election.cc:304] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:39.034363 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38addde16fdd4f82974dc39497c1efb4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:39.034296 14627 raft_consensus.cc:2804] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.037287 14656 raft_consensus.cc:2804] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.037576 14427 raft_consensus.cc:3060] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.037818 14656 raft_consensus.cc:493] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.038300 14656 raft_consensus.cc:3060] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.037796 14627 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.038909 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38addde16fdd4f82974dc39497c1efb4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:39.036492 14576 raft_consensus.cc:2468] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 0.
I20260709 13:03:39.039616 14501 raft_consensus.cc:3060] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.041953 14466 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: e528d66001e94fb492f62d211ef91a50
I20260709 13:03:39.043001 14633 raft_consensus.cc:2804] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.043418 14633 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.043833 14633 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.039824 14627 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.046892 14624 tablet_bootstrap.cc:654] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.057423 14656 raft_consensus.cc:515] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.063652 14656 leader_election.cc:290] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:39.064126 14633 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.064936 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204080e18f1348968d9b8a950a6e7e56" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:39.066872 14428 raft_consensus.cc:3060] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.076129 14426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
W20260709 13:03:39.079836 14469 leader_election.cc:343] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:39.074805 14633 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:39.081481 14627 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.083501 14627 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:39.084483 14620 tablet_bootstrap.cc:492] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:39.084757 14426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:39.085022 14620 ts_tablet_manager.cc:1403] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.121s	user 0.022s	sys 0.004s
I20260709 13:03:39.089869 14503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:39.090608 14621 tablet_bootstrap.cc:492] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:39.091168 14621 ts_tablet_manager.cc:1403] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.128s	user 0.027s	sys 0.005s
I20260709 13:03:39.092075 14428 raft_consensus.cc:2468] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 1.
I20260709 13:03:39.093428 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:39.094380 14575 raft_consensus.cc:2393] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b67f826ecc324d8db0fd6c337a08c7dd in current term 1: Already voted for candidate cc85955fabf547be8853867e5b655467 in this term.
I20260709 13:03:39.094714 14621 raft_consensus.cc:359] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.095846 14621 raft_consensus.cc:385] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.096989 14621 raft_consensus.cc:740] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.095813 14427 raft_consensus.cc:2468] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
W20260709 13:03:39.086836 14543 leader_election.cc:343] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:39.097952 14466 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd; no voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50
I20260709 13:03:39.098065 14621 consensus_queue.cc:260] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.097133 14503 raft_consensus.cc:2393] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc85955fabf547be8853867e5b655467 in current term 1: Already voted for candidate b67f826ecc324d8db0fd6c337a08c7dd in this term.
I20260709 13:03:39.098479 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204080e18f1348968d9b8a950a6e7e56" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:39.101234 14576 raft_consensus.cc:3060] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.101501 14621 ts_tablet_manager.cc:1434] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:03:39.103009 14621 tablet_bootstrap.cc:492] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50: Bootstrap starting.
I20260709 13:03:39.100425 14543 leader_election.cc:304] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:39.095388 14469 leader_election.cc:304] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:39.108632 14656 raft_consensus.cc:2804] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.108727 14633 raft_consensus.cc:2749] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:39.109417 14624 tablet_bootstrap.cc:492] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
I20260709 13:03:39.111449 14624 ts_tablet_manager.cc:1403] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.011s
I20260709 13:03:39.112613 14501 raft_consensus.cc:2468] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
I20260709 13:03:39.110296 14620 raft_consensus.cc:359] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.109303 14656 raft_consensus.cc:697] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:39.113263 14620 raft_consensus.cc:385] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.113590 14621 tablet_bootstrap.cc:654] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.113834 14656 consensus_queue.cc:237] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.116360 14576 raft_consensus.cc:2468] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 1.
I20260709 13:03:39.113615 14620 raft_consensus.cc:740] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.117924 14620 consensus_queue.cc:260] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.123271 14620 ts_tablet_manager.cc:1434] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:03:39.113837 14627 raft_consensus.cc:2804] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.127746 14667 raft_consensus.cc:493] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.128222 14627 raft_consensus.cc:697] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:39.116608 14624 raft_consensus.cc:359] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:39.128638 14667 raft_consensus.cc:515] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.129460 14627 consensus_queue.cc:237] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.131664 14667 leader_election.cc:290] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:39.132632 14624 raft_consensus.cc:385] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.133107 14624 raft_consensus.cc:740] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.134091 14624 consensus_queue.cc:260] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:39.141286 14621 tablet_bootstrap.cc:492] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50: No bootstrap required, opened a new log
I20260709 13:03:39.129562 14620 tablet_bootstrap.cc:492] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467: Bootstrap starting.
I20260709 13:03:39.141960 14621 ts_tablet_manager.cc:1403] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.014s
I20260709 13:03:39.145457 14621 raft_consensus.cc:359] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.121491 14542 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc85955fabf547be8853867e5b655467; no voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50
I20260709 13:03:39.148545 14324 catalog_manager.cc:5697] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 0 to 1, leader changed from <none> to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 1 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.146763 14624 ts_tablet_manager.cc:1434] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:03:39.135375 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:39.150427 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:39.151099 14427 raft_consensus.cc:2393] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc85955fabf547be8853867e5b655467 in current term 1: Already voted for candidate b67f826ecc324d8db0fd6c337a08c7dd in this term.
I20260709 13:03:39.152567 14542 leader_election.cc:304] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc85955fabf547be8853867e5b655467; no voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50
I20260709 13:03:39.153649 14624 tablet_bootstrap.cc:492] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:39.153600 14667 raft_consensus.cc:2749] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:39.154592 14667 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.155078 14320 catalog_manager.cc:5697] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.150455 14620 tablet_bootstrap.cc:654] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.163983 14667 raft_consensus.cc:2749] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:39.164865 14621 raft_consensus.cc:385] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.165243 14621 raft_consensus.cc:740] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.166081 14621 consensus_queue.cc:260] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.174978 14621 ts_tablet_manager.cc:1434] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:03:39.177436 14624 tablet_bootstrap.cc:654] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.192584 14620 tablet_bootstrap.cc:492] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467: No bootstrap required, opened a new log
I20260709 13:03:39.193171 14620 ts_tablet_manager.cc:1403] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.015s
I20260709 13:03:39.194772 14624 tablet_bootstrap.cc:492] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
I20260709 13:03:39.195379 14624 ts_tablet_manager.cc:1403] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.003s
I20260709 13:03:39.196422 14620 raft_consensus.cc:359] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.197201 14620 raft_consensus.cc:385] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.197510 14620 raft_consensus.cc:740] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.198371 14620 consensus_queue.cc:260] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.198910 14624 raft_consensus.cc:359] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.199400 14625 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.199705 14624 raft_consensus.cc:385] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.200063 14625 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.201678 14620 ts_tablet_manager.cc:1434] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:39.200071 14624 raft_consensus.cc:740] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.204603 14625 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:39.205667 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
I20260709 13:03:39.205530 14624 consensus_queue.cc:260] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.206586 14576 raft_consensus.cc:2393] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e528d66001e94fb492f62d211ef91a50 in current term 1: Already voted for candidate cc85955fabf547be8853867e5b655467 in this term.
I20260709 13:03:39.207805 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:39.208248 14624 ts_tablet_manager.cc:1434] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:03:39.208873 14501 raft_consensus.cc:2393] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e528d66001e94fb492f62d211ef91a50 in current term 1: Already voted for candidate b67f826ecc324d8db0fd6c337a08c7dd in this term.
I20260709 13:03:39.209600 14624 tablet_bootstrap.cc:492] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:39.213114 14391 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e528d66001e94fb492f62d211ef91a50; no voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467
I20260709 13:03:39.215350 14625 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.218403 14624 tablet_bootstrap.cc:654] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.225606 14625 raft_consensus.cc:2749] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:39.226485 14624 tablet_bootstrap.cc:492] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
I20260709 13:03:39.227054 14624 ts_tablet_manager.cc:1403] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:03:39.230101 14624 raft_consensus.cc:359] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.230937 14624 raft_consensus.cc:385] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.231225 14624 raft_consensus.cc:740] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.232061 14624 consensus_queue.cc:260] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.234254 14624 ts_tablet_manager.cc:1434] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:03:39.235430 14624 tablet_bootstrap.cc:492] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd: Bootstrap starting.
I20260709 13:03:39.243861 14624 tablet_bootstrap.cc:654] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.251051 14624 tablet_bootstrap.cc:492] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd: No bootstrap required, opened a new log
I20260709 13:03:39.251809 14624 ts_tablet_manager.cc:1403] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:03:39.255319 14624 raft_consensus.cc:359] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.256639 14624 raft_consensus.cc:385] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.257041 14624 raft_consensus.cc:740] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.257916 14624 consensus_queue.cc:260] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.259249 14667 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.260766 14624 ts_tablet_manager.cc:1434] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:39.274789 14501 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.283707 14656 raft_consensus.cc:493] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.284337 14656 raft_consensus.cc:515] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:39.288478 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
I20260709 13:03:39.288964 14656 leader_election.cc:290] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc85955fabf547be8853867e5b655467 (127.13.245.67:43279), e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129)
I20260709 13:03:39.289489 14576 raft_consensus.cc:2393] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b67f826ecc324d8db0fd6c337a08c7dd in current term 1: Already voted for candidate e528d66001e94fb492f62d211ef91a50 in this term.
I20260709 13:03:39.288478 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:39.292765 14469 leader_election.cc:304] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd; no voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50
I20260709 13:03:39.293314 14666 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.294762 14633 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.297043 14655 consensus_queue.cc:1048] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.305457 14666 raft_consensus.cc:493] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.306156 14633 raft_consensus.cc:2749] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:39.306103 14666 raft_consensus.cc:515] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.310457 14666 leader_election.cc:290] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:39.311195 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c2470e057c4097a3c77fa2a2e297f0" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:39.312173 14427 raft_consensus.cc:2468] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 0.
I20260709 13:03:39.312436 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c2470e057c4097a3c77fa2a2e297f0" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:39.313141 14501 raft_consensus.cc:2468] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 0.
I20260709 13:03:39.313637 14543 leader_election.cc:304] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:39.314646 14627 raft_consensus.cc:2804] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.315047 14627 raft_consensus.cc:493] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.315408 14627 raft_consensus.cc:3060] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.326653 14627 raft_consensus.cc:515] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.328999 14627 leader_election.cc:290] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:39.332060 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c2470e057c4097a3c77fa2a2e297f0" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:39.333055 14501 raft_consensus.cc:3060] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.334535 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c2470e057c4097a3c77fa2a2e297f0" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:39.335217 14428 raft_consensus.cc:3060] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.339305 14655 consensus_queue.cc:1048] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.343518 14428 raft_consensus.cc:2468] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
I20260709 13:03:39.345817 14543 leader_election.cc:304] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:39.348272 14627 raft_consensus.cc:2804] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.343928 14501 raft_consensus.cc:2468] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
I20260709 13:03:39.354514 14627 raft_consensus.cc:697] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:39.355882 14627 consensus_queue.cc:237] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.369781 14324 catalog_manager.cc:5697] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.488997 14625 consensus_queue.cc:1048] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.512566 14688 consensus_queue.cc:1048] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.560600 14655 raft_consensus.cc:493] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.561218 14655 raft_consensus.cc:515] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.563410 14655 leader_election.cc:290] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:39.564471 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:39.564741 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467" is_pre_election: true
I20260709 13:03:39.565294 14428 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 0.
I20260709 13:03:39.565320 14576 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 0.
I20260709 13:03:39.566776 14466 leader_election.cc:304] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: 
I20260709 13:03:39.567655 14655 raft_consensus.cc:2804] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.568076 14655 raft_consensus.cc:493] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.568389 14655 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.573977 14655 raft_consensus.cc:515] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.576031 14655 leader_election.cc:290] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:39.577172 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:39.577396 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:39.577772 14428 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.578027 14576 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.583487 14428 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 1.
I20260709 13:03:39.584944 14469 leader_election.cc:304] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:39.585345 14576 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 1.
I20260709 13:03:39.585780 14655 raft_consensus.cc:2804] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.586380 14655 raft_consensus.cc:697] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:39.587806 14655 consensus_queue.cc:237] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:39.597369 14324 catalog_manager.cc:5697] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 0 to 1, leader changed from <none> to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 1 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.626961 14655 consensus_queue.cc:1048] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.645807 14656 consensus_queue.cc:1048] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.698855 14627 consensus_queue.cc:1048] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.715819 14666 consensus_queue.cc:1048] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.752368 14666 consensus_queue.cc:1048] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.770242 14627 consensus_queue.cc:1048] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:39.827705 14373 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:39.993794 14656 consensus_queue.cc:1048] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:40.010607 14655 consensus_queue.cc:1048] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:40.697243 14667 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.697829 14667 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:40.699968 14667 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:40.700893 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50" is_pre_election: true
I20260709 13:03:40.700996 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" is_pre_election: true
I20260709 13:03:40.701650 14428 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
I20260709 13:03:40.701723 14501 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 1.
I20260709 13:03:40.703095 14542 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: 
I20260709 13:03:40.704080 14667 raft_consensus.cc:2804] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:40.704439 14667 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.704794 14667 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.711848 14667 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:40.715448 14667 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 2 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:40.716754 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:40.717388 14428 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.717561 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:40.718338 14501 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.725840 14428 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 2.
I20260709 13:03:40.725808 14501 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 2.
I20260709 13:03:40.727777 14543 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:40.728714 14667 raft_consensus.cc:2804] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:40.730352 14667 raft_consensus.cc:697] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 2 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:40.731812 14667 consensus_queue.cc:237] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:40.741084 14324 catalog_manager.cc:5697] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 0 to 2, leader changed from <none> to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.151846 14501 raft_consensus.cc:1275] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:41.153285 14667 consensus_queue.cc:1048] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:41.167016 14427 raft_consensus.cc:1275] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:41.168876 14667 consensus_queue.cc:1048] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:41.295219 14501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
mode: GRACEFUL
new_leader_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:48600
I20260709 13:03:41.295979 14501 raft_consensus.cc:606] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Received request to transfer leadership to TS e528d66001e94fb492f62d211ef91a50
I20260709 13:03:41.313220 14576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4"
dest_uuid: "cc85955fabf547be8853867e5b655467"
mode: GRACEFUL
new_leader_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:49252
I20260709 13:03:41.313848 14576 raft_consensus.cc:606] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Received request to transfer leadership to TS e528d66001e94fb492f62d211ef91a50
I20260709 13:03:41.320235 14501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
mode: GRACEFUL
new_leader_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:48600
I20260709 13:03:41.320851 14501 raft_consensus.cc:606] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Received request to transfer leadership to TS e528d66001e94fb492f62d211ef91a50
I20260709 13:03:41.327013 14576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38addde16fdd4f82974dc39497c1efb4"
dest_uuid: "cc85955fabf547be8853867e5b655467"
mode: GRACEFUL
new_leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:49252
I20260709 13:03:41.327730 14576 raft_consensus.cc:606] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Received request to transfer leadership to TS b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:41.334221 14576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940"
dest_uuid: "cc85955fabf547be8853867e5b655467"
mode: GRACEFUL
new_leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:49252
I20260709 13:03:41.334797 14576 raft_consensus.cc:606] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Received request to transfer leadership to TS b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:41.345039 14576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e"
dest_uuid: "cc85955fabf547be8853867e5b655467"
mode: GRACEFUL
new_leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:49252
I20260709 13:03:41.345675 14576 raft_consensus.cc:606] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 2 LEADER]: Received request to transfer leadership to TS b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:41.422930 14701 raft_consensus.cc:993] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467: : Instructing follower e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:41.423448 14667 raft_consensus.cc:1081] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Signalling peer e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:41.425313 14427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:50658
I20260709 13:03:41.425963 14427 raft_consensus.cc:493] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.426327 14427 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.431725 14427 raft_consensus.cc:515] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.433614 14427 leader_election.cc:290] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 2 election: Requested vote from peers b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:41.434918 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:41.434923 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:41.435684 14576 raft_consensus.cc:3055] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:41.435772 14501 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.436071 14576 raft_consensus.cc:740] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:41.436990 14576 consensus_queue.cc:260] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.438175 14576 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.441327 14501 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 2.
I20260709 13:03:41.442646 14393 leader_election.cc:304] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:41.443589 14700 raft_consensus.cc:2804] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:41.443782 14576 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 2.
I20260709 13:03:41.445026 14700 raft_consensus.cc:697] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Becoming Leader. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:41.447662 14700 consensus_queue.cc:237] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.457235 14320 catalog_manager.cc:5697] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 reported cstate change: term changed from 1 to 2, leader changed from cc85955fabf547be8853867e5b655467 (127.13.245.67) to e528d66001e94fb492f62d211ef91a50 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e528d66001e94fb492f62d211ef91a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.484579 14701 raft_consensus.cc:993] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467: : Instructing follower b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:41.485133 14667 raft_consensus.cc:1081] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Signalling peer b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:41.487043 14501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38addde16fdd4f82974dc39497c1efb4"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:51214
I20260709 13:03:41.487668 14501 raft_consensus.cc:493] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.488026 14501 raft_consensus.cc:3060] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.492894 14501 raft_consensus.cc:515] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.494890 14501 leader_election.cc:290] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 2 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:41.495882 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38addde16fdd4f82974dc39497c1efb4" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:41.496413 14427 raft_consensus.cc:3060] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.496240 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38addde16fdd4f82974dc39497c1efb4" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:41.497372 14576 raft_consensus.cc:3055] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:41.497718 14576 raft_consensus.cc:740] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:41.498468 14576 consensus_queue.cc:260] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.499960 14576 raft_consensus.cc:3060] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.501792 14427 raft_consensus.cc:2468] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 2.
I20260709 13:03:41.502990 14469 leader_election.cc:304] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:41.503834 14656 raft_consensus.cc:2804] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:41.505275 14656 raft_consensus.cc:697] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:41.506304 14656 consensus_queue.cc:237] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.507113 14576 raft_consensus.cc:2468] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 2.
I20260709 13:03:41.513656 14656 raft_consensus.cc:993] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd: : Instructing follower e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:41.514147 14656 raft_consensus.cc:1081] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Signalling peer e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:41.515735 14427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:50668
I20260709 13:03:41.516177 14427 raft_consensus.cc:493] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.516440 14427 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.516521 14320 catalog_manager.cc:5697] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 1 to 2, leader changed from cc85955fabf547be8853867e5b655467 (127.13.245.67) to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 2 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.521823 14427 raft_consensus.cc:515] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.523815 14427 leader_election.cc:290] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 2 election: Requested vote from peers b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:41.524695 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:41.525321 14501 raft_consensus.cc:3055] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:41.525758 14501 raft_consensus.cc:740] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:41.525180 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:41.526794 14576 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.526582 14501 consensus_queue.cc:260] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.527921 14501 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.533500 14501 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 2.
I20260709 13:03:41.534096 14576 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 2.
I20260709 13:03:41.534559 14393 leader_election.cc:304] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:41.535367 14700 raft_consensus.cc:2804] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:41.535892 14700 raft_consensus.cc:697] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Becoming Leader. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:41.536726 14700 consensus_queue.cc:237] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.544524 14320 catalog_manager.cc:5697] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 reported cstate change: term changed from 1 to 2, leader changed from b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66) to e528d66001e94fb492f62d211ef91a50 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e528d66001e94fb492f62d211ef91a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.551527 14701 raft_consensus.cc:993] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467: : Instructing follower b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:41.552143 14667 raft_consensus.cc:1081] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 2 LEADER]: Signalling peer b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:41.553869 14501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:51214
I20260709 13:03:41.554469 14501 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.554888 14501 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.561575 14501 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.563822 14501 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 3 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:41.564845 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:41.565022 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:41.565627 14427 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.565630 14576 raft_consensus.cc:3055] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:41.566196 14576 raft_consensus.cc:740] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:41.567123 14576 consensus_queue.cc:260] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.568512 14576 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.574532 14427 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 3.
I20260709 13:03:41.576109 14469 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:41.576763 14576 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 3.
I20260709 13:03:41.577003 14721 raft_consensus.cc:2804] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.577507 14721 raft_consensus.cc:697] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:41.578459 14721 consensus_queue.cc:237] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.586063 14320 catalog_manager.cc:5697] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 2 to 3, leader changed from cc85955fabf547be8853867e5b655467 (127.13.245.67) to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 3 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.623381 14701 raft_consensus.cc:993] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467: : Instructing follower b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:41.623942 14701 raft_consensus.cc:1081] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Signalling peer b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:41.625612 14501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:51214
I20260709 13:03:41.626178 14501 raft_consensus.cc:493] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.626541 14501 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.632200 14501 raft_consensus.cc:515] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.634243 14501 leader_election.cc:290] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 2 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:41.635332 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:41.635600 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:41.635973 14427 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.636268 14576 raft_consensus.cc:3055] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:41.636605 14576 raft_consensus.cc:740] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:41.637524 14576 consensus_queue.cc:260] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.638765 14576 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.641197 14427 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 2.
I20260709 13:03:41.642344 14469 leader_election.cc:304] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:41.643163 14721 raft_consensus.cc:2804] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:41.643747 14721 raft_consensus.cc:697] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:41.644632 14721 consensus_queue.cc:237] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.645576 14576 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 2.
I20260709 13:03:41.654735 14721 raft_consensus.cc:993] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd: : Instructing follower e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:41.654239 14320 catalog_manager.cc:5697] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 1 to 2, leader changed from cc85955fabf547be8853867e5b655467 (127.13.245.67) to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 2 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.655287 14656 raft_consensus.cc:1081] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Signalling peer e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:41.657444 14427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:50668
I20260709 13:03:41.658090 14427 raft_consensus.cc:493] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.658403 14427 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.665800 14427 raft_consensus.cc:515] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.668141 14427 leader_election.cc:290] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 2 election: Requested vote from peers b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:41.668962 14501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:41.669302 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:41.669652 14501 raft_consensus.cc:3055] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:41.669914 14576 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.669992 14501 raft_consensus.cc:740] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:41.670889 14501 consensus_queue.cc:260] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.671917 14501 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.675089 14576 raft_consensus.cc:2468] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 2.
I20260709 13:03:41.676447 14391 leader_election.cc:304] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:41.677424 14700 raft_consensus.cc:2804] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:41.677599 14501 raft_consensus.cc:2468] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 2.
I20260709 13:03:41.677871 14700 raft_consensus.cc:697] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Becoming Leader. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:41.679232 14700 consensus_queue.cc:237] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:41.686479 14320 catalog_manager.cc:5697] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 reported cstate change: term changed from 1 to 2, leader changed from b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66) to e528d66001e94fb492f62d211ef91a50 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e528d66001e94fb492f62d211ef91a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.925383 14576 raft_consensus.cc:1275] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:41.926769 14700 consensus_queue.cc:1048] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:41.937263 14501 raft_consensus.cc:1275] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:41.939226 14716 consensus_queue.cc:1048] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:42.017870 14576 raft_consensus.cc:1275] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.018527 14577 raft_consensus.cc:1275] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.019605 14700 consensus_queue.cc:1048] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.020057 14656 consensus_queue.cc:1048] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.030977 14501 raft_consensus.cc:1275] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.032876 14700 consensus_queue.cc:1048] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.043378 14427 raft_consensus.cc:1275] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.046630 14427 raft_consensus.cc:1275] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.048455 14656 consensus_queue.cc:1048] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:42.048717 14736 consensus_queue.cc:1048] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.067032 14575 raft_consensus.cc:1275] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.070593 14736 consensus_queue.cc:1048] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:42.130210 14427 raft_consensus.cc:1275] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.131778 14736 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.135875 14575 raft_consensus.cc:1275] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.137547 14736 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:42.156545 14502 raft_consensus.cc:1275] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.158264 14700 consensus_queue.cc:1048] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.168769 14575 raft_consensus.cc:1275] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.170563 14700 consensus_queue.cc:1048] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.387777 14293 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:03:44.388878 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:44.410964 14427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
mode: GRACEFUL
new_leader_uuid: "cc85955fabf547be8853867e5b655467"
 from {username='slave'} at 127.0.0.1:40850
I20260709 13:03:44.411674 14427 raft_consensus.cc:606] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Received request to transfer leadership to TS cc85955fabf547be8853867e5b655467
I20260709 13:03:44.423580 14502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
mode: GRACEFUL
new_leader_uuid: "cc85955fabf547be8853867e5b655467"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:03:44.424186 14502 raft_consensus.cc:606] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Received request to transfer leadership to TS cc85955fabf547be8853867e5b655467
I20260709 13:03:44.425437 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:44.425962 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:44.518148 14745 raft_consensus.cc:993] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50: : Instructing follower cc85955fabf547be8853867e5b655467 to start an election
I20260709 13:03:44.518770 14745 raft_consensus.cc:1081] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Signalling peer cc85955fabf547be8853867e5b655467 to start an election
I20260709 13:03:44.520712 14577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff"
dest_uuid: "cc85955fabf547be8853867e5b655467"
 from {username='slave'} at 127.0.0.1:35084
I20260709 13:03:44.521252 14577 raft_consensus.cc:493] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.521646 14577 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.526633 14577 raft_consensus.cc:515] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:44.528656 14577 leader_election.cc:290] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 3 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:44.529749 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:44.530269 14502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:44.530412 14427 raft_consensus.cc:3055] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.530895 14502 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.530939 14427 raft_consensus.cc:740] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:44.531963 14427 consensus_queue.cc:260] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:44.532989 14427 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.536350 14502 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 3.
I20260709 13:03:44.537894 14542 leader_election.cc:304] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: 
I20260709 13:03:44.538656 14701 raft_consensus.cc:2804] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:44.538695 14427 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 3.
I20260709 13:03:44.539944 14701 raft_consensus.cc:697] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:44.540795 14701 consensus_queue.cc:237] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:44.548898 14324 catalog_manager.cc:5697] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 2 to 3, leader changed from e528d66001e94fb492f62d211ef91a50 (127.13.245.65) to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.789486 14755 raft_consensus.cc:993] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd: : Instructing follower cc85955fabf547be8853867e5b655467 to start an election
I20260709 13:03:44.790060 14744 raft_consensus.cc:1081] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Signalling peer cc85955fabf547be8853867e5b655467 to start an election
I20260709 13:03:44.791724 14577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940"
dest_uuid: "cc85955fabf547be8853867e5b655467"
 from {username='slave'} at 127.0.0.1:35082
I20260709 13:03:44.792214 14577 raft_consensus.cc:493] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.792546 14577 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.797192 14577 raft_consensus.cc:515] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:44.798966 14577 leader_election.cc:290] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 3 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:44.799984 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:44.800323 14502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:44.800685 14427 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.800858 14502 raft_consensus.cc:3055] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.801213 14502 raft_consensus.cc:740] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:44.802069 14502 consensus_queue.cc:260] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:44.803370 14502 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.808633 14427 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 3.
I20260709 13:03:44.810004 14543 leader_election.cc:304] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:44.810866 14701 raft_consensus.cc:2804] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:44.811336 14701 raft_consensus.cc:697] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:44.811307 14502 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 3.
I20260709 13:03:44.812395 14701 consensus_queue.cc:237] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:44.820583 14324 catalog_manager.cc:5697] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 2 to 3, leader changed from b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66) to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.090530 14427 raft_consensus.cc:1275] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.091866 14701 consensus_queue.cc:1048] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:45.102984 14502 raft_consensus.cc:1275] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.106081 14759 consensus_queue.cc:1048] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:45.301847 14427 raft_consensus.cc:1275] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.304066 14701 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:45.320499 14501 raft_consensus.cc:1275] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.324318 14701 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:45.427302 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.453438 14427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d38931cd671415180052e38260c8b69"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
mode: GRACEFUL
new_leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:40852
I20260709 13:03:45.454092 14427 raft_consensus.cc:606] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 1 LEADER]: Received request to transfer leadership to TS b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:45.461835 14577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff"
dest_uuid: "cc85955fabf547be8853867e5b655467"
mode: GRACEFUL
new_leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:49252
I20260709 13:03:45.462639 14577 raft_consensus.cc:606] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Received request to transfer leadership to TS b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:45.470713 14427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
mode: GRACEFUL
new_leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:40852
I20260709 13:03:45.471365 14427 raft_consensus.cc:606] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Received request to transfer leadership to TS b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:45.477931 14427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
mode: GRACEFUL
new_leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:40852
I20260709 13:03:45.478659 14427 raft_consensus.cc:606] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Received request to transfer leadership to TS b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:45.489607 14577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940"
dest_uuid: "cc85955fabf547be8853867e5b655467"
mode: GRACEFUL
new_leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:49252
I20260709 13:03:45.490351 14577 raft_consensus.cc:606] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Received request to transfer leadership to TS b67f826ecc324d8db0fd6c337a08c7dd
I20260709 13:03:45.551420 14745 raft_consensus.cc:993] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50: : Instructing follower b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.552030 14745 raft_consensus.cc:1081] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 1 LEADER]: Signalling peer b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.553963 14501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d38931cd671415180052e38260c8b69"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:51218
I20260709 13:03:45.554553 14501 raft_consensus.cc:493] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.554873 14501 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.560786 14501 raft_consensus.cc:515] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:45.562749 14501 leader_election.cc:290] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 2 election: Requested vote from peers cc85955fabf547be8853867e5b655467 (127.13.245.67:43279), e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129)
I20260709 13:03:45.563899 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:45.563890 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:45.564775 14427 raft_consensus.cc:3055] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:45.564788 14577 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.565161 14427 raft_consensus.cc:740] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:45.566057 14427 consensus_queue.cc:260] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:45.567149 14427 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.572574 14577 raft_consensus.cc:2468] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 2.
I20260709 13:03:45.573096 14427 raft_consensus.cc:2468] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 2.
I20260709 13:03:45.574193 14466 leader_election.cc:304] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: 
I20260709 13:03:45.575392 14744 raft_consensus.cc:2804] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:45.575922 14744 raft_consensus.cc:697] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:45.576711 14744 consensus_queue.cc:237] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:45.585718 14324 catalog_manager.cc:5697] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 1 to 2, leader changed from e528d66001e94fb492f62d211ef91a50 (127.13.245.65) to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 2 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.728818 14759 raft_consensus.cc:993] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467: : Instructing follower b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.729494 14759 raft_consensus.cc:1081] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Signalling peer b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.730752 14745 raft_consensus.cc:993] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50: : Instructing follower b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.731462 14761 raft_consensus.cc:1081] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Signalling peer b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.731474 14501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:51214
I20260709 13:03:45.732295 14501 raft_consensus.cc:493] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.732772 14501 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.733948 14502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:51218
I20260709 13:03:45.734635 14502 raft_consensus.cc:493] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.735050 14502 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.741225 14501 raft_consensus.cc:515] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.743903 14501 leader_election.cc:290] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 4 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:45.743672 14502 raft_consensus.cc:515] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.744875 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:45.745107 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a133c50d0744fc9b8a1946bf4f21aff" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:45.745529 14427 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.745729 14577 raft_consensus.cc:3055] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:45.746306 14502 leader_election.cc:290] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 3 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:45.746088 14577 raft_consensus.cc:740] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:45.747730 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:45.747804 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1973adcf694e948fadf3fbf5fae271" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:45.748559 14575 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.748885 14428 raft_consensus.cc:3055] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:45.749233 14428 raft_consensus.cc:740] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:45.748641 14577 consensus_queue.cc:260] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.750319 14577 raft_consensus.cc:3060] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.750171 14428 consensus_queue.cc:260] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.751734 14428 raft_consensus.cc:3060] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.754808 14427 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 4.
I20260709 13:03:45.756275 14469 leader_election.cc:304] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:45.758291 14755 raft_consensus.cc:2804] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:45.763411 14428 raft_consensus.cc:2468] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 3.
I20260709 13:03:45.764876 14755 raft_consensus.cc:697] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 4 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:45.765518 14575 raft_consensus.cc:2468] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 3.
I20260709 13:03:45.765034 14469 leader_election.cc:304] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:45.765985 14577 raft_consensus.cc:2468] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 4.
I20260709 13:03:45.766861 14773 raft_consensus.cc:2804] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:45.767402 14773 raft_consensus.cc:697] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:45.767311 14755 consensus_queue.cc:237] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.768365 14773 consensus_queue.cc:237] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.775799 14324 catalog_manager.cc:5697] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 3 to 4, leader changed from cc85955fabf547be8853867e5b655467 (127.13.245.67) to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 4 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.789588 14324 catalog_manager.cc:5697] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 2 to 3, leader changed from e528d66001e94fb492f62d211ef91a50 (127.13.245.65) to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 3 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.800611 14749 raft_consensus.cc:993] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467: : Instructing follower b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.801194 14749 raft_consensus.cc:1081] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Signalling peer b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.803611 14502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:51214
I20260709 13:03:45.804317 14502 raft_consensus.cc:493] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.804797 14502 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.810668 14502 raft_consensus.cc:515] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.813122 14502 leader_election.cc:290] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 4 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:45.814224 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:45.814627 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:45.814806 14428 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.815299 14575 raft_consensus.cc:3055] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:45.815671 14575 raft_consensus.cc:740] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:45.816521 14575 consensus_queue.cc:260] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.817920 14575 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.822000 14428 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 4.
I20260709 13:03:45.823722 14469 leader_election.cc:304] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:45.824568 14773 raft_consensus.cc:2804] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:45.825026 14773 raft_consensus.cc:697] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:45.825917 14773 consensus_queue.cc:237] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.826395 14575 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 4.
I20260709 13:03:45.833354 14320 catalog_manager.cc:5697] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 3 to 4, leader changed from cc85955fabf547be8853867e5b655467 (127.13.245.67) to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 4 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.927906 14761 raft_consensus.cc:993] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50: : Instructing follower b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.928453 14761 raft_consensus.cc:1081] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Signalling peer b67f826ecc324d8db0fd6c337a08c7dd to start an election
I20260709 13:03:45.930490 14502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
 from {username='slave'} at 127.0.0.1:51218
I20260709 13:03:45.931149 14502 raft_consensus.cc:493] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.931524 14502 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.937135 14502 raft_consensus.cc:515] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.939459 14502 leader_election.cc:290] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 3 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:45.941047 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:45.941110 14428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:45.941685 14575 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.941928 14428 raft_consensus.cc:3055] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:45.942315 14428 raft_consensus.cc:740] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:45.943387 14428 consensus_queue.cc:260] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.944594 14428 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.950223 14575 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 3.
I20260709 13:03:45.951787 14466 leader_election.cc:304] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67f826ecc324d8db0fd6c337a08c7dd, cc85955fabf547be8853867e5b655467; no voters: 
I20260709 13:03:45.953300 14773 raft_consensus.cc:2804] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:45.953729 14428 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67f826ecc324d8db0fd6c337a08c7dd in term 3.
I20260709 13:03:45.954118 14773 raft_consensus.cc:697] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Becoming Leader. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:45.955955 14773 consensus_queue.cc:237] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:45.964890 14320 catalog_manager.cc:5697] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd reported cstate change: term changed from 2 to 3, leader changed from e528d66001e94fb492f62d211ef91a50 (127.13.245.65) to b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66). New cstate: current_term: 3 leader_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.000710 14575 raft_consensus.cc:1275] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.001950 14428 raft_consensus.cc:1275] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.002223 14773 consensus_queue.cc:1048] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.003723 14773 consensus_queue.cc:1048] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.224164 14427 raft_consensus.cc:1275] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:46.225674 14755 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:46.235497 14575 raft_consensus.cc:1275] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:46.237236 14744 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:46.243414 14577 raft_consensus.cc:1275] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:46.245532 14773 consensus_queue.cc:1048] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:46.259459 14427 raft_consensus.cc:1275] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.261052 14744 consensus_queue.cc:1048] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:46.261679 14427 raft_consensus.cc:1275] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:46.264321 14773 consensus_queue.cc:1048] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:46.293488 14575 raft_consensus.cc:1275] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.295768 14785 consensus_queue.cc:1048] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:46.413482 14575 raft_consensus.cc:1275] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.415184 14785 consensus_queue.cc:1048] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:46.426232 14427 raft_consensus.cc:1275] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Refusing update from remote peer b67f826ecc324d8db0fd6c337a08c7dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.428889 14785 consensus_queue.cc:1048] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:48.504871 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.514093 14502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d38931cd671415180052e38260c8b69"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
mode: GRACEFUL
new_leader_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:03:48.514756 14502 raft_consensus.cc:606] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Received request to transfer leadership to TS e528d66001e94fb492f62d211ef91a50
I20260709 13:03:48.518349 14502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "204080e18f1348968d9b8a950a6e7e56"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
mode: GRACEFUL
new_leader_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:03:48.519003 14502 raft_consensus.cc:606] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Received request to transfer leadership to TS e528d66001e94fb492f62d211ef91a50
I20260709 13:03:48.521970 14502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
mode: GRACEFUL
new_leader_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:03:48.522634 14502 raft_consensus.cc:606] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Received request to transfer leadership to TS e528d66001e94fb492f62d211ef91a50
I20260709 13:03:48.525566 14502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
mode: GRACEFUL
new_leader_uuid: "cc85955fabf547be8853867e5b655467"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:03:48.526153 14502 raft_consensus.cc:606] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Received request to transfer leadership to TS cc85955fabf547be8853867e5b655467
I20260709 13:03:48.528524 14502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940"
dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
mode: GRACEFUL
new_leader_uuid: "cc85955fabf547be8853867e5b655467"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:03:48.529076 14502 raft_consensus.cc:606] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 LEADER]: Received request to transfer leadership to TS cc85955fabf547be8853867e5b655467
I20260709 13:03:48.530067 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:48.530566 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:48.568504 14785 raft_consensus.cc:993] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd: : Instructing follower e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:48.569000 14773 raft_consensus.cc:1081] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Signalling peer e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:48.570672 14428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "204080e18f1348968d9b8a950a6e7e56"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:50668
I20260709 13:03:48.571159 14428 raft_consensus.cc:493] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.571415 14428 raft_consensus.cc:3060] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.576675 14428 raft_consensus.cc:515] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.578203 14428 leader_election.cc:290] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 2 election: Requested vote from peers b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:48.579365 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204080e18f1348968d9b8a950a6e7e56" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:48.579368 14502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "204080e18f1348968d9b8a950a6e7e56" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:48.580456 14502 raft_consensus.cc:3055] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:48.580391 14577 raft_consensus.cc:3060] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.580938 14502 raft_consensus.cc:740] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:48.581929 14502 consensus_queue.cc:260] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.582991 14502 raft_consensus.cc:3060] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.587175 14577 raft_consensus.cc:2468] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 2.
I20260709 13:03:48.588838 14391 leader_election.cc:304] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:48.589917 14502 raft_consensus.cc:2468] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 2.
I20260709 13:03:48.591004 14789 raft_consensus.cc:2804] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:48.592226 14789 raft_consensus.cc:697] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Becoming Leader. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:48.593292 14789 consensus_queue.cc:237] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.601294 14324 catalog_manager.cc:5697] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 reported cstate change: term changed from 1 to 2, leader changed from b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66) to e528d66001e94fb492f62d211ef91a50 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e528d66001e94fb492f62d211ef91a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.702657 14773 raft_consensus.cc:993] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd: : Instructing follower e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:48.703183 14785 raft_consensus.cc:1081] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Signalling peer e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:48.704972 14427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d38931cd671415180052e38260c8b69"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:50668
I20260709 13:03:48.705498 14427 raft_consensus.cc:493] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.705798 14427 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.710772 14427 raft_consensus.cc:515] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:48.712661 14427 leader_election.cc:290] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 3 election: Requested vote from peers cc85955fabf547be8853867e5b655467 (127.13.245.67:43279), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:48.713690 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:48.713855 14502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d38931cd671415180052e38260c8b69" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:48.714278 14577 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.714534 14502 raft_consensus.cc:3055] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:48.714982 14502 raft_consensus.cc:740] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:48.715952 14502 consensus_queue.cc:260] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:48.717314 14502 raft_consensus.cc:3060] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.720685 14785 raft_consensus.cc:993] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd: : Instructing follower e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:48.721251 14773 raft_consensus.cc:1081] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Signalling peer e528d66001e94fb492f62d211ef91a50 to start an election
I20260709 13:03:48.722666 14577 raft_consensus.cc:2468] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 3.
I20260709 13:03:48.723136 14427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e"
dest_uuid: "e528d66001e94fb492f62d211ef91a50"
 from {username='slave'} at 127.0.0.1:50668
I20260709 13:03:48.723801 14427 raft_consensus.cc:493] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.723905 14391 leader_election.cc:304] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:48.724196 14427 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.724726 14789 raft_consensus.cc:2804] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:48.725179 14789 raft_consensus.cc:697] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 3 LEADER]: Becoming Leader. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:48.725075 14502 raft_consensus.cc:2468] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 3.
I20260709 13:03:48.726380 14789 consensus_queue.cc:237] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } }
I20260709 13:03:48.729676 14427 raft_consensus.cc:515] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.731681 14427 leader_election.cc:290] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 4 election: Requested vote from peers b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345), cc85955fabf547be8853867e5b655467 (127.13.245.67:43279)
I20260709 13:03:48.732457 14502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:48.733124 14502 raft_consensus.cc:3055] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:48.733196 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ccb1a97c9c45e5aa67bbec180c8a8e" candidate_uuid: "e528d66001e94fb492f62d211ef91a50" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cc85955fabf547be8853867e5b655467"
I20260709 13:03:48.733441 14502 raft_consensus.cc:740] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:48.733798 14577 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.734270 14502 consensus_queue.cc:260] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.735234 14502 raft_consensus.cc:3060] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.734843 14324 catalog_manager.cc:5697] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 reported cstate change: term changed from 2 to 3, leader changed from b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66) to e528d66001e94fb492f62d211ef91a50 (127.13.245.65). New cstate: current_term: 3 leader_uuid: "e528d66001e94fb492f62d211ef91a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.740427 14577 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 4.
I20260709 13:03:48.741760 14391 leader_election.cc:304] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:48.741951 14502 raft_consensus.cc:2468] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e528d66001e94fb492f62d211ef91a50 in term 4.
I20260709 13:03:48.743788 14789 raft_consensus.cc:2804] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.744234 14789 raft_consensus.cc:697] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 4 LEADER]: Becoming Leader. State: Replica: e528d66001e94fb492f62d211ef91a50, State: Running, Role: LEADER
I20260709 13:03:48.745055 14789 consensus_queue.cc:237] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.752225 14324 catalog_manager.cc:5697] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 reported cstate change: term changed from 3 to 4, leader changed from b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66) to e528d66001e94fb492f62d211ef91a50 (127.13.245.65). New cstate: current_term: 4 leader_uuid: "e528d66001e94fb492f62d211ef91a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.887624 14773 raft_consensus.cc:993] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd: : Instructing follower cc85955fabf547be8853867e5b655467 to start an election
I20260709 13:03:48.888350 14785 raft_consensus.cc:1081] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 LEADER]: Signalling peer cc85955fabf547be8853867e5b655467 to start an election
I20260709 13:03:48.890606 14577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940"
dest_uuid: "cc85955fabf547be8853867e5b655467"
 from {username='slave'} at 127.0.0.1:35082
I20260709 13:03:48.891366 14577 raft_consensus.cc:493] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.891870 14577 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.899991 14577 raft_consensus.cc:515] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.902383 14577 leader_election.cc:290] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 5 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:48.903366 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:48.903623 14502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e410f11f4c37b988d6ea8704e940" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:48.904058 14427 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.904157 14502 raft_consensus.cc:3055] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:48.904496 14502 raft_consensus.cc:740] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:48.905371 14502 consensus_queue.cc:260] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.906764 14502 raft_consensus.cc:3060] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.911863 14427 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 5.
I20260709 13:03:48.913546 14543 leader_election.cc:304] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:48.914417 14502 raft_consensus.cc:2468] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 5.
I20260709 13:03:48.914439 14759 raft_consensus.cc:2804] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:48.917735 14759 raft_consensus.cc:697] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 5 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:48.918658 14759 consensus_queue.cc:237] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:48.926502 14324 catalog_manager.cc:5697] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 4 to 5, leader changed from b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66) to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 5 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.050158 14577 raft_consensus.cc:1275] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.051935 14789 consensus_queue.cc:1048] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:49.053260 14502 raft_consensus.cc:1275] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.055018 14789 consensus_queue.cc:1048] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.055353 14773 raft_consensus.cc:993] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd: : Instructing follower cc85955fabf547be8853867e5b655467 to start an election
I20260709 13:03:49.056553 14785 raft_consensus.cc:1081] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Signalling peer cc85955fabf547be8853867e5b655467 to start an election
I20260709 13:03:49.059419 14575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4"
dest_uuid: "cc85955fabf547be8853867e5b655467"
 from {username='slave'} at 127.0.0.1:35082
I20260709 13:03:49.060853 14575 raft_consensus.cc:493] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.061347 14575 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.070665 14575 raft_consensus.cc:515] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:49.074419 14427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e528d66001e94fb492f62d211ef91a50"
I20260709 13:03:49.075037 14575 leader_election.cc:290] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 4 election: Requested vote from peers e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129), b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345)
I20260709 13:03:49.077104 14502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8cb687ae3b48c29f6636a0e1d452b4" candidate_uuid: "cc85955fabf547be8853867e5b655467" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b67f826ecc324d8db0fd6c337a08c7dd"
I20260709 13:03:49.077952 14502 raft_consensus.cc:3055] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:49.078365 14502 raft_consensus.cc:740] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b67f826ecc324d8db0fd6c337a08c7dd, State: Running, Role: LEADER
I20260709 13:03:49.079350 14502 consensus_queue.cc:260] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:49.075163 14427 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.081169 14502 raft_consensus.cc:3060] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.089246 14427 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 4.
I20260709 13:03:49.090986 14543 leader_election.cc:304] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc85955fabf547be8853867e5b655467, e528d66001e94fb492f62d211ef91a50; no voters: 
I20260709 13:03:49.093057 14502 raft_consensus.cc:2468] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc85955fabf547be8853867e5b655467 in term 4.
I20260709 13:03:49.095265 14759 raft_consensus.cc:2804] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:49.095944 14759 raft_consensus.cc:697] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 4 LEADER]: Becoming Leader. State: Replica: cc85955fabf547be8853867e5b655467, State: Running, Role: LEADER
I20260709 13:03:49.096897 14759 consensus_queue.cc:237] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } }
I20260709 13:03:49.106868 14324 catalog_manager.cc:5697] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 reported cstate change: term changed from 3 to 4, leader changed from b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66) to cc85955fabf547be8853867e5b655467 (127.13.245.67). New cstate: current_term: 4 leader_uuid: "cc85955fabf547be8853867e5b655467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.136829 14577 raft_consensus.cc:1275] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:49.138675 14790 consensus_queue.cc:1048] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.152065 14501 raft_consensus.cc:1275] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:49.154908 14789 consensus_queue.cc:1048] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.158547 14502 raft_consensus.cc:1275] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:49.160614 14805 consensus_queue.cc:1048] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:49.172780 14577 raft_consensus.cc:1275] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Refusing update from remote peer e528d66001e94fb492f62d211ef91a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:49.174695 14789 consensus_queue.cc:1048] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc85955fabf547be8853867e5b655467" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.455240 14427 raft_consensus.cc:1275] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 5 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:49.456750 14759 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e528d66001e94fb492f62d211ef91a50" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:49.467129 14501 raft_consensus.cc:1275] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 5 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:49.468968 14798 consensus_queue.cc:1048] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:49.531697 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:49.537396 14293 tablet_server.cc:179] TabletServer@127.13.245.65:0 shutting down...
I20260709 13:03:49.547958 14501 raft_consensus.cc:1275] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Refusing update from remote peer cc85955fabf547be8853867e5b655467: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:49.550837 14798 consensus_queue.cc:1048] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67f826ecc324d8db0fd6c337a08c7dd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 46345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:49.570650 14543 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:49.581723 14543 consensus_peers.cc:597] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 -> Peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Couldn't send request to peer e528d66001e94fb492f62d211ef91a50. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.604207 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:49.605095 14293 tablet_replica.cc:333] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.605777 14293 raft_consensus.cc:2243] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.606526 14293 raft_consensus.cc:2272] T 38ccb1a97c9c45e5aa67bbec180c8a8e P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.609902 14293 tablet_replica.cc:333] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.610404 14293 raft_consensus.cc:2243] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.610778 14293 raft_consensus.cc:2272] T 7a133c50d0744fc9b8a1946bf4f21aff P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.613132 14293 tablet_replica.cc:333] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.613955 14293 raft_consensus.cc:2243] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.614483 14293 raft_consensus.cc:2272] T 38addde16fdd4f82974dc39497c1efb4 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.617722 14293 tablet_replica.cc:333] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.618450 14293 raft_consensus.cc:2243] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.619042 14293 raft_consensus.cc:2272] T 3a1973adcf694e948fadf3fbf5fae271 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.620991 14293 tablet_replica.cc:333] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.621582 14293 raft_consensus.cc:2243] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.622339 14293 raft_consensus.cc:2272] T 204080e18f1348968d9b8a950a6e7e56 P e528d66001e94fb492f62d211ef91a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.624568 14293 tablet_replica.cc:333] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.625133 14293 raft_consensus.cc:2243] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.625921 14293 raft_consensus.cc:2272] T 1d38931cd671415180052e38260c8b69 P e528d66001e94fb492f62d211ef91a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.628290 14293 tablet_replica.cc:333] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.628821 14293 raft_consensus.cc:2243] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.629242 14293 raft_consensus.cc:2272] T c7c2470e057c4097a3c77fa2a2e297f0 P e528d66001e94fb492f62d211ef91a50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.631007 14293 tablet_replica.cc:333] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.631497 14293 raft_consensus.cc:2243] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.631983 14293 raft_consensus.cc:2272] T dd8cb687ae3b48c29f6636a0e1d452b4 P e528d66001e94fb492f62d211ef91a50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.633664 14293 tablet_replica.cc:333] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50: stopping tablet replica
I20260709 13:03:49.634120 14293 raft_consensus.cc:2243] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.634562 14293 raft_consensus.cc:2272] T e853e410f11f4c37b988d6ea8704e940 P e528d66001e94fb492f62d211ef91a50 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:49.813796 14543 consensus_peers.cc:597] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 -> Peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Couldn't send request to peer e528d66001e94fb492f62d211ef91a50. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:45129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.814831 14293 tablet_server.cc:196] TabletServer@127.13.245.65:0 shutdown complete.
W20260709 13:03:49.816107 14469 consensus_peers.cc:597] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd -> Peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Couldn't send request to peer e528d66001e94fb492f62d211ef91a50. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:45129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.816617 14469 consensus_peers.cc:597] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd -> Peer e528d66001e94fb492f62d211ef91a50 (127.13.245.65:45129): Couldn't send request to peer e528d66001e94fb492f62d211ef91a50. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:45129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.839816 14293 tablet_server.cc:179] TabletServer@127.13.245.66:0 shutting down...
W20260709 13:03:49.861465 14542 consensus_peers.cc:597] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 -> Peer b67f826ecc324d8db0fd6c337a08c7dd (127.13.245.66:46345): Couldn't send request to peer b67f826ecc324d8db0fd6c337a08c7dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.880398 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:49.881167 14293 tablet_replica.cc:333] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.882045 14293 raft_consensus.cc:2243] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.883021 14293 raft_consensus.cc:2272] T 7a133c50d0744fc9b8a1946bf4f21aff P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.884828 14293 tablet_replica.cc:333] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.885291 14293 raft_consensus.cc:2243] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.885660 14293 raft_consensus.cc:2272] T c7c2470e057c4097a3c77fa2a2e297f0 P b67f826ecc324d8db0fd6c337a08c7dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.887187 14293 tablet_replica.cc:333] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.887799 14293 raft_consensus.cc:2243] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.888167 14293 raft_consensus.cc:2272] T 1d38931cd671415180052e38260c8b69 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.890502 14293 tablet_replica.cc:333] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.891240 14293 raft_consensus.cc:2243] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.891862 14293 raft_consensus.cc:2272] T 204080e18f1348968d9b8a950a6e7e56 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.894045 14293 tablet_replica.cc:333] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.894615 14293 raft_consensus.cc:2243] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.895057 14293 raft_consensus.cc:2272] T 38ccb1a97c9c45e5aa67bbec180c8a8e P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.897332 14293 tablet_replica.cc:333] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.897931 14293 raft_consensus.cc:2243] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.898725 14293 raft_consensus.cc:2272] T 3a1973adcf694e948fadf3fbf5fae271 P b67f826ecc324d8db0fd6c337a08c7dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.900985 14293 tablet_replica.cc:333] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.901631 14293 raft_consensus.cc:2243] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.902609 14293 raft_consensus.cc:2272] T 38addde16fdd4f82974dc39497c1efb4 P b67f826ecc324d8db0fd6c337a08c7dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.904488 14293 tablet_replica.cc:333] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.905009 14293 raft_consensus.cc:2243] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.905462 14293 raft_consensus.cc:2272] T e853e410f11f4c37b988d6ea8704e940 P b67f826ecc324d8db0fd6c337a08c7dd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.908303 14293 tablet_replica.cc:333] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd: stopping tablet replica
I20260709 13:03:49.908895 14293 raft_consensus.cc:2243] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.909382 14293 raft_consensus.cc:2272] T dd8cb687ae3b48c29f6636a0e1d452b4 P b67f826ecc324d8db0fd6c337a08c7dd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.940043 14293 tablet_server.cc:196] TabletServer@127.13.245.66:0 shutdown complete.
I20260709 13:03:49.961630 14293 tablet_server.cc:179] TabletServer@127.13.245.67:0 shutting down...
I20260709 13:03:49.995606 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:49.996440 14293 tablet_replica.cc:333] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:49.997480 14293 raft_consensus.cc:2243] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.998893 14293 raft_consensus.cc:2272] T c7c2470e057c4097a3c77fa2a2e297f0 P cc85955fabf547be8853867e5b655467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.000869 14293 tablet_replica.cc:333] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:50.001422 14293 raft_consensus.cc:2243] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.001852 14293 raft_consensus.cc:2272] T 3a1973adcf694e948fadf3fbf5fae271 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.003391 14293 tablet_replica.cc:333] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:50.003949 14293 raft_consensus.cc:2243] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.004379 14293 raft_consensus.cc:2272] T 38ccb1a97c9c45e5aa67bbec180c8a8e P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.006712 14293 tablet_replica.cc:333] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:50.007404 14293 raft_consensus.cc:2243] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.007885 14293 raft_consensus.cc:2272] T 204080e18f1348968d9b8a950a6e7e56 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.010296 14293 tablet_replica.cc:333] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:50.010970 14293 raft_consensus.cc:2243] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.011466 14293 raft_consensus.cc:2272] T 1d38931cd671415180052e38260c8b69 P cc85955fabf547be8853867e5b655467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.013888 14293 tablet_replica.cc:333] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:50.014395 14293 raft_consensus.cc:2243] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.014803 14293 raft_consensus.cc:2272] T 7a133c50d0744fc9b8a1946bf4f21aff P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.016438 14293 tablet_replica.cc:333] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:50.016919 14293 raft_consensus.cc:2243] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.017678 14293 raft_consensus.cc:2272] T dd8cb687ae3b48c29f6636a0e1d452b4 P cc85955fabf547be8853867e5b655467 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.019778 14293 tablet_replica.cc:333] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:50.020699 14293 raft_consensus.cc:2243] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.021409 14293 raft_consensus.cc:2272] T e853e410f11f4c37b988d6ea8704e940 P cc85955fabf547be8853867e5b655467 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.025447 14293 tablet_replica.cc:333] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467: stopping tablet replica
I20260709 13:03:50.026710 14293 raft_consensus.cc:2243] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.027169 14293 raft_consensus.cc:2272] T 38addde16fdd4f82974dc39497c1efb4 P cc85955fabf547be8853867e5b655467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.056931 14293 tablet_server.cc:196] TabletServer@127.13.245.67:0 shutdown complete.
I20260709 13:03:50.074893 14293 master.cc:562] Master@127.13.245.126:42903 shutting down...
I20260709 13:03:50.308413 14293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.309005 14293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.309305 14293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 28366101d2fa4ae5ab850aabcc97303a: stopping tablet replica
I20260709 13:03:50.331316 14293 master.cc:584] Master@127.13.245.126:42903 shutdown complete.
b67f826ecc324d8db0fd6c337a08c7dd  4
cc85955fabf547be8853867e5b655467  1
e528d66001e94fb492f62d211ef91a50  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (15213 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:03:50.384068 14293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.245.126:42149
I20260709 13:03:50.385377 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:50.392410 14821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.392906 14822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.395179 14824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:50.396903 14293 server_base.cc:1061] running on GCE node
I20260709 13:03:50.398389 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:50.398672 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:50.398891 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602230398872 us; error 0 us; skew 500 ppm
I20260709 13:03:50.399600 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:50.402709 14293 webserver.cc:533] Webserver started at http://127.13.245.126:39555/ using document root <none> and password file <none>
I20260709 13:03:50.403370 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:50.403613 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:50.403946 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:50.405304 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/master-0-root/instance:
uuid: "b946551868c448d0a1b3e16cfebcac26"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-fc6v"
I20260709 13:03:50.412515 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.007s
I20260709 13:03:50.417105 14829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.418337 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:03:50.418774 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/master-0-root
uuid: "b946551868c448d0a1b3e16cfebcac26"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-fc6v"
I20260709 13:03:50.419112 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:50.437927 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:50.439419 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:50.487417 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.126:42149
I20260709 13:03:50.487622 14880 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.126:42149 every 8 connection(s)
I20260709 13:03:50.493795 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:50.505300 14881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26: Bootstrap starting.
I20260709 13:03:50.510725 14881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.515818 14881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26: No bootstrap required, opened a new log
I20260709 13:03:50.518181 14881 raft_consensus.cc:359] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b946551868c448d0a1b3e16cfebcac26" member_type: VOTER }
I20260709 13:03:50.518607 14881 raft_consensus.cc:385] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.518887 14881 raft_consensus.cc:740] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b946551868c448d0a1b3e16cfebcac26, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.519572 14881 consensus_queue.cc:260] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b946551868c448d0a1b3e16cfebcac26" member_type: VOTER }
I20260709 13:03:50.520071 14881 raft_consensus.cc:399] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:50.520303 14881 raft_consensus.cc:493] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:50.520610 14881 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.525404 14881 raft_consensus.cc:515] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b946551868c448d0a1b3e16cfebcac26" member_type: VOTER }
I20260709 13:03:50.526006 14881 leader_election.cc:304] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b946551868c448d0a1b3e16cfebcac26; no voters: 
I20260709 13:03:50.527271 14881 leader_election.cc:290] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:50.527737 14884 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.529202 14884 raft_consensus.cc:697] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 1 LEADER]: Becoming Leader. State: Replica: b946551868c448d0a1b3e16cfebcac26, State: Running, Role: LEADER
I20260709 13:03:50.530018 14884 consensus_queue.cc:237] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b946551868c448d0a1b3e16cfebcac26" member_type: VOTER }
I20260709 13:03:50.530767 14881 sys_catalog.cc:565] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:50.535472 14885 sys_catalog.cc:455] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b946551868c448d0a1b3e16cfebcac26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b946551868c448d0a1b3e16cfebcac26" member_type: VOTER } }
I20260709 13:03:50.536211 14885 sys_catalog.cc:458] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:50.536477 14886 sys_catalog.cc:455] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b946551868c448d0a1b3e16cfebcac26. Latest consensus state: current_term: 1 leader_uuid: "b946551868c448d0a1b3e16cfebcac26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b946551868c448d0a1b3e16cfebcac26" member_type: VOTER } }
I20260709 13:03:50.537039 14886 sys_catalog.cc:458] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:50.538527 14891 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:50.545154 14891 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:50.551793 14293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:50.557416 14891 catalog_manager.cc:1383] Generated new cluster ID: 803e05862f2148dba49fe4cad611e25a
I20260709 13:03:50.557885 14891 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:50.584841 14891 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:50.586303 14891 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:50.602764 14891 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26: Generated new TSK 0
I20260709 13:03:50.603509 14891 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:50.623963 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:50.631661 14902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.632855 14903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.634375 14905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:50.634825 14293 server_base.cc:1061] running on GCE node
I20260709 13:03:50.636265 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:50.636528 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:50.636739 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602230636715 us; error 0 us; skew 500 ppm
I20260709 13:03:50.637401 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:50.640540 14293 webserver.cc:533] Webserver started at http://127.13.245.65:33077/ using document root <none> and password file <none>
I20260709 13:03:50.641153 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:50.641388 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:50.641702 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:50.642974 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-0-root/instance:
uuid: "0796a5020884417a808a07800b19342f"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-fc6v"
I20260709 13:03:50.648624 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:03:50.652712 14910 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.653723 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:50.654147 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "0796a5020884417a808a07800b19342f"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-fc6v"
I20260709 13:03:50.654448 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:50.671700 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:50.673388 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:50.675380 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:50.678426 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:50.678687 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.678903 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:50.679072 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.730751 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:33707
I20260709 13:03:50.730885 14972 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:33707 every 8 connection(s)
I20260709 13:03:50.736864 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:50.747320 14978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.749151 14977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.751859 14980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:50.752076 14293 server_base.cc:1061] running on GCE node
I20260709 13:03:50.753489 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:50.753821 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:50.754019 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602230754000 us; error 0 us; skew 500 ppm
I20260709 13:03:50.754822 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:50.758432 14293 webserver.cc:533] Webserver started at http://127.13.245.66:36549/ using document root <none> and password file <none>
I20260709 13:03:50.759182 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:50.759485 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:50.759470 14973 heartbeater.cc:344] Connected to a master server at 127.13.245.126:42149
I20260709 13:03:50.760056 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:50.760058 14973 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:50.761011 14973 heartbeater.cc:507] Master 127.13.245.126:42149 requested a full tablet report, sending...
I20260709 13:03:50.761548 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-1-root/instance:
uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-fc6v"
I20260709 13:03:50.763672 14846 ts_manager.cc:194] Registered new tserver with Master: 0796a5020884417a808a07800b19342f (127.13.245.65:33707)
I20260709 13:03:50.766364 14846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50264
I20260709 13:03:50.768669 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:03:50.772853 14985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.773929 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:50.774312 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-1-root
uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-fc6v"
I20260709 13:03:50.774611 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:50.792616 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:50.794188 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:50.796196 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:50.798915 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:50.799157 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.799463 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:50.799919 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:03:50.853905 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.66:42491
I20260709 13:03:50.854032 15047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.66:42491 every 8 connection(s)
I20260709 13:03:50.860042 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:50.868311 15051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:50.872531 15052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:50.874804 14293 server_base.cc:1061] running on GCE node
W20260709 13:03:50.875957 15054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:50.876883 15048 heartbeater.cc:344] Connected to a master server at 127.13.245.126:42149
I20260709 13:03:50.877563 15048 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:50.877993 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:50.878353 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:50.878607 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602230878585 us; error 0 us; skew 500 ppm
I20260709 13:03:50.878897 15048 heartbeater.cc:507] Master 127.13.245.126:42149 requested a full tablet report, sending...
I20260709 13:03:50.879572 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:50.882560 14846 ts_manager.cc:194] Registered new tserver with Master: ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:50.883445 14293 webserver.cc:533] Webserver started at http://127.13.245.67:38569/ using document root <none> and password file <none>
I20260709 13:03:50.884205 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:50.884426 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:50.884459 14846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50266
I20260709 13:03:50.884799 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:50.886548 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-2-root/instance:
uuid: "e838d8e1b54043eca2f9c748f3de133b"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-fc6v"
I20260709 13:03:50.892437 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:03:50.897703 15059 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.898790 14293 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:03:50.899189 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-2-root
uuid: "e838d8e1b54043eca2f9c748f3de133b"
format_stamp: "Formatted at 2026-07-09 13:03:50 on dist-test-slave-fc6v"
I20260709 13:03:50.899549 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602214968311-14293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:50.915731 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:50.917361 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:50.919281 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:50.922422 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:50.922717 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.922999 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:50.923188 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:50.978581 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.67:44379
I20260709 13:03:50.978685 15121 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.67:44379 every 8 connection(s)
I20260709 13:03:50.995214 15122 heartbeater.cc:344] Connected to a master server at 127.13.245.126:42149
I20260709 13:03:50.995697 15122 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:50.996610 15122 heartbeater.cc:507] Master 127.13.245.126:42149 requested a full tablet report, sending...
I20260709 13:03:50.999176 14846 ts_manager.cc:194] Registered new tserver with Master: e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:50.999922 14293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017536026s
I20260709 13:03:51.001197 14846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50278
I20260709 13:03:51.032245 14846 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50282:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:51.035701 14846 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:51.119131 15087 tablet_service.cc:1511] Processing CreateTablet for tablet f77c76aa4eda483ebd41a4189adb1f2e (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:51.121214 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77c76aa4eda483ebd41a4189adb1f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.125033 15086 tablet_service.cc:1511] Processing CreateTablet for tablet 55df0921a1944cf8825b590a079b53db (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:51.127485 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55df0921a1944cf8825b590a079b53db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.132472 15085 tablet_service.cc:1511] Processing CreateTablet for tablet 5b82873adb2f4c8392363556d635956a (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:51.134323 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b82873adb2f4c8392363556d635956a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.136835 15084 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5fe781a39d4bbea3a2311ccf2f9b95 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:51.139531 15012 tablet_service.cc:1511] Processing CreateTablet for tablet 55df0921a1944cf8825b590a079b53db (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:51.139851 15013 tablet_service.cc:1511] Processing CreateTablet for tablet f77c76aa4eda483ebd41a4189adb1f2e (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:51.141772 15012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55df0921a1944cf8825b590a079b53db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.142639 15083 tablet_service.cc:1511] Processing CreateTablet for tablet 779ccd461b454089bbe94455a734c88e (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:51.145298 15013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77c76aa4eda483ebd41a4189adb1f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.146245 15011 tablet_service.cc:1511] Processing CreateTablet for tablet 5b82873adb2f4c8392363556d635956a (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:51.147835 15011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b82873adb2f4c8392363556d635956a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.150477 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5fe781a39d4bbea3a2311ccf2f9b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.153287 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779ccd461b454089bbe94455a734c88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.154461 15082 tablet_service.cc:1511] Processing CreateTablet for tablet b572831563e049c9bcc979cfe2c2ab92 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:51.158640 14938 tablet_service.cc:1511] Processing CreateTablet for tablet f77c76aa4eda483ebd41a4189adb1f2e (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:51.158051 15010 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5fe781a39d4bbea3a2311ccf2f9b95 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:51.160429 14938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77c76aa4eda483ebd41a4189adb1f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.161167 15010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5fe781a39d4bbea3a2311ccf2f9b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.156189 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b572831563e049c9bcc979cfe2c2ab92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.177726 14937 tablet_service.cc:1511] Processing CreateTablet for tablet 55df0921a1944cf8825b590a079b53db (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:51.179945 14937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55df0921a1944cf8825b590a079b53db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.185693 14936 tablet_service.cc:1511] Processing CreateTablet for tablet 5b82873adb2f4c8392363556d635956a (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:51.187438 14936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b82873adb2f4c8392363556d635956a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.193168 15009 tablet_service.cc:1511] Processing CreateTablet for tablet 779ccd461b454089bbe94455a734c88e (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:51.194494 14934 tablet_service.cc:1511] Processing CreateTablet for tablet 779ccd461b454089bbe94455a734c88e (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:51.196076 14934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779ccd461b454089bbe94455a734c88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.193168 14935 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5fe781a39d4bbea3a2311ccf2f9b95 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:51.197405 14935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5fe781a39d4bbea3a2311ccf2f9b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.198817 14933 tablet_service.cc:1511] Processing CreateTablet for tablet b572831563e049c9bcc979cfe2c2ab92 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:51.201956 15008 tablet_service.cc:1511] Processing CreateTablet for tablet b572831563e049c9bcc979cfe2c2ab92 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:51.202850 15081 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2dc92324e24a02894596adb5cf43d0 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:51.204493 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2dc92324e24a02894596adb5cf43d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.205229 14932 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2dc92324e24a02894596adb5cf43d0 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:51.205515 15007 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2dc92324e24a02894596adb5cf43d0 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:51.205839 14931 tablet_service.cc:1511] Processing CreateTablet for tablet 428b66aef10e443bb08930ad331d3730 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:51.206671 15009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779ccd461b454089bbe94455a734c88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.208117 14933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b572831563e049c9bcc979cfe2c2ab92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.208256 15008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b572831563e049c9bcc979cfe2c2ab92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.211129 14932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2dc92324e24a02894596adb5cf43d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.211999 15007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2dc92324e24a02894596adb5cf43d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.214732 14931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428b66aef10e443bb08930ad331d3730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.235112 15006 tablet_service.cc:1511] Processing CreateTablet for tablet 428b66aef10e443bb08930ad331d3730 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:51.237270 15006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428b66aef10e443bb08930ad331d3730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.246871 15137 tablet_bootstrap.cc:492] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:51.264321 15084 tablet_service.cc:1511] Processing CreateTablet for tablet 428b66aef10e443bb08930ad331d3730 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:51.265914 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428b66aef10e443bb08930ad331d3730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.273253 15137 tablet_bootstrap.cc:654] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.302713 14937 tablet_service.cc:1511] Processing CreateTablet for tablet 111d244ff4844c808d538765fea283f3 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:51.304476 14937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111d244ff4844c808d538765fea283f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.306165 15008 tablet_service.cc:1511] Processing CreateTablet for tablet 111d244ff4844c808d538765fea283f3 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:51.307775 15008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111d244ff4844c808d538765fea283f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.312633 15138 tablet_bootstrap.cc:492] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:51.336958 15085 tablet_service.cc:1511] Processing CreateTablet for tablet 111d244ff4844c808d538765fea283f3 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:51.339192 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111d244ff4844c808d538765fea283f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.351303 15139 tablet_bootstrap.cc:492] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:51.358729 15138 tablet_bootstrap.cc:654] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.367106 14933 tablet_service.cc:1511] Processing CreateTablet for tablet d3aa539e667949feb9d56af5dd16a152 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:51.369213 14933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aa539e667949feb9d56af5dd16a152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.376819 15010 tablet_service.cc:1511] Processing CreateTablet for tablet d3aa539e667949feb9d56af5dd16a152 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:51.379029 15137 tablet_bootstrap.cc:492] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:51.379734 15137 ts_tablet_manager.cc:1403] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.012s
I20260709 13:03:51.380937 15084 tablet_service.cc:1511] Processing CreateTablet for tablet d3aa539e667949feb9d56af5dd16a152 (DEFAULT_TABLE table=test-workload [id=776a160ec221498db0babec62123e7df]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:51.382515 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aa539e667949feb9d56af5dd16a152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.378847 15010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aa539e667949feb9d56af5dd16a152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.383059 15137 raft_consensus.cc:359] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.384094 15137 raft_consensus.cc:385] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.384447 15137 raft_consensus.cc:740] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.385283 15137 consensus_queue.cc:260] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.390513 15139 tablet_bootstrap.cc:654] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.398384 15138 tablet_bootstrap.cc:492] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:51.398998 15138 ts_tablet_manager.cc:1403] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.009s
I20260709 13:03:51.409664 15138 raft_consensus.cc:359] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.410545 15138 raft_consensus.cc:385] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.410859 15138 raft_consensus.cc:740] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.416993 15138 consensus_queue.cc:260] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.421056 15139 tablet_bootstrap.cc:492] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:51.420873 15122 heartbeater.cc:499] Master 127.13.245.126:42149 was elected leader, sending a full tablet report...
I20260709 13:03:51.421728 15139 ts_tablet_manager.cc:1403] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.005s
I20260709 13:03:51.424988 14973 heartbeater.cc:499] Master 127.13.245.126:42149 was elected leader, sending a full tablet report...
I20260709 13:03:51.425143 15139 raft_consensus.cc:359] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.425933 15139 raft_consensus.cc:385] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.426223 15139 raft_consensus.cc:740] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.426932 15139 consensus_queue.cc:260] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.425594 15138 ts_tablet_manager.cc:1434] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.006s
I20260709 13:03:51.428346 15137 ts_tablet_manager.cc:1434] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.048s	user 0.021s	sys 0.019s
I20260709 13:03:51.429557 15137 tablet_bootstrap.cc:492] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:51.429616 15048 heartbeater.cc:499] Master 127.13.245.126:42149 was elected leader, sending a full tablet report...
I20260709 13:03:51.431149 15139 ts_tablet_manager.cc:1434] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:03:51.429445 15138 tablet_bootstrap.cc:492] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:51.438714 15138 tablet_bootstrap.cc:654] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.438738 15137 tablet_bootstrap.cc:654] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.442934 15139 tablet_bootstrap.cc:492] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:51.452878 15139 tablet_bootstrap.cc:654] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.453648 15137 tablet_bootstrap.cc:492] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:51.453734 15138 tablet_bootstrap.cc:492] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:51.454375 15137 ts_tablet_manager.cc:1403] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:03:51.454536 15138 ts_tablet_manager.cc:1403] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.011s
I20260709 13:03:51.458520 15137 raft_consensus.cc:359] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.459429 15137 raft_consensus.cc:385] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.459867 15137 raft_consensus.cc:740] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.459478 15138 raft_consensus.cc:359] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.460836 15138 raft_consensus.cc:385] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.460800 15137 consensus_queue.cc:260] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.461534 15138 raft_consensus.cc:740] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.462636 15138 consensus_queue.cc:260] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.463665 15137 ts_tablet_manager.cc:1434] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.004s
I20260709 13:03:51.464903 15137 tablet_bootstrap.cc:492] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:51.466678 15138 ts_tablet_manager.cc:1434] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:03:51.468364 15138 tablet_bootstrap.cc:492] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:51.472669 15137 tablet_bootstrap.cc:654] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.476701 15139 tablet_bootstrap.cc:492] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:51.477516 15139 ts_tablet_manager.cc:1403] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.012s
I20260709 13:03:51.479172 15138 tablet_bootstrap.cc:654] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.481166 15139 raft_consensus.cc:359] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.482151 15139 raft_consensus.cc:385] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.482630 15139 raft_consensus.cc:740] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.484097 15139 consensus_queue.cc:260] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.489635 15139 ts_tablet_manager.cc:1434] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:03:51.491489 15139 tablet_bootstrap.cc:492] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:51.500279 15139 tablet_bootstrap.cc:654] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.502399 15137 tablet_bootstrap.cc:492] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:51.503037 15137 ts_tablet_manager.cc:1403] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.010s
I20260709 13:03:51.506506 15137 raft_consensus.cc:359] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.507074 15138 tablet_bootstrap.cc:492] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:51.507598 15137 raft_consensus.cc:385] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.507928 15138 ts_tablet_manager.cc:1403] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.017s
I20260709 13:03:51.508013 15137 raft_consensus.cc:740] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.509487 15139 tablet_bootstrap.cc:492] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:51.509148 15137 consensus_queue.cc:260] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.510004 15139 ts_tablet_manager.cc:1403] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:03:51.511811 15137 ts_tablet_manager.cc:1434] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:03:51.511736 15138 raft_consensus.cc:359] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.512744 15138 raft_consensus.cc:385] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.513132 15138 raft_consensus.cc:740] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.513218 15137 tablet_bootstrap.cc:492] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:51.514098 15138 consensus_queue.cc:260] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.516185 15139 raft_consensus.cc:359] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.516721 15138 ts_tablet_manager.cc:1434] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:51.517043 15139 raft_consensus.cc:385] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.517414 15139 raft_consensus.cc:740] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.517817 15138 tablet_bootstrap.cc:492] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:51.518420 15139 consensus_queue.cc:260] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.521443 15139 ts_tablet_manager.cc:1434] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:03:51.523068 15137 tablet_bootstrap.cc:654] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.524014 15139 tablet_bootstrap.cc:492] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:51.526145 15138 tablet_bootstrap.cc:654] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.532255 15139 tablet_bootstrap.cc:654] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.540479 15138 tablet_bootstrap.cc:492] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:51.541477 15138 ts_tablet_manager.cc:1403] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 13:03:51.543262 15139 tablet_bootstrap.cc:492] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:51.543900 15139 ts_tablet_manager.cc:1403] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
W20260709 13:03:51.545675 14894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:51.547418 15139 raft_consensus.cc:359] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.548295 15139 raft_consensus.cc:385] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.548604 15139 raft_consensus.cc:740] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.549372 15138 raft_consensus.cc:359] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.549688 15139 consensus_queue.cc:260] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.550552 15138 raft_consensus.cc:385] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.550992 15138 raft_consensus.cc:740] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.552729 15139 ts_tablet_manager.cc:1434] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:03:51.552414 15138 consensus_queue.cc:260] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.554033 15139 tablet_bootstrap.cc:492] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:51.560922 15138 ts_tablet_manager.cc:1434] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:03:51.562690 15138 tablet_bootstrap.cc:492] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:51.562994 15139 tablet_bootstrap.cc:654] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.566627 15142 raft_consensus.cc:493] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.567509 15142 raft_consensus.cc:515] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.576385 15156 raft_consensus.cc:493] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.577095 15156 raft_consensus.cc:515] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.580376 15138 tablet_bootstrap.cc:654] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.581378 15142 leader_election.cc:290] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:51.595023 15137 tablet_bootstrap.cc:492] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:51.595023 15138 tablet_bootstrap.cc:492] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:51.595938 15138 ts_tablet_manager.cc:1403] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.010s
I20260709 13:03:51.595940 15137 ts_tablet_manager.cc:1403] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.083s	user 0.029s	sys 0.049s
I20260709 13:03:51.596837 15139 tablet_bootstrap.cc:492] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:51.597999 15139 ts_tablet_manager.cc:1403] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.005s
I20260709 13:03:51.599965 15138 raft_consensus.cc:359] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.600072 15137 raft_consensus.cc:359] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.600996 15138 raft_consensus.cc:385] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.601039 15137 raft_consensus.cc:385] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.601462 15138 raft_consensus.cc:740] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.601504 15137 raft_consensus.cc:740] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.602800 15137 consensus_queue.cc:260] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.602803 15138 consensus_queue.cc:260] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.607822 15144 raft_consensus.cc:493] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.608062 15137 ts_tablet_manager.cc:1434] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:51.608578 15144 raft_consensus.cc:515] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.609484 15137 tablet_bootstrap.cc:492] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:51.608485 15139 raft_consensus.cc:359] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.613905 15139 raft_consensus.cc:385] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.614454 15139 raft_consensus.cc:740] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.612502 15156 leader_election.cc:290] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:51.615984 15139 consensus_queue.cc:260] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.618137 15137 tablet_bootstrap.cc:654] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.618645 15139 ts_tablet_manager.cc:1434] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:03:51.624884 15144 leader_election.cc:290] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:51.646051 15139 tablet_bootstrap.cc:492] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:51.664721 15156 raft_consensus.cc:493] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.665342 15156 raft_consensus.cc:515] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.666198 15137 tablet_bootstrap.cc:492] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:51.666731 15137 ts_tablet_manager.cc:1403] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.058s	user 0.001s	sys 0.025s
I20260709 13:03:51.670691 15137 raft_consensus.cc:359] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.671667 15137 raft_consensus.cc:385] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.672041 15137 raft_consensus.cc:740] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.673480 15139 tablet_bootstrap.cc:654] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.673134 15137 consensus_queue.cc:260] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.676522 15137 ts_tablet_manager.cc:1434] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.005s
I20260709 13:03:51.676230 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.677281 14948 raft_consensus.cc:2468] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:51.677811 15137 tablet_bootstrap.cc:492] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:51.679086 15062 leader_election.cc:304] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:51.679629 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.680437 14947 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:51.680426 15142 raft_consensus.cc:2804] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.681857 15142 raft_consensus.cc:493] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.682300 15142 raft_consensus.cc:3060] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.686206 15137 tablet_bootstrap.cc:654] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.688103 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.690019 15144 raft_consensus.cc:493] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.690704 15144 raft_consensus.cc:515] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.691642 15156 leader_election.cc:290] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:51.692045 15145 raft_consensus.cc:493] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.692952 15145 raft_consensus.cc:515] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.696025 15144 leader_election.cc:290] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:51.707960 15138 ts_tablet_manager.cc:1434] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.111s	user 0.011s	sys 0.000s
I20260709 13:03:51.708783 15062 leader_election.cc:304] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
W20260709 13:03:51.710135 15062 leader_election.cc:343] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0796a5020884417a808a07800b19342f (127.13.245.65:33707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.725116 15170 raft_consensus.cc:493] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.721747 15156 raft_consensus.cc:2804] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.732509 15138 tablet_bootstrap.cc:492] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:51.721017 15144 raft_consensus.cc:493] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.746546 15145 leader_election.cc:290] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:51.741408 15156 raft_consensus.cc:493] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.746779 15144 raft_consensus.cc:515] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.754091 15144 leader_election.cc:290] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:51.751824 15156 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.731359 15142 raft_consensus.cc:515] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.758828 15142 leader_election.cc:290] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:51.756142 15145 raft_consensus.cc:493] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.760293 15145 raft_consensus.cc:515] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.762166 15022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:51.763128 15145 leader_election.cc:290] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379), 0796a5020884417a808a07800b19342f (127.13.245.65:33707)
I20260709 13:03:51.763664 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:51.764508 15021 raft_consensus.cc:2468] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:51.764972 15137 tablet_bootstrap.cc:492] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:51.765599 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:51.766022 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:51.768368 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:51.768431 15023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:51.768838 15138 tablet_bootstrap.cc:654] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.765606 15137 ts_tablet_manager.cc:1403] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.088s	user 0.022s	sys 0.024s
W20260709 13:03:51.771803 14911 leader_election.cc:343] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.776198 15063 leader_election.cc:304] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 0796a5020884417a808a07800b19342f
I20260709 13:03:51.777698 15139 tablet_bootstrap.cc:492] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:51.777933 15142 raft_consensus.cc:2804] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.778354 15142 raft_consensus.cc:493] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.778689 15139 ts_tablet_manager.cc:1403] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.133s	user 0.037s	sys 0.036s
I20260709 13:03:51.778687 15142 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.771296 15023 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:51.727334 15170 raft_consensus.cc:515] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.763125 15022 raft_consensus.cc:2468] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:51.780226 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:51.779520 15137 raft_consensus.cc:359] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.784863 15137 raft_consensus.cc:385] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.784911 14948 raft_consensus.cc:3060] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.785326 15137 raft_consensus.cc:740] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.786393 15137 consensus_queue.cc:260] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.787734 15097 raft_consensus.cc:2468] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 0.
I20260709 13:03:51.781876 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:51.789356 15022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:51.782389 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.787364 15142 raft_consensus.cc:515] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.790570 14947 raft_consensus.cc:2468] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:51.793327 15142 leader_election.cc:290] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
W20260709 13:03:51.793248 14911 leader_election.cc:343] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.783087 15023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:51.794608 14911 leader_election.cc:304] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:51.781492 15170 leader_election.cc:290] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:51.796175 15167 raft_consensus.cc:2804] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.793381 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:51.796736 15167 raft_consensus.cc:493] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.797149 15167 raft_consensus.cc:3060] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.797281 15023 raft_consensus.cc:2468] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
W20260709 13:03:51.802654 14914 leader_election.cc:343] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.805486 14914 leader_election.cc:304] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0796a5020884417a808a07800b19342f; no voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:51.806638 15144 raft_consensus.cc:2749] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.808871 15156 raft_consensus.cc:515] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.811375 15156 leader_election.cc:290] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:51.793488 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:51.812114 15020 raft_consensus.cc:2468] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 0.
I20260709 13:03:51.812817 15139 raft_consensus.cc:359] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.813783 15139 raft_consensus.cc:385] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.814142 15139 raft_consensus.cc:740] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
W20260709 13:03:51.815138 14914 leader_election.cc:343] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.815881 14914 leader_election.cc:304] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0796a5020884417a808a07800b19342f; no voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:51.815930 15139 consensus_queue.cc:260] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.818917 15139 ts_tablet_manager.cc:1434] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.005s
I20260709 13:03:51.820473 15139 tablet_bootstrap.cc:492] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:51.821408 15144 raft_consensus.cc:2749] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.823453 15063 leader_election.cc:304] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:51.824527 15156 raft_consensus.cc:2804] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.824944 15156 raft_consensus.cc:493] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.825335 15156 raft_consensus.cc:3060] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.831066 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:51.831928 15020 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.832420 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:51.833616 15021 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.839715 15139 tablet_bootstrap.cc:654] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.841434 15020 raft_consensus.cc:2468] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
I20260709 13:03:51.834900 15156 raft_consensus.cc:515] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.844674 15167 raft_consensus.cc:515] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.846855 15156 leader_election.cc:290] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:51.846951 15167 leader_election.cc:290] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:51.848740 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:51.848922 15063 leader_election.cc:304] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:51.849749 15097 raft_consensus.cc:2393] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0796a5020884417a808a07800b19342f in current term 1: Already voted for candidate e838d8e1b54043eca2f9c748f3de133b in this term.
I20260709 13:03:51.849938 15170 raft_consensus.cc:2804] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.850100 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.850497 15170 raft_consensus.cc:697] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:51.850947 14947 raft_consensus.cc:2393] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2dc15ed80e44c4a0b3b58493af683a in current term 1: Already voted for candidate 0796a5020884417a808a07800b19342f in this term.
I20260709 13:03:51.848740 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:51.849376 15137 ts_tablet_manager.cc:1434] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.073s	user 0.012s	sys 0.039s
I20260709 13:03:51.851470 15170 consensus_queue.cc:237] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.852974 15137 tablet_bootstrap.cc:492] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:51.853529 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.856628 15023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:51.856925 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:51.851449 15020 raft_consensus.cc:3060] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.857081 15021 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
W20260709 13:03:51.861754 15062 leader_election.cc:343] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0796a5020884417a808a07800b19342f (127.13.245.65:33707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.864908 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:51.865664 14947 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.868496 14946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:51.869091 15139 tablet_bootstrap.cc:492] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:51.869540 14948 raft_consensus.cc:2468] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
I20260709 13:03:51.869650 14946 raft_consensus.cc:2393] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e838d8e1b54043eca2f9c748f3de133b in current term 1: Already voted for candidate 0796a5020884417a808a07800b19342f in this term.
I20260709 13:03:51.869717 15139 ts_tablet_manager.cc:1403] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.010s
I20260709 13:03:51.871807 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:51.871989 15063 leader_election.cc:304] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:51.872802 15097 raft_consensus.cc:2393] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2dc15ed80e44c4a0b3b58493af683a in current term 1: Already voted for candidate e838d8e1b54043eca2f9c748f3de133b in this term.
I20260709 13:03:51.873797 15173 raft_consensus.cc:2804] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.874953 15138 tablet_bootstrap.cc:492] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:51.874759 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:51.875031 15173 raft_consensus.cc:697] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:51.875491 15138 ts_tablet_manager.cc:1403] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.000s
I20260709 13:03:51.875689 15097 raft_consensus.cc:2393] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2dc15ed80e44c4a0b3b58493af683a in current term 1: Already voted for candidate e838d8e1b54043eca2f9c748f3de133b in this term.
I20260709 13:03:51.876428 15062 leader_election.cc:304] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:51.876368 15173 consensus_queue.cc:237] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.880302 15139 raft_consensus.cc:359] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.881220 15139 raft_consensus.cc:385] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.881364 15020 raft_consensus.cc:2468] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 1.
I20260709 13:03:51.881421 15156 raft_consensus.cc:2804] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.881596 15139 raft_consensus.cc:740] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.882256 15156 raft_consensus.cc:697] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:51.878255 15137 tablet_bootstrap.cc:654] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.882717 15139 consensus_queue.cc:260] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.883349 15156 consensus_queue.cc:237] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:51.883976 15062 leader_election.cc:304] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e838d8e1b54043eca2f9c748f3de133b; no voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:51.887576 15142 raft_consensus.cc:2749] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.888677 14986 leader_election.cc:304] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a; no voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:51.883817 15138 raft_consensus.cc:359] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.889734 15138 raft_consensus.cc:385] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.890187 15138 raft_consensus.cc:740] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.893966 14947 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
I20260709 13:03:51.895857 15138 consensus_queue.cc:260] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.893811 15145 raft_consensus.cc:493] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.899744 15145 raft_consensus.cc:515] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.902439 15145 leader_election.cc:290] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:51.902638 15179 raft_consensus.cc:2749] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.904805 14914 leader_election.cc:304] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:51.905033 14986 leader_election.cc:304] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a; no voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:51.906052 15167 raft_consensus.cc:2804] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.906555 15167 raft_consensus.cc:697] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:51.905778 14845 catalog_manager.cc:5697] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 0 to 1, leader changed from <none> to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 1 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.907476 15167 consensus_queue.cc:237] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.910799 15179 raft_consensus.cc:3060] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.907491 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:51.912530 15097 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 0.
I20260709 13:03:51.912726 15139 ts_tablet_manager.cc:1434] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:03:51.913853 14986 leader_election.cc:304] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:51.914759 15145 raft_consensus.cc:2804] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.915160 15145 raft_consensus.cc:493] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.915575 15145 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.916118 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.916920 14947 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 0.
I20260709 13:03:51.920212 15138 ts_tablet_manager.cc:1434] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.005s
I20260709 13:03:51.921887 15138 tablet_bootstrap.cc:492] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:51.926831 15137 tablet_bootstrap.cc:492] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:51.927928 15139 tablet_bootstrap.cc:492] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:51.929833 15138 tablet_bootstrap.cc:654] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.931305 15156 raft_consensus.cc:493] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.927529 15137 ts_tablet_manager.cc:1403] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.004s
I20260709 13:03:51.932022 15156 raft_consensus.cc:515] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.935760 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.936431 15156 leader_election.cc:290] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
W20260709 13:03:51.937546 15062 leader_election.cc:343] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0796a5020884417a808a07800b19342f (127.13.245.65:33707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.937294 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:51.938447 15020 raft_consensus.cc:2468] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:51.941602 15063 leader_election.cc:304] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 0796a5020884417a808a07800b19342f
I20260709 13:03:51.943307 15156 raft_consensus.cc:2804] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.944144 15156 raft_consensus.cc:493] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.944717 15156 raft_consensus.cc:3060] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.947574 15138 tablet_bootstrap.cc:492] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:51.947790 15139 tablet_bootstrap.cc:654] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.949950 15138 ts_tablet_manager.cc:1403] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 13:03:51.951957 15179 raft_consensus.cc:2749] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.931356 15145 raft_consensus.cc:515] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.936405 15137 raft_consensus.cc:359] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.960904 15179 raft_consensus.cc:493] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.961546 15179 raft_consensus.cc:515] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.964690 15145 leader_election.cc:290] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:51.959528 15137 raft_consensus.cc:385] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.965826 15137 raft_consensus.cc:740] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.966984 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:51.966105 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:51.967857 14947 raft_consensus.cc:2468] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 0.
I20260709 13:03:51.969192 14948 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.969079 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:51.969902 15097 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.969827 14988 leader_election.cc:304] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:51.970484 15138 raft_consensus.cc:359] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.971302 15138 raft_consensus.cc:385] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.971722 15138 raft_consensus.cc:740] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.972959 15138 consensus_queue.cc:260] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.973809 15145 raft_consensus.cc:2804] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.974231 15145 raft_consensus.cc:493] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.974655 15145 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.977243 15138 ts_tablet_manager.cc:1434] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 13:03:51.978601 15138 tablet_bootstrap.cc:492] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:51.968075 15137 consensus_queue.cc:260] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.986351 15137 ts_tablet_manager.cc:1434] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:03:51.987993 15137 tablet_bootstrap.cc:492] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:51.987908 15156 raft_consensus.cc:515] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.990593 15156 leader_election.cc:290] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:51.991194 14948 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 1.
I20260709 13:03:51.994053 15173 raft_consensus.cc:493] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.994069 14988 leader_election.cc:304] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:51.995008 15173 raft_consensus.cc:515] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:51.992451 15097 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 1.
I20260709 13:03:51.996984 15179 leader_election.cc:290] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:51.998793 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:51.980322 14844 catalog_manager.cc:5697] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 1 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:52.000710 14986 leader_election.cc:343] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.000908 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:51.999049 15179 raft_consensus.cc:2804] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.001976 15020 raft_consensus.cc:3060] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.002419 15179 raft_consensus.cc:697] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Becoming Leader. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:52.002580 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:52.014668 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:52.017040 14947 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:52.013284 15173 leader_election.cc:290] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:52.019722 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
W20260709 13:03:52.021451 15063 leader_election.cc:343] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:52.021772 15062 leader_election.cc:343] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0796a5020884417a808a07800b19342f (127.13.245.65:33707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.022307 15137 tablet_bootstrap.cc:654] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.022560 15062 leader_election.cc:304] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:52.023350 15173 raft_consensus.cc:2804] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.023926 15173 raft_consensus.cc:493] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.024398 15173 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.024075 15145 raft_consensus.cc:515] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.026158 15179 consensus_queue.cc:237] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.027796 15020 raft_consensus.cc:2468] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
I20260709 13:03:52.023422 15138 tablet_bootstrap.cc:654] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.032123 15063 leader_election.cc:304] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 0796a5020884417a808a07800b19342f
I20260709 13:03:52.035346 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:52.036266 14947 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.034129 15139 tablet_bootstrap.cc:492] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:52.037127 15139 ts_tablet_manager.cc:1403] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.021s
I20260709 13:03:52.037472 15170 raft_consensus.cc:2804] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.039374 15170 raft_consensus.cc:697] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:52.040424 15170 consensus_queue.cc:237] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.043642 15139 raft_consensus.cc:359] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.045239 15139 raft_consensus.cc:385] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.045804 15139 raft_consensus.cc:740] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.040951 15173 raft_consensus.cc:515] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.050859 15139 consensus_queue.cc:260] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.055114 15138 tablet_bootstrap.cc:492] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:52.056732 15138 ts_tablet_manager.cc:1403] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.000s
I20260709 13:03:52.060168 15173 leader_election.cc:290] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:52.060921 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:52.061461 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:52.061596 14948 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.062088 15145 leader_election.cc:290] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:52.063647 15139 ts_tablet_manager.cc:1434] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 13:03:52.062101 15020 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.064052 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:52.065186 14844 catalog_manager.cc:5697] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 0 to 1, leader changed from <none> to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 1 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:52.066576 14986 leader_election.cc:343] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.067441 14844 catalog_manager.cc:5697] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 0 to 1, leader changed from <none> to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 1 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.073155 15020 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
I20260709 13:03:52.059991 15138 raft_consensus.cc:359] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.075858 15138 raft_consensus.cc:385] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.076284 15138 raft_consensus.cc:740] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.077204 15063 leader_election.cc:304] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:52.073431 14947 raft_consensus.cc:2468] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 1.
I20260709 13:03:52.078248 15173 raft_consensus.cc:2804] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.078794 15173 raft_consensus.cc:697] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:52.077143 15138 consensus_queue.cc:260] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.078801 14988 leader_election.cc:304] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:52.081454 15138 ts_tablet_manager.cc:1434] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:03:52.082043 15137 tablet_bootstrap.cc:492] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:52.082581 15137 ts_tablet_manager.cc:1403] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.009s
I20260709 13:03:52.082973 15138 tablet_bootstrap.cc:492] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:52.082717 15173 consensus_queue.cc:237] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.085744 15137 raft_consensus.cc:359] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.086560 15137 raft_consensus.cc:385] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.086858 15137 raft_consensus.cc:740] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.087743 15179 raft_consensus.cc:2804] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.088310 15179 raft_consensus.cc:697] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Becoming Leader. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:52.089232 15179 consensus_queue.cc:237] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.074378 14948 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
I20260709 13:03:52.074692 15139 tablet_bootstrap.cc:492] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:52.091712 15138 tablet_bootstrap.cc:654] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.099396 15139 tablet_bootstrap.cc:654] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.102948 14845 catalog_manager.cc:5697] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66). New cstate: current_term: 1 leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.106236 15138 tablet_bootstrap.cc:492] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:52.106904 15138 ts_tablet_manager.cc:1403] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.016s
I20260709 13:03:52.109354 15137 consensus_queue.cc:260] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.109930 15138 raft_consensus.cc:359] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.110970 15138 raft_consensus.cc:385] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.111356 15138 raft_consensus.cc:740] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.111907 15137 ts_tablet_manager.cc:1434] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:03:52.112406 15138 consensus_queue.cc:260] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.114173 15139 tablet_bootstrap.cc:492] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:52.114691 15139 ts_tablet_manager.cc:1403] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.005s
I20260709 13:03:52.115188 15138 ts_tablet_manager.cc:1434] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:03:52.116806 15138 tablet_bootstrap.cc:492] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f: Bootstrap starting.
I20260709 13:03:52.118112 15139 raft_consensus.cc:359] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.112922 15137 tablet_bootstrap.cc:492] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:52.118974 15139 raft_consensus.cc:385] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.119401 15139 raft_consensus.cc:740] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.120487 15139 consensus_queue.cc:260] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.127664 15137 tablet_bootstrap.cc:654] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.129693 15139 ts_tablet_manager.cc:1434] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:03:52.130847 15139 tablet_bootstrap.cc:492] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a: Bootstrap starting.
I20260709 13:03:52.130337 14843 catalog_manager.cc:5697] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 0 to 1, leader changed from <none> to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 1 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.127662 15138 tablet_bootstrap.cc:654] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.138780 14843 catalog_manager.cc:5697] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 0 to 1, leader changed from <none> to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 1 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.140435 15139 tablet_bootstrap.cc:654] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.143066 15137 tablet_bootstrap.cc:492] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:52.143857 15137 ts_tablet_manager.cc:1403] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.006s
I20260709 13:03:52.146979 15139 tablet_bootstrap.cc:492] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a: No bootstrap required, opened a new log
I20260709 13:03:52.146907 15137 raft_consensus.cc:359] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.147473 15139 ts_tablet_manager.cc:1403] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:03:52.147688 15137 raft_consensus.cc:385] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.148025 15137 raft_consensus.cc:740] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.148818 15137 consensus_queue.cc:260] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.150233 15139 raft_consensus.cc:359] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.150797 15139 raft_consensus.cc:385] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.150954 15137 ts_tablet_manager.cc:1434] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:03:52.151051 15139 raft_consensus.cc:740] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.152074 15137 tablet_bootstrap.cc:492] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b: Bootstrap starting.
I20260709 13:03:52.152097 15139 consensus_queue.cc:260] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.153576 14846 catalog_manager.cc:5697] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66). New cstate: current_term: 1 leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.154901 15138 tablet_bootstrap.cc:492] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f: No bootstrap required, opened a new log
I20260709 13:03:52.154992 15139 ts_tablet_manager.cc:1434] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:52.155751 15138 ts_tablet_manager.cc:1403] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.004s
I20260709 13:03:52.158674 15138 raft_consensus.cc:359] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.159451 15138 raft_consensus.cc:385] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.159773 15138 raft_consensus.cc:740] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.160290 15137 tablet_bootstrap.cc:654] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.160637 15138 consensus_queue.cc:260] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.162811 15138 ts_tablet_manager.cc:1434] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:52.169704 15137 tablet_bootstrap.cc:492] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b: No bootstrap required, opened a new log
I20260709 13:03:52.170288 15137 ts_tablet_manager.cc:1403] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:03:52.173768 15137 raft_consensus.cc:359] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.174561 15137 raft_consensus.cc:385] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.174867 15137 raft_consensus.cc:740] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.175828 15137 consensus_queue.cc:260] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.178438 15137 ts_tablet_manager.cc:1434] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:03:52.196789 15167 raft_consensus.cc:493] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.197335 15167 raft_consensus.cc:515] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.199178 15167 leader_election.cc:290] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:52.200357 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:52.200380 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:52.201160 15020 raft_consensus.cc:2393] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0796a5020884417a808a07800b19342f in current term 1: Already voted for candidate e838d8e1b54043eca2f9c748f3de133b in this term.
I20260709 13:03:52.202375 14914 leader_election.cc:304] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0796a5020884417a808a07800b19342f; no voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:52.203395 15167 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.208745 15167 raft_consensus.cc:2749] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.220202 15173 raft_consensus.cc:493] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.220757 15173 raft_consensus.cc:515] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.222724 15173 leader_election.cc:290] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:52.223953 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111d244ff4844c808d538765fea283f3" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:52.223953 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111d244ff4844c808d538765fea283f3" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:52.224924 14948 raft_consensus.cc:2468] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:52.225021 15020 raft_consensus.cc:2468] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 0.
I20260709 13:03:52.226114 15062 leader_election.cc:304] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:52.226923 15173 raft_consensus.cc:2804] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.227312 15173 raft_consensus.cc:493] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.227648 15173 raft_consensus.cc:3060] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.233124 15173 raft_consensus.cc:515] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.235064 15173 leader_election.cc:290] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:52.236073 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111d244ff4844c808d538765fea283f3" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:52.236193 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111d244ff4844c808d538765fea283f3" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:52.236747 14948 raft_consensus.cc:3060] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.236838 15020 raft_consensus.cc:3060] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.242626 15020 raft_consensus.cc:2468] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
I20260709 13:03:52.242849 14948 raft_consensus.cc:2468] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 1.
I20260709 13:03:52.244051 15063 leader_election.cc:304] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:52.245337 15173 raft_consensus.cc:2804] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.245888 15173 raft_consensus.cc:697] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:52.247326 15173 consensus_queue.cc:237] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.257222 14843 catalog_manager.cc:5697] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 0 to 1, leader changed from <none> to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 1 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.285584 15173 consensus_queue.cc:1048] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.290345 15173 consensus_queue.cc:1048] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.301738 15173 consensus_queue.cc:1048] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.319350 15167 raft_consensus.cc:493] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.320008 15167 raft_consensus.cc:515] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.321588 15142 consensus_queue.cc:1048] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.322837 15167 leader_election.cc:290] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:52.326159 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aa539e667949feb9d56af5dd16a152" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:52.327054 15097 raft_consensus.cc:2468] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 0.
I20260709 13:03:52.329176 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aa539e667949feb9d56af5dd16a152" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:52.330050 14911 leader_election.cc:304] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:52.330176 15020 raft_consensus.cc:2468] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 0.
I20260709 13:03:52.331117 15167 raft_consensus.cc:2804] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.332171 15167 raft_consensus.cc:493] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.332679 15167 raft_consensus.cc:3060] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.342355 15167 raft_consensus.cc:515] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.345810 15167 leader_election.cc:290] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:52.345970 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aa539e667949feb9d56af5dd16a152" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:52.346016 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aa539e667949feb9d56af5dd16a152" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:52.346832 15020 raft_consensus.cc:3060] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.347060 15097 raft_consensus.cc:3060] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.353677 15020 raft_consensus.cc:2468] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 1.
I20260709 13:03:52.354442 15097 raft_consensus.cc:2468] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 1.
I20260709 13:03:52.355021 14914 leader_election.cc:304] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:52.355991 15167 raft_consensus.cc:2804] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.356529 15167 raft_consensus.cc:697] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:52.357355 15167 consensus_queue.cc:237] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.366528 14845 catalog_manager.cc:5697] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 1 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.396276 15142 raft_consensus.cc:493] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.396970 15142 raft_consensus.cc:515] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.398615 15167 consensus_queue.cc:1048] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.400205 15142 leader_election.cc:290] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:52.400821 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:52.401062 15167 consensus_queue.cc:1048] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.400815 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0796a5020884417a808a07800b19342f" is_pre_election: true
I20260709 13:03:52.402928 14948 raft_consensus.cc:2393] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e838d8e1b54043eca2f9c748f3de133b in current term 1: Already voted for candidate ad2dc15ed80e44c4a0b3b58493af683a in this term.
I20260709 13:03:52.404479 15062 leader_election.cc:304] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e838d8e1b54043eca2f9c748f3de133b; no voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:52.406327 15142 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.417291 15142 raft_consensus.cc:2749] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.439986 15142 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.445142 15179 consensus_queue.cc:1048] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.454610 15156 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.470520 15186 consensus_queue.cc:1048] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.480310 15211 raft_consensus.cc:493] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.480890 15211 raft_consensus.cc:515] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.484529 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e838d8e1b54043eca2f9c748f3de133b" is_pre_election: true
I20260709 13:03:52.484412 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" is_pre_election: true
I20260709 13:03:52.485504 15021 raft_consensus.cc:2393] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0796a5020884417a808a07800b19342f in current term 1: Already voted for candidate e838d8e1b54043eca2f9c748f3de133b in this term.
I20260709 13:03:52.485690 15211 leader_election.cc:290] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:52.486636 14914 leader_election.cc:304] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0796a5020884417a808a07800b19342f; no voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:52.487334 15211 raft_consensus.cc:3060] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.493758 15211 raft_consensus.cc:2749] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.520151 15145 consensus_queue.cc:1048] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.534190 15173 consensus_queue.cc:1048] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.534212 15179 consensus_queue.cc:1048] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.554718 15173 consensus_queue.cc:1048] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.568507 15173 consensus_queue.cc:1048] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.589723 15156 consensus_queue.cc:1048] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.643394 15097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:56904
I20260709 13:03:52.644340 15097 raft_consensus.cc:606] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:52.653676 15156 consensus_queue.cc:1048] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.673031 15020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b82873adb2f4c8392363556d635956a"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:37930
I20260709 13:03:52.673451 15173 consensus_queue.cc:1048] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.673938 15020 raft_consensus.cc:606] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:52.681282 15097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:56904
I20260709 13:03:52.682541 15097 raft_consensus.cc:606] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:52.692344 15097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "779ccd461b454089bbe94455a734c88e"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:56904
I20260709 13:03:52.692971 15097 raft_consensus.cc:606] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:52.700513 15097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
mode: GRACEFUL
new_leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:56904
I20260709 13:03:52.701182 15097 raft_consensus.cc:606] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Received request to transfer leadership to TS ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:52.707652 15097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
mode: GRACEFUL
new_leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:56904
I20260709 13:03:52.708206 15097 raft_consensus.cc:606] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Received request to transfer leadership to TS ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:52.717717 15097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "111d244ff4844c808d538765fea283f3"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
mode: GRACEFUL
new_leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:56904
I20260709 13:03:52.718302 15097 raft_consensus.cc:606] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Received request to transfer leadership to TS ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:52.726316 15173 raft_consensus.cc:993] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b: : Instructing follower ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:03:52.726846 15156 raft_consensus.cc:1081] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Signalling peer ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:03:52.728803 15020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:37910
I20260709 13:03:52.729399 15020 raft_consensus.cc:493] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:52.729756 15020 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.735826 14948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3aa539e667949feb9d56af5dd16a152"
dest_uuid: "0796a5020884417a808a07800b19342f"
mode: GRACEFUL
new_leader_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:34876
I20260709 13:03:52.736577 14948 raft_consensus.cc:606] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Received request to transfer leadership to TS e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:52.737483 15020 raft_consensus.cc:515] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.739766 15020 leader_election.cc:290] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 2 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:52.741032 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:52.741130 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:52.741729 14948 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.741881 15097 raft_consensus.cc:3055] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:52.742524 15097 raft_consensus.cc:740] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:52.743709 15097 consensus_queue.cc:260] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.744846 15097 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.747689 14948 raft_consensus.cc:2468] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 2.
I20260709 13:03:52.749051 14988 leader_election.cc:304] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:52.749862 15179 raft_consensus.cc:2804] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:52.750319 15179 raft_consensus.cc:697] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Becoming Leader. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:52.750981 15097 raft_consensus.cc:2468] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 2.
I20260709 13:03:52.751116 15179 consensus_queue.cc:237] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.760174 14844 catalog_manager.cc:5697] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a reported cstate change: term changed from 1 to 2, leader changed from e838d8e1b54043eca2f9c748f3de133b (127.13.245.67) to ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66). New cstate: current_term: 2 leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.876700 15173 raft_consensus.cc:993] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:52.877293 15156 raft_consensus.cc:1081] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:52.879101 14948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34852
I20260709 13:03:52.879806 14948 raft_consensus.cc:493] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:52.880101 14948 raft_consensus.cc:3060] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.885350 14948 raft_consensus.cc:515] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:52.887255 14948 leader_election.cc:290] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Requested vote from peers e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:52.888475 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:52.888409 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77c76aa4eda483ebd41a4189adb1f2e" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:52.889135 15097 raft_consensus.cc:3055] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:52.889173 15020 raft_consensus.cc:3060] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.889503 15097 raft_consensus.cc:740] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:52.890311 15097 consensus_queue.cc:260] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:52.891331 15097 raft_consensus.cc:3060] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.895780 15020 raft_consensus.cc:2468] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:52.897198 15097 raft_consensus.cc:2468] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:52.897260 14914 leader_election.cc:304] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:52.898510 15211 raft_consensus.cc:2804] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:52.899080 15211 raft_consensus.cc:697] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:52.900013 15211 consensus_queue.cc:237] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } }
I20260709 13:03:52.908830 14845 catalog_manager.cc:5697] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 1 to 2, leader changed from e838d8e1b54043eca2f9c748f3de133b (127.13.245.67) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 2 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.914484 15211 consensus_queue.cc:1048] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.914742 15145 raft_consensus.cc:993] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:52.915493 15179 raft_consensus.cc:1081] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:52.917448 14948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b82873adb2f4c8392363556d635956a"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34866
I20260709 13:03:52.918123 14948 raft_consensus.cc:493] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:52.918512 14948 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.923623 15144 raft_consensus.cc:993] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f: : Instructing follower e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:03:52.924168 15144 raft_consensus.cc:1081] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Signalling peer e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:03:52.926748 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3aa539e667949feb9d56af5dd16a152"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:56896
I20260709 13:03:52.927383 15096 raft_consensus.cc:493] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:52.927369 14948 raft_consensus.cc:515] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.928088 15096 raft_consensus.cc:3060] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.930425 15167 consensus_queue.cc:1048] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.931321 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:52.932041 15095 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.932546 14948 leader_election.cc:290] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:52.932751 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:52.933449 15020 raft_consensus.cc:3055] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:52.933811 15020 raft_consensus.cc:740] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:52.935767 15020 consensus_queue.cc:260] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.937155 15020 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.944615 15095 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:52.937229 15096 raft_consensus.cc:515] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.946048 14911 leader_election.cc:304] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:52.946987 15211 raft_consensus.cc:2804] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:52.947530 15097 raft_consensus.cc:1240] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Rejecting Update request from peer 0796a5020884417a808a07800b19342f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:52.948563 15211 raft_consensus.cc:697] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:52.949051 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aa539e667949feb9d56af5dd16a152" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:52.949651 14948 raft_consensus.cc:3055] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:52.950160 14948 raft_consensus.cc:740] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:52.949600 15211 consensus_queue.cc:237] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.951006 14948 consensus_queue.cc:260] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.952273 14948 raft_consensus.cc:3060] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.946565 15020 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:52.957150 15096 leader_election.cc:290] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 2 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:52.959295 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aa539e667949feb9d56af5dd16a152" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:52.960019 15020 raft_consensus.cc:3060] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.961067 14948 raft_consensus.cc:2468] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 2.
I20260709 13:03:52.960778 14845 catalog_manager.cc:5697] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 1 to 2, leader changed from ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 2 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.962873 15062 leader_election.cc:304] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:52.963925 15156 raft_consensus.cc:2804] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:52.964458 15156 raft_consensus.cc:697] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 2 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:52.965265 15156 consensus_queue.cc:237] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:52.968401 15020 raft_consensus.cc:2468] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 2.
I20260709 13:03:52.973294 14844 catalog_manager.cc:5697] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 1 to 2, leader changed from 0796a5020884417a808a07800b19342f (127.13.245.65) to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 2 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.017176 15170 raft_consensus.cc:993] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b: : Instructing follower ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:03:53.017714 15156 raft_consensus.cc:1081] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Signalling peer ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:03:53.019444 15020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:37910
I20260709 13:03:53.020141 15020 raft_consensus.cc:493] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:53.020531 15020 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.026602 15020 raft_consensus.cc:515] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.029320 15020 leader_election.cc:290] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 2 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:53.029927 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:53.029925 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:53.030730 15096 raft_consensus.cc:3055] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:53.030834 14948 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.031098 15096 raft_consensus.cc:740] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:53.032137 15096 consensus_queue.cc:260] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.033319 15096 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.037101 14948 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 2.
I20260709 13:03:53.038450 14988 leader_election.cc:304] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:53.039278 15179 raft_consensus.cc:2804] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:53.039342 15096 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 2.
I20260709 13:03:53.039939 15179 raft_consensus.cc:697] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Becoming Leader. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:53.040863 15179 consensus_queue.cc:237] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.049082 14844 catalog_manager.cc:5697] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a reported cstate change: term changed from 1 to 2, leader changed from e838d8e1b54043eca2f9c748f3de133b (127.13.245.67) to ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66). New cstate: current_term: 2 leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.069059 15170 raft_consensus.cc:993] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:53.069607 15170 raft_consensus.cc:1081] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:53.071393 14948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "779ccd461b454089bbe94455a734c88e"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34852
I20260709 13:03:53.071943 14948 raft_consensus.cc:493] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:53.072224 14948 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.078331 14948 raft_consensus.cc:515] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.080391 14948 leader_election.cc:290] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:53.081745 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:53.081758 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:53.082465 15020 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.082541 15096 raft_consensus.cc:3055] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:53.082942 15096 raft_consensus.cc:740] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:53.083824 15096 consensus_queue.cc:260] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.084897 15096 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.088954 15020 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:53.090364 14914 leader_election.cc:304] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:53.091056 15096 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:53.091355 15211 raft_consensus.cc:2804] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:53.092021 15211 raft_consensus.cc:697] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:53.092886 15211 consensus_queue.cc:237] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.100212 14844 catalog_manager.cc:5697] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 1 to 2, leader changed from e838d8e1b54043eca2f9c748f3de133b (127.13.245.67) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 2 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.137192 15156 raft_consensus.cc:993] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b: : Instructing follower ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:03:53.137825 15170 raft_consensus.cc:1081] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Signalling peer ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:03:53.139756 15020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "111d244ff4844c808d538765fea283f3"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:37910
I20260709 13:03:53.140408 15020 raft_consensus.cc:493] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:53.140802 15020 raft_consensus.cc:3060] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.147270 15020 raft_consensus.cc:515] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.149322 15020 leader_election.cc:290] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 2 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:53.150631 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111d244ff4844c808d538765fea283f3" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:53.150630 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111d244ff4844c808d538765fea283f3" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:53.151337 14948 raft_consensus.cc:3060] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.151439 15096 raft_consensus.cc:3055] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:53.151882 15096 raft_consensus.cc:740] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:53.152634 15096 consensus_queue.cc:260] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.153622 15096 raft_consensus.cc:3060] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.157939 14948 raft_consensus.cc:2468] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 2.
I20260709 13:03:53.159183 15096 raft_consensus.cc:2468] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 2.
I20260709 13:03:53.159241 14988 leader_election.cc:304] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:53.160189 15230 raft_consensus.cc:2804] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:53.160717 15230 raft_consensus.cc:697] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Becoming Leader. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:53.161526 15230 consensus_queue.cc:237] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.168572 14844 catalog_manager.cc:5697] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a reported cstate change: term changed from 1 to 2, leader changed from e838d8e1b54043eca2f9c748f3de133b (127.13.245.67) to ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66). New cstate: current_term: 2 leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.213104 15156 raft_consensus.cc:993] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:53.213650 15156 raft_consensus.cc:1081] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:53.215479 14948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34852
I20260709 13:03:53.216125 14948 raft_consensus.cc:493] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:53.216496 14948 raft_consensus.cc:3060] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.221715 14948 raft_consensus.cc:515] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.223492 14948 leader_election.cc:290] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:53.224622 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:53.224831 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fe781a39d4bbea3a2311ccf2f9b95" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:53.225140 15020 raft_consensus.cc:3060] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.225409 15096 raft_consensus.cc:3055] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:53.225729 15096 raft_consensus.cc:740] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:53.226433 15096 consensus_queue.cc:260] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.227471 15096 raft_consensus.cc:3060] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.230480 15020 raft_consensus.cc:2468] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:53.231973 14914 leader_election.cc:304] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:53.232821 15211 raft_consensus.cc:2804] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:53.233259 15211 raft_consensus.cc:697] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:53.233793 15096 raft_consensus.cc:2468] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:53.234164 15211 consensus_queue.cc:237] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:53.241990 14844 catalog_manager.cc:5697] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 1 to 2, leader changed from e838d8e1b54043eca2f9c748f3de133b (127.13.245.67) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 2 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.274725 14948 raft_consensus.cc:1275] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.276412 15230 consensus_queue.cc:1048] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.284647 15096 raft_consensus.cc:1275] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.287074 15179 consensus_queue.cc:1048] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.365876 15096 raft_consensus.cc:1275] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.367689 15211 consensus_queue.cc:1048] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.381155 15020 raft_consensus.cc:1275] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.382781 15167 consensus_queue.cc:1048] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:53.390799 15096 raft_consensus.cc:1275] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.392741 15211 consensus_queue.cc:1048] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.404704 15020 raft_consensus.cc:1275] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.406646 15167 consensus_queue.cc:1048] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.416205 15020 raft_consensus.cc:1275] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.418099 15156 consensus_queue.cc:1048] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.428192 14948 raft_consensus.cc:1275] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.430094 15156 consensus_queue.cc:1048] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.508033 14948 raft_consensus.cc:1275] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.509524 15179 consensus_queue.cc:1048] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.521503 15096 raft_consensus.cc:1275] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.524045 15145 consensus_queue.cc:1048] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.537470 15020 raft_consensus.cc:1275] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.538913 15167 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.549045 15096 raft_consensus.cc:1275] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.551508 15167 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:53.684116 15095 raft_consensus.cc:1275] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.685665 15145 consensus_queue.cc:1048] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:53.696132 14948 raft_consensus.cc:1275] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.698052 15230 consensus_queue.cc:1048] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.724130 15020 raft_consensus.cc:1275] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.725605 15144 consensus_queue.cc:1048] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.734742 15095 raft_consensus.cc:1275] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.736533 15235 consensus_queue.cc:1048] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:55.783674 14293 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:03:55.784888 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:55.819028 14948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b82873adb2f4c8392363556d635956a"
dest_uuid: "0796a5020884417a808a07800b19342f"
mode: GRACEFUL
new_leader_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:34884
I20260709 13:03:55.820225 14948 raft_consensus.cc:606] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Received request to transfer leadership to TS e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:55.827157 14948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "779ccd461b454089bbe94455a734c88e"
dest_uuid: "0796a5020884417a808a07800b19342f"
mode: GRACEFUL
new_leader_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:34884
I20260709 13:03:55.828334 14948 raft_consensus.cc:606] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Received request to transfer leadership to TS e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:55.830560 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:55.831327 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:56.222154 15244 raft_consensus.cc:993] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f: : Instructing follower e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:03:56.222741 15249 raft_consensus.cc:1081] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Signalling peer e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:03:56.224648 15095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "779ccd461b454089bbe94455a734c88e"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:56896
I20260709 13:03:56.225291 15095 raft_consensus.cc:493] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:56.225654 15095 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.233814 15095 raft_consensus.cc:515] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:56.236207 15095 leader_election.cc:290] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 3 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:56.237224 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:56.237708 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:56.238088 14948 raft_consensus.cc:3055] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:56.238355 15021 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.238442 14948 raft_consensus.cc:740] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:56.239724 14948 consensus_queue.cc:260] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:56.241117 14948 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.247370 14948 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 3.
I20260709 13:03:56.248005 15021 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 3.
I20260709 13:03:56.249262 15062 leader_election.cc:304] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:56.250510 15243 raft_consensus.cc:2804] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:56.251763 15243 raft_consensus.cc:697] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:56.252810 15243 consensus_queue.cc:237] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:56.260180 14843 catalog_manager.cc:5697] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 2 to 3, leader changed from 0796a5020884417a808a07800b19342f (127.13.245.65) to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 3 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.379328 15244 raft_consensus.cc:993] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f: : Instructing follower e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:03:56.379911 15249 raft_consensus.cc:1081] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Signalling peer e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:03:56.381727 15095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b82873adb2f4c8392363556d635956a"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:56896
I20260709 13:03:56.382296 15095 raft_consensus.cc:493] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:56.382594 15095 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.387790 15095 raft_consensus.cc:515] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:56.389508 15095 leader_election.cc:290] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 3 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:03:56.390748 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:56.390856 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:03:56.391248 15020 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.391534 14947 raft_consensus.cc:3055] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:56.391927 14947 raft_consensus.cc:740] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:56.392652 14947 consensus_queue.cc:260] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:56.393862 14947 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.396508 15020 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 3.
I20260709 13:03:56.397969 15063 leader_election.cc:304] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:56.398751 15243 raft_consensus.cc:2804] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:56.399201 15243 raft_consensus.cc:697] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:56.400068 15243 consensus_queue.cc:237] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:56.400578 14947 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 3.
I20260709 13:03:56.407122 14843 catalog_manager.cc:5697] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 2 to 3, leader changed from 0796a5020884417a808a07800b19342f (127.13.245.65) to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 3 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.637976 15020 raft_consensus.cc:1275] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:56.639308 15243 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.651934 14947 raft_consensus.cc:1275] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:56.653973 15243 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.803946 15020 raft_consensus.cc:1275] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:56.805567 15243 consensus_queue.cc:1048] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.816618 14947 raft_consensus.cc:1275] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:56.818431 15243 consensus_queue.cc:1048] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.832427 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:56.852849 15095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b82873adb2f4c8392363556d635956a"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:56904
I20260709 13:03:56.853498 15095 raft_consensus.cc:606] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:56.863200 15095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "779ccd461b454089bbe94455a734c88e"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:56904
I20260709 13:03:56.863830 15095 raft_consensus.cc:606] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:56.870344 15020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:37930
I20260709 13:03:56.870985 15020 raft_consensus.cc:606] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:56.877158 15020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:37930
I20260709 13:03:56.877766 15020 raft_consensus.cc:606] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:56.884059 15020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "428b66aef10e443bb08930ad331d3730"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
mode: GRACEFUL
new_leader_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:37930
I20260709 13:03:56.884689 15020 raft_consensus.cc:606] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Received request to transfer leadership to TS 0796a5020884417a808a07800b19342f
I20260709 13:03:57.066380 15246 raft_consensus.cc:993] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.067075 15265 raft_consensus.cc:1081] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.068908 14948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34866
I20260709 13:03:57.069468 14948 raft_consensus.cc:493] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:57.069770 14948 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.075053 14948 raft_consensus.cc:515] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.077039 14948 leader_election.cc:290] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 3 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:57.078006 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:57.078249 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572831563e049c9bcc979cfe2c2ab92" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:57.078723 15020 raft_consensus.cc:3055] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:57.078843 15095 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.079144 15020 raft_consensus.cc:740] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:57.080080 15020 consensus_queue.cc:260] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.081409 15020 raft_consensus.cc:3060] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.084265 15095 raft_consensus.cc:2468] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 3.
I20260709 13:03:57.085582 14911 leader_election.cc:304] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:57.086350 15249 raft_consensus.cc:2804] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:57.086938 15020 raft_consensus.cc:2468] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 3.
I20260709 13:03:57.087675 15249 raft_consensus.cc:697] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 3 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:57.088996 15249 consensus_queue.cc:237] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.096720 14843 catalog_manager.cc:5697] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 2 to 3, leader changed from ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 3 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.134579 15246 raft_consensus.cc:993] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.135125 15265 raft_consensus.cc:1081] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.136811 14947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34866
I20260709 13:03:57.137387 14947 raft_consensus.cc:493] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:57.137789 14947 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.137854 15243 raft_consensus.cc:993] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.138720 15263 raft_consensus.cc:1081] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.140457 14948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "779ccd461b454089bbe94455a734c88e"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34852
I20260709 13:03:57.140990 14948 raft_consensus.cc:493] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:57.141315 14948 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.144240 14947 raft_consensus.cc:515] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.146499 14947 leader_election.cc:290] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 3 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:57.147081 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:57.147161 14948 raft_consensus.cc:515] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.147221 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:57.148066 15020 raft_consensus.cc:3055] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:57.148391 15020 raft_consensus.cc:740] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:57.148397 15095 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.149389 15020 consensus_queue.cc:260] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.150398 14948 leader_election.cc:290] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 4 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:57.150512 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:57.151108 15020 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.151229 15021 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.155686 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:57.156373 15096 raft_consensus.cc:3055] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:57.156695 15096 raft_consensus.cc:740] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:57.157557 15096 consensus_queue.cc:260] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.159075 15021 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 4.
I20260709 13:03:57.159399 15096 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.160776 14914 leader_election.cc:304] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:57.161886 15249 raft_consensus.cc:2804] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:57.159494 15020 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 3.
I20260709 13:03:57.157538 15095 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 3.
I20260709 13:03:57.162580 15249 raft_consensus.cc:697] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 4 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:57.163591 15249 consensus_queue.cc:237] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.163594 14914 leader_election.cc:304] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:57.166069 15266 raft_consensus.cc:2804] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:57.169183 15096 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 4.
I20260709 13:03:57.170688 15266 raft_consensus.cc:697] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 3 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:57.173266 15266 consensus_queue.cc:237] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.174157 14843 catalog_manager.cc:5697] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 3 to 4, leader changed from e838d8e1b54043eca2f9c748f3de133b (127.13.245.67) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 4 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.187712 14843 catalog_manager.cc:5697] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 2 to 3, leader changed from ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 3 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.220201 15246 raft_consensus.cc:993] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.220754 15246 raft_consensus.cc:1081] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.222887 14948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "428b66aef10e443bb08930ad331d3730"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34866
I20260709 13:03:57.223675 14948 raft_consensus.cc:493] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:57.224104 14948 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:57.230016 14948 raft_consensus.cc:515] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.231937 14948 leader_election.cc:290] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:57.233327 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:57.233219 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:57.234030 15095 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:57.234030 15020 raft_consensus.cc:3055] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:57.234637 15020 raft_consensus.cc:740] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:03:57.235769 15020 consensus_queue.cc:260] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.237398 15020 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:57.245065 15095 raft_consensus.cc:2468] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:57.246665 14911 leader_election.cc:304] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:03:57.246830 15020 raft_consensus.cc:2468] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 2.
I20260709 13:03:57.247892 15266 raft_consensus.cc:2804] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:57.248591 15266 raft_consensus.cc:697] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:57.249924 15266 consensus_queue.cc:237] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.258075 14843 catalog_manager.cc:5697] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 1 to 2, leader changed from ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 2 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.424769 15243 raft_consensus.cc:993] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b: : Instructing follower 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.425371 15263 raft_consensus.cc:1081] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Signalling peer 0796a5020884417a808a07800b19342f to start an election
I20260709 13:03:57.427278 14948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b82873adb2f4c8392363556d635956a"
dest_uuid: "0796a5020884417a808a07800b19342f"
 from {username='slave'} at 127.0.0.1:34852
I20260709 13:03:57.427984 14948 raft_consensus.cc:493] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:57.428328 14948 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.433907 14948 raft_consensus.cc:515] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.435966 14948 leader_election.cc:290] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 4 election: Requested vote from peers ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:03:57.437081 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:03:57.437081 15020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b82873adb2f4c8392363556d635956a" candidate_uuid: "0796a5020884417a808a07800b19342f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:03:57.437945 15095 raft_consensus.cc:3055] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:57.438048 15020 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.438371 15095 raft_consensus.cc:740] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:03:57.439349 15095 consensus_queue.cc:260] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.440673 15095 raft_consensus.cc:3060] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.445322 15020 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 4.
I20260709 13:03:57.446954 14914 leader_election.cc:304] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, ad2dc15ed80e44c4a0b3b58493af683a; no voters: 
I20260709 13:03:57.447738 15095 raft_consensus.cc:2468] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0796a5020884417a808a07800b19342f in term 4.
I20260709 13:03:57.448077 15266 raft_consensus.cc:2804] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:57.448592 15266 raft_consensus.cc:697] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 4 LEADER]: Becoming Leader. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:03:57.449427 15266 consensus_queue.cc:237] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:03:57.455938 14843 catalog_manager.cc:5697] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f reported cstate change: term changed from 3 to 4, leader changed from e838d8e1b54043eca2f9c748f3de133b (127.13.245.67) to 0796a5020884417a808a07800b19342f (127.13.245.65). New cstate: current_term: 4 leader_uuid: "0796a5020884417a808a07800b19342f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.628072 15095 raft_consensus.cc:1275] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:57.629621 15266 consensus_queue.cc:1048] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:57.641471 15020 raft_consensus.cc:1275] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:57.643570 15271 consensus_queue.cc:1048] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:57.650360 15021 raft_consensus.cc:1275] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:57.652416 15266 consensus_queue.cc:1048] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:57.660364 15020 raft_consensus.cc:1275] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:57.663463 15095 raft_consensus.cc:1275] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:57.664911 15249 consensus_queue.cc:1048] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:57.665439 15271 consensus_queue.cc:1048] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:57.685119 15096 raft_consensus.cc:1275] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:57.687493 15249 consensus_queue.cc:1048] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:57.713064 15020 raft_consensus.cc:1275] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:57.714654 15271 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:57.730504 15095 raft_consensus.cc:1275] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:57.732256 15285 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:57.926669 15020 raft_consensus.cc:1275] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:57.928511 15285 consensus_queue.cc:1048] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:57.938921 15095 raft_consensus.cc:1275] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Refusing update from remote peer 0796a5020884417a808a07800b19342f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:57.940632 15285 consensus_queue.cc:1048] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:59.894623 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:59.903301 14948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "428b66aef10e443bb08930ad331d3730"
dest_uuid: "0796a5020884417a808a07800b19342f"
mode: GRACEFUL
new_leader_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:34884
I20260709 13:03:59.904102 14948 raft_consensus.cc:606] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Received request to transfer leadership to TS e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:59.907274 14948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55df0921a1944cf8825b590a079b53db"
dest_uuid: "0796a5020884417a808a07800b19342f"
mode: GRACEFUL
new_leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:34884
I20260709 13:03:59.907902 14948 raft_consensus.cc:606] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Received request to transfer leadership to TS ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:59.910804 14948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "779ccd461b454089bbe94455a734c88e"
dest_uuid: "0796a5020884417a808a07800b19342f"
mode: GRACEFUL
new_leader_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:34884
I20260709 13:03:59.911376 14948 raft_consensus.cc:606] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 4 LEADER]: Received request to transfer leadership to TS e838d8e1b54043eca2f9c748f3de133b
I20260709 13:03:59.914094 14948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0"
dest_uuid: "0796a5020884417a808a07800b19342f"
mode: GRACEFUL
new_leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:34884
I20260709 13:03:59.914655 14948 raft_consensus.cc:606] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 3 LEADER]: Received request to transfer leadership to TS ad2dc15ed80e44c4a0b3b58493af683a
I20260709 13:03:59.915889 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:59.916474 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:00.105129 15289 raft_consensus.cc:993] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f: : Instructing follower e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:04:00.105774 15285 raft_consensus.cc:1081] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 4 LEADER]: Signalling peer e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:04:00.107841 15095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "779ccd461b454089bbe94455a734c88e"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:56896
I20260709 13:04:00.108345 15095 raft_consensus.cc:493] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:00.108670 15095 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.113299 15095 raft_consensus.cc:515] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.115191 15095 leader_election.cc:290] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 5 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:04:00.116304 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:04:00.116724 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779ccd461b454089bbe94455a734c88e" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:04:00.116963 14948 raft_consensus.cc:3055] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:00.117328 14948 raft_consensus.cc:740] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:04:00.117358 15021 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.118284 14948 consensus_queue.cc:260] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.119321 14948 raft_consensus.cc:3060] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.122839 15021 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 5.
I20260709 13:04:00.124198 15063 leader_election.cc:304] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:04:00.124931 15290 raft_consensus.cc:2804] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:00.125160 14948 raft_consensus.cc:2468] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 5.
I20260709 13:04:00.125366 15290 raft_consensus.cc:697] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 5 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:04:00.126323 15290 consensus_queue.cc:237] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.133704 14843 catalog_manager.cc:5697] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 4 to 5, leader changed from 0796a5020884417a808a07800b19342f (127.13.245.65) to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 5 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:00.210007 15289 raft_consensus.cc:993] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f: : Instructing follower ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:04:00.210505 15285 raft_consensus.cc:1081] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Signalling peer ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:04:00.212306 15021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55df0921a1944cf8825b590a079b53db"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:37918
I20260709 13:04:00.213006 15021 raft_consensus.cc:493] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:00.213372 15021 raft_consensus.cc:3060] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.219326 15021 raft_consensus.cc:515] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.221406 15021 leader_election.cc:290] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 2 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:04:00.222479 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:04:00.222637 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55df0921a1944cf8825b590a079b53db" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:04:00.223330 14948 raft_consensus.cc:3055] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:00.223430 15095 raft_consensus.cc:3060] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.223707 14948 raft_consensus.cc:740] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:04:00.224622 14948 consensus_queue.cc:260] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.225663 14948 raft_consensus.cc:3060] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.228956 15095 raft_consensus.cc:2468] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 2.
I20260709 13:04:00.230309 14986 leader_election.cc:304] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:04:00.231132 15246 raft_consensus.cc:2804] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.232807 15246 raft_consensus.cc:697] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Becoming Leader. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:04:00.233246 14948 raft_consensus.cc:2468] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 2.
I20260709 13:04:00.233848 15246 consensus_queue.cc:237] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.242465 14843 catalog_manager.cc:5697] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a reported cstate change: term changed from 1 to 2, leader changed from 0796a5020884417a808a07800b19342f (127.13.245.65) to ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66). New cstate: current_term: 2 leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.374248 15289 raft_consensus.cc:993] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f: : Instructing follower ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:04:00.375423 15298 raft_consensus.cc:1081] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 3 LEADER]: Signalling peer ad2dc15ed80e44c4a0b3b58493af683a to start an election
I20260709 13:04:00.377585 15021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0"
dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
 from {username='slave'} at 127.0.0.1:37918
I20260709 13:04:00.378087 15289 raft_consensus.cc:993] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f: : Instructing follower e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:04:00.378175 15021 raft_consensus.cc:493] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:00.378913 15021 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:00.378966 15289 raft_consensus.cc:1081] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Signalling peer e838d8e1b54043eca2f9c748f3de133b to start an election
I20260709 13:04:00.381448 15095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "428b66aef10e443bb08930ad331d3730"
dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
 from {username='slave'} at 127.0.0.1:56896
I20260709 13:04:00.382040 15095 raft_consensus.cc:493] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:00.382386 15095 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:00.386044 15021 raft_consensus.cc:515] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.388183 15021 leader_election.cc:290] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 4 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), e838d8e1b54043eca2f9c748f3de133b (127.13.245.67:44379)
I20260709 13:04:00.388775 15095 raft_consensus.cc:515] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.389206 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e838d8e1b54043eca2f9c748f3de133b"
I20260709 13:04:00.389175 14948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2dc92324e24a02894596adb5cf43d0" candidate_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:04:00.389957 15096 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:00.390259 14948 raft_consensus.cc:3055] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:00.390632 14948 raft_consensus.cc:740] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:04:00.391316 14947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0796a5020884417a808a07800b19342f"
I20260709 13:04:00.391953 14947 raft_consensus.cc:3055] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:00.391438 14948 consensus_queue.cc:260] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.392308 14947 raft_consensus.cc:740] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0796a5020884417a808a07800b19342f, State: Running, Role: LEADER
I20260709 13:04:00.392840 15095 leader_election.cc:290] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 3 election: Requested vote from peers 0796a5020884417a808a07800b19342f (127.13.245.65:33707), ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491)
I20260709 13:04:00.392989 14948 raft_consensus.cc:3060] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:00.393150 14947 consensus_queue.cc:260] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.394501 15021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428b66aef10e443bb08930ad331d3730" candidate_uuid: "e838d8e1b54043eca2f9c748f3de133b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2dc15ed80e44c4a0b3b58493af683a"
I20260709 13:04:00.395248 15021 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:00.394433 14947 raft_consensus.cc:3060] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:00.397688 15096 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 4.
I20260709 13:04:00.399076 14986 leader_election.cc:304] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2dc15ed80e44c4a0b3b58493af683a, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:04:00.400044 15246 raft_consensus.cc:2804] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:00.400543 15246 raft_consensus.cc:697] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 4 LEADER]: Becoming Leader. State: Replica: ad2dc15ed80e44c4a0b3b58493af683a, State: Running, Role: LEADER
I20260709 13:04:00.401539 14948 raft_consensus.cc:2468] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2dc15ed80e44c4a0b3b58493af683a in term 4.
I20260709 13:04:00.401398 15246 consensus_queue.cc:237] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.403756 15021 raft_consensus.cc:2468] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 3.
I20260709 13:04:00.405113 14947 raft_consensus.cc:2468] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e838d8e1b54043eca2f9c748f3de133b in term 3.
I20260709 13:04:00.406409 15062 leader_election.cc:304] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0796a5020884417a808a07800b19342f, e838d8e1b54043eca2f9c748f3de133b; no voters: 
I20260709 13:04:00.407403 15290 raft_consensus.cc:2804] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:00.408002 15290 raft_consensus.cc:697] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Becoming Leader. State: Replica: e838d8e1b54043eca2f9c748f3de133b, State: Running, Role: LEADER
I20260709 13:04:00.408917 15290 consensus_queue.cc:237] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } }
I20260709 13:04:00.411900 14843 catalog_manager.cc:5697] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a reported cstate change: term changed from 3 to 4, leader changed from 0796a5020884417a808a07800b19342f (127.13.245.65) to ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66). New cstate: current_term: 4 leader_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.417092 14845 catalog_manager.cc:5697] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b reported cstate change: term changed from 2 to 3, leader changed from 0796a5020884417a808a07800b19342f (127.13.245.65) to e838d8e1b54043eca2f9c748f3de133b (127.13.245.67). New cstate: current_term: 3 leader_uuid: "e838d8e1b54043eca2f9c748f3de133b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:00.506111 14948 raft_consensus.cc:1275] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 5 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:00.507530 15290 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:00.519387 15021 raft_consensus.cc:1275] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 5 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:00.522408 15290 consensus_queue.cc:1048] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:00.749044 15095 raft_consensus.cc:1275] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:00.750662 15246 consensus_queue.cc:1048] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:00.757340 14948 raft_consensus.cc:1275] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:00.758848 15296 consensus_queue.cc:1048] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:00.834682 14948 raft_consensus.cc:1275] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:00.836468 15246 consensus_queue.cc:1048] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0796a5020884417a808a07800b19342f" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:00.847204 15095 raft_consensus.cc:1275] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Refusing update from remote peer ad2dc15ed80e44c4a0b3b58493af683a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:00.849663 15246 consensus_queue.cc:1048] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e838d8e1b54043eca2f9c748f3de133b" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:00.917348 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:00.924566 14293 tablet_server.cc:179] TabletServer@127.13.245.65:0 shutting down...
W20260709 13:04:00.938051 15062 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:04:00.944597 15062 consensus_peers.cc:597] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b -> Peer 0796a5020884417a808a07800b19342f (127.13.245.65:33707): Couldn't send request to peer 0796a5020884417a808a07800b19342f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:00.954900 15021 raft_consensus.cc:1275] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Refusing update from remote peer e838d8e1b54043eca2f9c748f3de133b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:00.956560 15290 consensus_queue.cc:1048] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2dc15ed80e44c4a0b3b58493af683a" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:00.972348 14988 consensus_peers.cc:597] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a -> Peer 0796a5020884417a808a07800b19342f (127.13.245.65:33707): Couldn't send request to peer 0796a5020884417a808a07800b19342f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:00.984671 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:00.986153 14293 tablet_replica.cc:333] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:00.990857 14293 raft_consensus.cc:2243] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:00.991614 14293 raft_consensus.cc:2272] T d3aa539e667949feb9d56af5dd16a152 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:00.994264 14293 tablet_replica.cc:333] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:00.994959 14293 raft_consensus.cc:2243] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:00.995615 14293 raft_consensus.cc:2272] T 111d244ff4844c808d538765fea283f3 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:00.997757 14293 tablet_replica.cc:333] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:00.998445 14293 raft_consensus.cc:2243] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:00.999414 14293 raft_consensus.cc:2272] T b572831563e049c9bcc979cfe2c2ab92 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.001823 14293 tablet_replica.cc:333] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:01.002481 14293 raft_consensus.cc:2243] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.003353 14293 raft_consensus.cc:2272] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.005761 14293 tablet_replica.cc:333] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:01.006420 14293 raft_consensus.cc:2243] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.006916 14293 raft_consensus.cc:2272] T 9f2dc92324e24a02894596adb5cf43d0 P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.010141 14293 tablet_replica.cc:333] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:01.011116 14293 raft_consensus.cc:2243] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.011833 14293 raft_consensus.cc:2272] T 779ccd461b454089bbe94455a734c88e P 0796a5020884417a808a07800b19342f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.015128 14293 tablet_replica.cc:333] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:01.015875 14293 raft_consensus.cc:2243] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.016736 14293 raft_consensus.cc:2272] T 5b82873adb2f4c8392363556d635956a P 0796a5020884417a808a07800b19342f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.018895 14293 tablet_replica.cc:333] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:01.019486 14293 raft_consensus.cc:2243] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.020007 14293 raft_consensus.cc:2272] T 428b66aef10e443bb08930ad331d3730 P 0796a5020884417a808a07800b19342f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.022454 14293 tablet_replica.cc:333] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:01.023097 14293 raft_consensus.cc:2243] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.023690 14293 raft_consensus.cc:2272] T 55df0921a1944cf8825b590a079b53db P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.026324 14293 tablet_replica.cc:333] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f: stopping tablet replica
I20260709 13:04:01.026966 14293 raft_consensus.cc:2243] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.028096 14293 raft_consensus.cc:2272] T f77c76aa4eda483ebd41a4189adb1f2e P 0796a5020884417a808a07800b19342f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.062179 14293 tablet_server.cc:196] TabletServer@127.13.245.65:0 shutdown complete.
I20260709 13:04:01.086627 14293 tablet_server.cc:179] TabletServer@127.13.245.66:0 shutting down...
W20260709 13:04:01.103847 15062 consensus_peers.cc:597] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b -> Peer 0796a5020884417a808a07800b19342f (127.13.245.65:33707): Couldn't send request to peer 0796a5020884417a808a07800b19342f. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:33707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.120869 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:01.121835 14293 tablet_replica.cc:333] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.123057 14293 raft_consensus.cc:2243] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.123821 14293 raft_consensus.cc:2272] T d3aa539e667949feb9d56af5dd16a152 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.126037 14293 tablet_replica.cc:333] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.126713 14293 raft_consensus.cc:2243] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.127697 14293 raft_consensus.cc:2272] T 111d244ff4844c808d538765fea283f3 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.129725 14293 tablet_replica.cc:333] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.130306 14293 raft_consensus.cc:2243] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.131129 14293 raft_consensus.cc:2272] T 9f2dc92324e24a02894596adb5cf43d0 P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.133664 14293 tablet_replica.cc:333] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.134263 14293 raft_consensus.cc:2243] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.134704 14293 raft_consensus.cc:2272] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.136580 14293 tablet_replica.cc:333] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.137116 14293 raft_consensus.cc:2243] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.137583 14293 raft_consensus.cc:2272] T f77c76aa4eda483ebd41a4189adb1f2e P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.139346 14293 tablet_replica.cc:333] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.139930 14293 raft_consensus.cc:2243] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.140971 14293 raft_consensus.cc:2272] T 55df0921a1944cf8825b590a079b53db P ad2dc15ed80e44c4a0b3b58493af683a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.143639 14293 tablet_replica.cc:333] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.144429 14293 raft_consensus.cc:2243] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.144992 14293 raft_consensus.cc:2272] T 779ccd461b454089bbe94455a734c88e P ad2dc15ed80e44c4a0b3b58493af683a [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:01.145080 15063 consensus_peers.cc:597] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b -> Peer ad2dc15ed80e44c4a0b3b58493af683a (127.13.245.66:42491): Couldn't send request to peer ad2dc15ed80e44c4a0b3b58493af683a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.147864 14293 tablet_replica.cc:333] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.148602 14293 raft_consensus.cc:2243] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.149230 14293 raft_consensus.cc:2272] T b572831563e049c9bcc979cfe2c2ab92 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.151778 14293 tablet_replica.cc:333] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.152490 14293 raft_consensus.cc:2243] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.153021 14293 raft_consensus.cc:2272] T 428b66aef10e443bb08930ad331d3730 P ad2dc15ed80e44c4a0b3b58493af683a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.155992 14293 tablet_replica.cc:333] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a: stopping tablet replica
I20260709 13:04:01.156610 14293 raft_consensus.cc:2243] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.157089 14293 raft_consensus.cc:2272] T 5b82873adb2f4c8392363556d635956a P ad2dc15ed80e44c4a0b3b58493af683a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.189945 14293 tablet_server.cc:196] TabletServer@127.13.245.66:0 shutdown complete.
I20260709 13:04:01.214036 14293 tablet_server.cc:179] TabletServer@127.13.245.67:0 shutting down...
I20260709 13:04:01.242177 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:01.243058 14293 tablet_replica.cc:333] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.244114 14293 raft_consensus.cc:2243] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.244886 14293 raft_consensus.cc:2272] T 111d244ff4844c808d538765fea283f3 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.247189 14293 tablet_replica.cc:333] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.247905 14293 raft_consensus.cc:2243] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.248767 14293 raft_consensus.cc:2272] T d3aa539e667949feb9d56af5dd16a152 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.250667 14293 tablet_replica.cc:333] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.251185 14293 raft_consensus.cc:2243] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.252090 14293 raft_consensus.cc:2272] T 428b66aef10e443bb08930ad331d3730 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.254546 14293 tablet_replica.cc:333] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.255097 14293 raft_consensus.cc:2243] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.255510 14293 raft_consensus.cc:2272] T 5b82873adb2f4c8392363556d635956a P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.257669 14293 tablet_replica.cc:333] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.258213 14293 raft_consensus.cc:2243] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.258653 14293 raft_consensus.cc:2272] T 9f2dc92324e24a02894596adb5cf43d0 P e838d8e1b54043eca2f9c748f3de133b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.261344 14293 tablet_replica.cc:333] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.261891 14293 raft_consensus.cc:2243] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.262320 14293 raft_consensus.cc:2272] T 4a5fe781a39d4bbea3a2311ccf2f9b95 P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.264183 14293 tablet_replica.cc:333] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.264708 14293 raft_consensus.cc:2243] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.265170 14293 raft_consensus.cc:2272] T f77c76aa4eda483ebd41a4189adb1f2e P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.267458 14293 tablet_replica.cc:333] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.268117 14293 raft_consensus.cc:2243] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.268581 14293 raft_consensus.cc:2272] T 55df0921a1944cf8825b590a079b53db P e838d8e1b54043eca2f9c748f3de133b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.271713 14293 tablet_replica.cc:333] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.272495 14293 raft_consensus.cc:2243] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:01.273108 14293 raft_consensus.cc:2272] T b572831563e049c9bcc979cfe2c2ab92 P e838d8e1b54043eca2f9c748f3de133b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.274852 14293 tablet_replica.cc:333] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b: stopping tablet replica
I20260709 13:04:01.275291 14293 raft_consensus.cc:2243] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.276154 14293 raft_consensus.cc:2272] T 779ccd461b454089bbe94455a734c88e P e838d8e1b54043eca2f9c748f3de133b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.309005 14293 tablet_server.cc:196] TabletServer@127.13.245.67:0 shutdown complete.
I20260709 13:04:01.333563 14293 master.cc:562] Master@127.13.245.126:42149 shutting down...
I20260709 13:04:01.359468 14293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:01.360284 14293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:01.360653 14293 tablet_replica.cc:333] T 00000000000000000000000000000000 P b946551868c448d0a1b3e16cfebcac26: stopping tablet replica
I20260709 13:04:01.384541 14293 master.cc:584] Master@127.13.245.126:42149 shutdown complete.
0796a5020884417a808a07800b19342f  5
ad2dc15ed80e44c4a0b3b58493af683a  4
e838d8e1b54043eca2f9c748f3de133b  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11051 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:04:01.435487 14293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.245.126:46019
I20260709 13:04:01.437290 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:01.445650 15317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:01.445663 15316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:01.445842 15319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:01.446880 14293 server_base.cc:1061] running on GCE node
I20260709 13:04:01.447929 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:01.448139 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:01.448361 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602241448322 us; error 0 us; skew 500 ppm
I20260709 13:04:01.448980 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:01.452131 14293 webserver.cc:533] Webserver started at http://127.13.245.126:36813/ using document root <none> and password file <none>
I20260709 13:04:01.452781 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:01.452962 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:01.453338 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:01.454660 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/master-0-root/instance:
uuid: "7478e1667cd24e1eb33dcbc8ac104877"
format_stamp: "Formatted at 2026-07-09 13:04:01 on dist-test-slave-fc6v"
I20260709 13:04:01.460325 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:04:01.465109 15324 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:01.466097 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:04:01.466518 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/master-0-root
uuid: "7478e1667cd24e1eb33dcbc8ac104877"
format_stamp: "Formatted at 2026-07-09 13:04:01 on dist-test-slave-fc6v"
I20260709 13:04:01.466899 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:01.499064 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:01.500634 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:01.556492 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.126:46019
I20260709 13:04:01.556605 15375 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.126:46019 every 8 connection(s)
I20260709 13:04:01.561142 15376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.573197 15376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Bootstrap starting.
I20260709 13:04:01.578727 15376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.583902 15376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: No bootstrap required, opened a new log
I20260709 13:04:01.586429 15376 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7478e1667cd24e1eb33dcbc8ac104877" member_type: VOTER }
I20260709 13:04:01.586900 15376 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.587213 15376 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7478e1667cd24e1eb33dcbc8ac104877, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.588188 15376 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7478e1667cd24e1eb33dcbc8ac104877" member_type: VOTER }
I20260709 13:04:01.588744 15376 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:01.589000 15376 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:01.589339 15376 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.594249 15376 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7478e1667cd24e1eb33dcbc8ac104877" member_type: VOTER }
I20260709 13:04:01.594924 15376 leader_election.cc:304] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7478e1667cd24e1eb33dcbc8ac104877; no voters: 
I20260709 13:04:01.596305 15376 leader_election.cc:290] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:01.596722 15379 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.598388 15379 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 1 LEADER]: Becoming Leader. State: Replica: 7478e1667cd24e1eb33dcbc8ac104877, State: Running, Role: LEADER
I20260709 13:04:01.599195 15379 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7478e1667cd24e1eb33dcbc8ac104877" member_type: VOTER }
I20260709 13:04:01.599879 15376 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:01.604315 15381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7478e1667cd24e1eb33dcbc8ac104877. Latest consensus state: current_term: 1 leader_uuid: "7478e1667cd24e1eb33dcbc8ac104877" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7478e1667cd24e1eb33dcbc8ac104877" member_type: VOTER } }
I20260709 13:04:01.605257 15381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:01.604974 15380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7478e1667cd24e1eb33dcbc8ac104877" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7478e1667cd24e1eb33dcbc8ac104877" member_type: VOTER } }
I20260709 13:04:01.606009 15380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:01.611569 15385 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:01.620811 15385 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:01.623059 14293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:01.633430 15385 catalog_manager.cc:1383] Generated new cluster ID: bfe033a7a26048c8b1bc48372d06ecae
I20260709 13:04:01.633898 15385 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:01.661382 15385 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:01.663029 15385 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:01.679230 15385 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Generated new TSK 0
I20260709 13:04:01.680050 15385 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:01.690516 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:01.697590 15397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:01.699018 15398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:01.701126 15400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:01.701187 14293 server_base.cc:1061] running on GCE node
I20260709 13:04:01.702432 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:01.702626 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:01.702829 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602241702808 us; error 0 us; skew 500 ppm
I20260709 13:04:01.703436 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:01.706182 14293 webserver.cc:533] Webserver started at http://127.13.245.65:39301/ using document root <none> and password file <none>
I20260709 13:04:01.706663 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:01.706837 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:01.707105 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:01.708607 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/instance:
uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
format_stamp: "Formatted at 2026-07-09 13:04:01 on dist-test-slave-fc6v"
I20260709 13:04:01.714869 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:01.718909 15405 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:01.719950 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:01.720321 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
format_stamp: "Formatted at 2026-07-09 13:04:01 on dist-test-slave-fc6v"
I20260709 13:04:01.720674 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:01.738533 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:01.740170 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:01.741991 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:01.744803 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:01.745069 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:01.745354 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:01.745565 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:01.803073 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:36757
I20260709 13:04:01.803323 15467 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:36757 every 8 connection(s)
I20260709 13:04:01.810011 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:01.818713 15472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:01.821585 15473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:01.824774 14293 server_base.cc:1061] running on GCE node
W20260709 13:04:01.824700 15475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:01.826537 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:01.826879 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:01.827118 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602241827093 us; error 0 us; skew 500 ppm
I20260709 13:04:01.827908 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:01.831457 15468 heartbeater.cc:344] Connected to a master server at 127.13.245.126:46019
I20260709 13:04:01.831526 14293 webserver.cc:533] Webserver started at http://127.13.245.66:34685/ using document root <none> and password file <none>
I20260709 13:04:01.832106 15468 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:01.832412 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:01.832674 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:01.832966 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:01.833148 15468 heartbeater.cc:507] Master 127.13.245.126:46019 requested a full tablet report, sending...
I20260709 13:04:01.834372 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/instance:
uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
format_stamp: "Formatted at 2026-07-09 13:04:01 on dist-test-slave-fc6v"
I20260709 13:04:01.836207 15341 ts_manager.cc:194] Registered new tserver with Master: 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:01.838680 15341 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50450
I20260709 13:04:01.840065 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:04:01.844373 15480 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:01.845320 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:04:01.845698 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root
uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
format_stamp: "Formatted at 2026-07-09 13:04:01 on dist-test-slave-fc6v"
I20260709 13:04:01.846062 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:01.876793 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:01.878258 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:01.880056 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:01.882750 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:01.883044 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:01.883344 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:01.883569 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:01.936864 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.66:34291
I20260709 13:04:01.937033 15542 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.66:34291 every 8 connection(s)
I20260709 13:04:01.942574 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:01.951102 15546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:01.953365 15547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:01.958310 15549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:01.958982 15543 heartbeater.cc:344] Connected to a master server at 127.13.245.126:46019
I20260709 13:04:01.959427 15543 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:01.960080 14293 server_base.cc:1061] running on GCE node
I20260709 13:04:01.960500 15543 heartbeater.cc:507] Master 127.13.245.126:46019 requested a full tablet report, sending...
I20260709 13:04:01.961269 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:01.961576 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:01.961803 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602241961755 us; error 0 us; skew 500 ppm
I20260709 13:04:01.962607 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:01.963398 15341 ts_manager.cc:194] Registered new tserver with Master: 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:01.965505 15341 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50466
I20260709 13:04:01.966039 14293 webserver.cc:533] Webserver started at http://127.13.245.67:37325/ using document root <none> and password file <none>
I20260709 13:04:01.966849 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:01.967247 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:01.967811 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:01.969475 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/instance:
uuid: "d225833a2cbf4a5995fdbbb1292d1918"
format_stamp: "Formatted at 2026-07-09 13:04:01 on dist-test-slave-fc6v"
I20260709 13:04:01.974828 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:01.979164 15554 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:01.980345 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:01.980775 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root
uuid: "d225833a2cbf4a5995fdbbb1292d1918"
format_stamp: "Formatted at 2026-07-09 13:04:01 on dist-test-slave-fc6v"
I20260709 13:04:01.981094 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:01.997449 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:01.999145 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:02.001173 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:02.004079 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:02.004374 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:02.004688 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:02.004879 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:02.057137 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.67:37005
I20260709 13:04:02.057268 15616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.67:37005 every 8 connection(s)
I20260709 13:04:02.075292 15617 heartbeater.cc:344] Connected to a master server at 127.13.245.126:46019
I20260709 13:04:02.075847 15617 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:02.076857 15617 heartbeater.cc:507] Master 127.13.245.126:46019 requested a full tablet report, sending...
I20260709 13:04:02.079684 15341 ts_manager.cc:194] Registered new tserver with Master: d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:02.079895 14293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019184345s
I20260709 13:04:02.081390 15341 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50468
I20260709 13:04:02.112818 15341 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50470:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:02.120042 15341 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:02.359838 15433 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5602b415c44c2486bba85d5cbf2ec5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:02.360150 15432 tablet_service.cc:1511] Processing CreateTablet for tablet f91e9b24450f4bc88be5be6228d8587f (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:02.361763 15432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91e9b24450f4bc88be5be6228d8587f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.362305 15431 tablet_service.cc:1511] Processing CreateTablet for tablet f87e12456fed4de1b2d723da6cc14d3a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:02.363906 15431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87e12456fed4de1b2d723da6cc14d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.367967 15430 tablet_service.cc:1511] Processing CreateTablet for tablet 894134e9e1614272b87adbf47e180cdb (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:02.368602 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5602b415c44c2486bba85d5cbf2ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.369679 15430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894134e9e1614272b87adbf47e180cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.372897 15429 tablet_service.cc:1511] Processing CreateTablet for tablet 77b747e7ea77471f95bf6fbb4eb03bab (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:02.374532 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b747e7ea77471f95bf6fbb4eb03bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.380630 15427 tablet_service.cc:1511] Processing CreateTablet for tablet ae531d3e35db41bc9f66769323b94372 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:02.382432 15427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae531d3e35db41bc9f66769323b94372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.384987 15426 tablet_service.cc:1511] Processing CreateTablet for tablet ba3252dd04824c9ca1c0b6dfd9c7c387 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:02.387959 15425 tablet_service.cc:1511] Processing CreateTablet for tablet 534703c18f76440380b33b80bf77802e (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:02.389022 15582 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5602b415c44c2486bba85d5cbf2ec5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:02.390933 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5602b415c44c2486bba85d5cbf2ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.392431 15508 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5602b415c44c2486bba85d5cbf2ec5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:02.392943 15581 tablet_service.cc:1511] Processing CreateTablet for tablet f91e9b24450f4bc88be5be6228d8587f (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:02.394065 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5602b415c44c2486bba85d5cbf2ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.394845 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91e9b24450f4bc88be5be6228d8587f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.397017 15507 tablet_service.cc:1511] Processing CreateTablet for tablet f91e9b24450f4bc88be5be6228d8587f (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:02.398576 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91e9b24450f4bc88be5be6228d8587f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.380916 15428 tablet_service.cc:1511] Processing CreateTablet for tablet 790046238f9f42cfa9d478a7ed4f2e21 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:02.403633 15580 tablet_service.cc:1511] Processing CreateTablet for tablet f87e12456fed4de1b2d723da6cc14d3a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:02.404757 15506 tablet_service.cc:1511] Processing CreateTablet for tablet f87e12456fed4de1b2d723da6cc14d3a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:02.405387 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87e12456fed4de1b2d723da6cc14d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.406224 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87e12456fed4de1b2d723da6cc14d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.410081 15505 tablet_service.cc:1511] Processing CreateTablet for tablet 894134e9e1614272b87adbf47e180cdb (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:02.413004 15504 tablet_service.cc:1511] Processing CreateTablet for tablet 77b747e7ea77471f95bf6fbb4eb03bab (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:02.413589 15424 tablet_service.cc:1511] Processing CreateTablet for tablet c098e199a9c74c79bc225b7ce9d73ff4 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:02.415679 15503 tablet_service.cc:1511] Processing CreateTablet for tablet 790046238f9f42cfa9d478a7ed4f2e21 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:02.416088 15579 tablet_service.cc:1511] Processing CreateTablet for tablet 894134e9e1614272b87adbf47e180cdb (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:02.417554 15579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894134e9e1614272b87adbf47e180cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.418813 15502 tablet_service.cc:1511] Processing CreateTablet for tablet ae531d3e35db41bc9f66769323b94372 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:02.421439 15501 tablet_service.cc:1511] Processing CreateTablet for tablet ba3252dd04824c9ca1c0b6dfd9c7c387 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:02.425258 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894134e9e1614272b87adbf47e180cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.424844 15500 tablet_service.cc:1511] Processing CreateTablet for tablet 534703c18f76440380b33b80bf77802e (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:02.426468 15500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534703c18f76440380b33b80bf77802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.427174 15502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae531d3e35db41bc9f66769323b94372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.430677 15503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790046238f9f42cfa9d478a7ed4f2e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.432050 15501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3252dd04824c9ca1c0b6dfd9c7c387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.435925 15504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b747e7ea77471f95bf6fbb4eb03bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.441780 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 77b747e7ea77471f95bf6fbb4eb03bab (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:02.443902 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b747e7ea77471f95bf6fbb4eb03bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.452207 15424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c098e199a9c74c79bc225b7ce9d73ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.455992 15425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534703c18f76440380b33b80bf77802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.458792 15426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3252dd04824c9ca1c0b6dfd9c7c387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.461299 15499 tablet_service.cc:1511] Processing CreateTablet for tablet c098e199a9c74c79bc225b7ce9d73ff4 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:02.463009 15499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c098e199a9c74c79bc225b7ce9d73ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.464017 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790046238f9f42cfa9d478a7ed4f2e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.473057 15577 tablet_service.cc:1511] Processing CreateTablet for tablet 790046238f9f42cfa9d478a7ed4f2e21 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:02.475258 15577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790046238f9f42cfa9d478a7ed4f2e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.481812 15576 tablet_service.cc:1511] Processing CreateTablet for tablet ae531d3e35db41bc9f66769323b94372 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:02.483927 15576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae531d3e35db41bc9f66769323b94372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.538131 15575 tablet_service.cc:1511] Processing CreateTablet for tablet ba3252dd04824c9ca1c0b6dfd9c7c387 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:02.544420 15575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3252dd04824c9ca1c0b6dfd9c7c387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.541157 15574 tablet_service.cc:1511] Processing CreateTablet for tablet 534703c18f76440380b33b80bf77802e (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:02.547334 15574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534703c18f76440380b33b80bf77802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.550866 15432 tablet_service.cc:1511] Processing CreateTablet for tablet 496a555ec7cc49798fc4d775f6d151ed (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:02.591872 15432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496a555ec7cc49798fc4d775f6d151ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:02.615980 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:02.659173 15573 tablet_service.cc:1511] Processing CreateTablet for tablet c098e199a9c74c79bc225b7ce9d73ff4 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:02.661612 15573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c098e199a9c74c79bc225b7ce9d73ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.691671 15632 tablet_bootstrap.cc:492] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:02.705350 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 496a555ec7cc49798fc4d775f6d151ed (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:02.709977 15633 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:02.714100 15577 tablet_service.cc:1511] Processing CreateTablet for tablet 65c950883b754dd6bb39c54f8c8134aa (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:02.716007 15500 tablet_service.cc:1511] Processing CreateTablet for tablet 496a555ec7cc49798fc4d775f6d151ed (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:02.717514 15500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496a555ec7cc49798fc4d775f6d151ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.720845 15433 tablet_service.cc:1511] Processing CreateTablet for tablet 65c950883b754dd6bb39c54f8c8134aa (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:02.753916 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c950883b754dd6bb39c54f8c8134aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.731580 15581 tablet_service.cc:1511] Processing CreateTablet for tablet 952f15e68b0745e5a8ca26a3b527cab0 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:02.730677 15501 tablet_service.cc:1511] Processing CreateTablet for tablet 65c950883b754dd6bb39c54f8c8134aa (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:02.738693 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496a555ec7cc49798fc4d775f6d151ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.753509 15427 tablet_service.cc:1511] Processing CreateTablet for tablet 952f15e68b0745e5a8ca26a3b527cab0 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:02.734241 15502 tablet_service.cc:1511] Processing CreateTablet for tablet 952f15e68b0745e5a8ca26a3b527cab0 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:02.772415 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952f15e68b0745e5a8ca26a3b527cab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.773602 15577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c950883b754dd6bb39c54f8c8134aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.774602 15580 tablet_service.cc:1511] Processing CreateTablet for tablet 653fb1b09eaf49f98c8993fbea783b3d (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:02.776090 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653fb1b09eaf49f98c8993fbea783b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.778568 15507 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8c57ead024481e8882a1b97814f799 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:02.783353 15427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952f15e68b0745e5a8ca26a3b527cab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.784320 15501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c950883b754dd6bb39c54f8c8134aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.790153 15579 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8c57ead024481e8882a1b97814f799 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:02.791714 15502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952f15e68b0745e5a8ca26a3b527cab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.792550 15634 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:02.795274 15431 tablet_service.cc:1511] Processing CreateTablet for tablet 653fb1b09eaf49f98c8993fbea783b3d (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:02.796350 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8c57ead024481e8882a1b97814f799. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:02.798820 15326 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 66009.6us
I20260709 13:04:02.805469 15505 tablet_service.cc:1511] Processing CreateTablet for tablet 07d5db06e4ec455f8b7755416957114a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:02.777464 15508 tablet_service.cc:1511] Processing CreateTablet for tablet 653fb1b09eaf49f98c8993fbea783b3d (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:02.822413 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d5db06e4ec455f8b7755416957114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.829589 15632 tablet_bootstrap.cc:654] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.836328 15582 tablet_service.cc:1511] Processing CreateTablet for tablet e3f17bb405a44393bd7aacc1097a7a13 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:02.836926 15503 tablet_service.cc:1511] Processing CreateTablet for tablet ff30e083feaf42a3aca56510e7fe367a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:02.839782 15504 tablet_service.cc:1511] Processing CreateTablet for tablet 1fdfe2cf7f6141b9b4378a2f1f915fc5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:02.842178 15468 heartbeater.cc:499] Master 127.13.245.126:46019 was elected leader, sending a full tablet report...
I20260709 13:04:02.853909 15425 tablet_service.cc:1511] Processing CreateTablet for tablet 07d5db06e4ec455f8b7755416957114a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:02.823939 15579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8c57ead024481e8882a1b97814f799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.863803 15576 tablet_service.cc:1511] Processing CreateTablet for tablet ff30e083feaf42a3aca56510e7fe367a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:02.858975 15431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653fb1b09eaf49f98c8993fbea783b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.867638 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653fb1b09eaf49f98c8993fbea783b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.882071 15429 tablet_service.cc:1511] Processing CreateTablet for tablet e3f17bb405a44393bd7aacc1097a7a13 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:02.893158 15426 tablet_service.cc:1511] Processing CreateTablet for tablet 1fdfe2cf7f6141b9b4378a2f1f915fc5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:02.893424 15430 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8c57ead024481e8882a1b97814f799 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:02.889071 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f17bb405a44393bd7aacc1097a7a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.895874 15507 tablet_service.cc:1511] Processing CreateTablet for tablet e3f17bb405a44393bd7aacc1097a7a13 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:02.898270 15504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fdfe2cf7f6141b9b4378a2f1f915fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.899305 15432 tablet_service.cc:1511] Processing CreateTablet for tablet ff30e083feaf42a3aca56510e7fe367a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:02.900000 15425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d5db06e4ec455f8b7755416957114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.901111 15432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff30e083feaf42a3aca56510e7fe367a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.902243 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f17bb405a44393bd7aacc1097a7a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.902293 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f17bb405a44393bd7aacc1097a7a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.903899 15430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8c57ead024481e8882a1b97814f799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.903899 15573 tablet_service.cc:1511] Processing CreateTablet for tablet 1fdfe2cf7f6141b9b4378a2f1f915fc5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:02.913726 15633 tablet_bootstrap.cc:654] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.917999 15503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff30e083feaf42a3aca56510e7fe367a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.896337 15428 tablet_service.cc:1511] Processing CreateTablet for tablet 327bd8cd50304a9e89be009f16906be3 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:02.923305 15426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fdfe2cf7f6141b9b4378a2f1f915fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.926636 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bd8cd50304a9e89be009f16906be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.907083 15576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff30e083feaf42a3aca56510e7fe367a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.928187 15573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fdfe2cf7f6141b9b4378a2f1f915fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.913607 15424 tablet_service.cc:1511] Processing CreateTablet for tablet 3b48413efda34be880a83df9e239fb3c (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:02.945403 15424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b48413efda34be880a83df9e239fb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.940975 15634 tablet_bootstrap.cc:654] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.959666 15433 tablet_service.cc:1511] Processing CreateTablet for tablet 423df90a9f55438bbe1c32ab906c6e10 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:02.966629 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423df90a9f55438bbe1c32ab906c6e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.969342 15581 tablet_service.cc:1511] Processing CreateTablet for tablet 3b48413efda34be880a83df9e239fb3c (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:02.962477 15427 tablet_service.cc:1511] Processing CreateTablet for tablet 4152881cdccb4731a3bd4a47c960307b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:02.969259 15543 heartbeater.cc:499] Master 127.13.245.126:46019 was elected leader, sending a full tablet report...
I20260709 13:04:02.971127 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b48413efda34be880a83df9e239fb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.948629 15499 tablet_service.cc:1511] Processing CreateTablet for tablet 327bd8cd50304a9e89be009f16906be3 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:02.972838 15499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bd8cd50304a9e89be009f16906be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.974071 15632 tablet_bootstrap.cc:492] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:02.974669 15632 ts_tablet_manager.cc:1403] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.283s	user 0.013s	sys 0.005s
I20260709 13:04:02.909961 15575 tablet_service.cc:1511] Processing CreateTablet for tablet 07d5db06e4ec455f8b7755416957114a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:02.978189 15575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d5db06e4ec455f8b7755416957114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.981959 15633 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:02.982664 15633 ts_tablet_manager.cc:1403] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.273s	user 0.016s	sys 0.012s
I20260709 13:04:02.986308 15633 raft_consensus.cc:359] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:02.979005 15632 raft_consensus.cc:359] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:03.075734 15633 raft_consensus.cc:385] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.992322 15500 tablet_service.cc:1511] Processing CreateTablet for tablet 4152881cdccb4731a3bd4a47c960307b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:03.076247 15633 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.076628 15430 tablet_service.cc:1511] Processing CreateTablet for tablet 3782fb71a4794032bbb7124248fc9b05 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:03.030012 15577 tablet_service.cc:1511] Processing CreateTablet for tablet 4152881cdccb4731a3bd4a47c960307b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:03.035790 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 75927b236d9342309d9e8c7a6a9b2f95 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:03.077319 15633 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.078243 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75927b236d9342309d9e8c7a6a9b2f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.079717 15503 tablet_service.cc:1511] Processing CreateTablet for tablet f8071c427f08433d8ffd6bd0809b1076 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:02.968770 15580 tablet_service.cc:1511] Processing CreateTablet for tablet 327bd8cd50304a9e89be009f16906be3 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:02.991034 15502 tablet_service.cc:1511] Processing CreateTablet for tablet 423df90a9f55438bbe1c32ab906c6e10 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:03.045678 15429 tablet_service.cc:1511] Processing CreateTablet for tablet 75927b236d9342309d9e8c7a6a9b2f95 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:03.047158 15634 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:03.087072 15634 ts_tablet_manager.cc:1403] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.295s	user 0.010s	sys 0.010s
I20260709 13:04:03.088894 15432 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc152f2e639487986baac02b0324f06 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:03.090620 15634 raft_consensus.cc:359] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.048709 15576 tablet_service.cc:1511] Processing CreateTablet for tablet f8071c427f08433d8ffd6bd0809b1076 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:03.058938 15579 tablet_service.cc:1511] Processing CreateTablet for tablet 3782fb71a4794032bbb7124248fc9b05 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:03.060966 15425 tablet_service.cc:1511] Processing CreateTablet for tablet f8071c427f08433d8ffd6bd0809b1076 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:03.091285 15428 tablet_service.cc:1511] Processing CreateTablet for tablet 27b4902277e34c9f97dd7889ac3f8375 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:03.067363 15504 tablet_service.cc:1511] Processing CreateTablet for tablet 3782fb71a4794032bbb7124248fc9b05 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:03.073145 15505 tablet_service.cc:1511] Processing CreateTablet for tablet 27b4902277e34c9f97dd7889ac3f8375 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:03.075050 15508 tablet_service.cc:1511] Processing CreateTablet for tablet 35e9ed1641e04cbfb3dfb6d3b9c4fd5f (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:03.075811 15632 raft_consensus.cc:385] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.096719 15632 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.097644 15632 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:02.988801 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 3b48413efda34be880a83df9e239fb3c (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:03.077101 15500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4152881cdccb4731a3bd4a47c960307b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.099527 15575 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc152f2e639487986baac02b0324f06 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:03.100483 15502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423df90a9f55438bbe1c32ab906c6e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.100855 15581 tablet_service.cc:1511] Processing CreateTablet for tablet 27b4902277e34c9f97dd7889ac3f8375 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:03.004940 15574 tablet_service.cc:1511] Processing CreateTablet for tablet 423df90a9f55438bbe1c32ab906c6e10 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:03.104653 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b48413efda34be880a83df9e239fb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.105365 15504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3782fb71a4794032bbb7124248fc9b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.110265 15431 tablet_service.cc:1511] Processing CreateTablet for tablet 66d8364b020b43deb510a118a19d076a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:03.077322 15501 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc152f2e639487986baac02b0324f06 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:03.036343 15427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4152881cdccb4731a3bd4a47c960307b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.111487 15503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8071c427f08433d8ffd6bd0809b1076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.112277 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75927b236d9342309d9e8c7a6a9b2f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.084180 15577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4152881cdccb4731a3bd4a47c960307b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.114156 15425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8071c427f08433d8ffd6bd0809b1076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.114298 15574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423df90a9f55438bbe1c32ab906c6e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.114848 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b4902277e34c9f97dd7889ac3f8375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.091418 15634 raft_consensus.cc:385] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.120806 15634 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.121755 15634 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.105239 15424 tablet_service.cc:1511] Processing CreateTablet for tablet 35e9ed1641e04cbfb3dfb6d3b9c4fd5f (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:03.065718 15507 tablet_service.cc:1511] Processing CreateTablet for tablet 75927b236d9342309d9e8c7a6a9b2f95 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:03.085002 15617 heartbeater.cc:499] Master 127.13.245.126:46019 was elected leader, sending a full tablet report...
I20260709 13:04:03.115845 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e9ed1641e04cbfb3dfb6d3b9c4fd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.119885 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bd8cd50304a9e89be009f16906be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.138839 15576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8071c427f08433d8ffd6bd0809b1076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.139632 15575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc152f2e639487986baac02b0324f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.136755 15424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e9ed1641e04cbfb3dfb6d3b9c4fd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.143443 15499 tablet_service.cc:1511] Processing CreateTablet for tablet 66d8364b020b43deb510a118a19d076a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:03.144026 15579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3782fb71a4794032bbb7124248fc9b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.144797 15430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3782fb71a4794032bbb7124248fc9b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.150864 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b4902277e34c9f97dd7889ac3f8375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.153751 15431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d8364b020b43deb510a118a19d076a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.157743 15432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc152f2e639487986baac02b0324f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.160351 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75927b236d9342309d9e8c7a6a9b2f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.161916 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b4902277e34c9f97dd7889ac3f8375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.163255 15501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc152f2e639487986baac02b0324f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.173337 15426 tablet_service.cc:1511] Processing CreateTablet for tablet a42725e017f142629708ff226f2d53e1 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:03.175105 15499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d8364b020b43deb510a118a19d076a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.192075 15426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42725e017f142629708ff226f2d53e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.193017 15633 ts_tablet_manager.cc:1434] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.210s	user 0.000s	sys 0.012s
I20260709 13:04:03.226634 15633 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:03.226783 15632 ts_tablet_manager.cc:1434] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.252s	user 0.025s	sys 0.040s
I20260709 13:04:03.233351 15433 tablet_service.cc:1511] Processing CreateTablet for tablet d40d294abeec453098d547799a79f7c5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:03.234066 15576 tablet_service.cc:1511] Processing CreateTablet for tablet 35e9ed1641e04cbfb3dfb6d3b9c4fd5f (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:03.235751 15632 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:03.237608 15576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e9ed1641e04cbfb3dfb6d3b9c4fd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.242566 15506 tablet_service.cc:1511] Processing CreateTablet for tablet a42725e017f142629708ff226f2d53e1 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:03.258190 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40d294abeec453098d547799a79f7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.262228 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 66d8364b020b43deb510a118a19d076a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:03.270223 15632 tablet_bootstrap.cc:654] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.274147 15574 tablet_service.cc:1511] Processing CreateTablet for tablet d40d294abeec453098d547799a79f7c5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:03.279403 15638 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.283270 15638 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.270223 15633 tablet_bootstrap.cc:654] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.298941 15582 tablet_service.cc:1511] Processing CreateTablet for tablet 4adf54c918c8432f819a78622c9d46bc (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:03.299275 15575 tablet_service.cc:1511] Processing CreateTablet for tablet f2b019444ffb4533ac4eb7baefd96ae7 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:03.300613 15634 ts_tablet_manager.cc:1434] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.213s	user 0.007s	sys 0.008s
I20260709 13:04:03.301291 15638 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:03.307964 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d8364b020b43deb510a118a19d076a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.321723 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42725e017f142629708ff226f2d53e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.344415 15577 tablet_service.cc:1511] Processing CreateTablet for tablet 08f534c2cc884d65b268a74636da80eb (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:03.348857 15574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40d294abeec453098d547799a79f7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.291356 15573 tablet_service.cc:1511] Processing CreateTablet for tablet a42725e017f142629708ff226f2d53e1 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:03.328994 15634 tablet_bootstrap.cc:492] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:03.369935 15500 tablet_service.cc:1511] Processing CreateTablet for tablet d40d294abeec453098d547799a79f7c5 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:03.372671 15500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40d294abeec453098d547799a79f7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.381875 15428 tablet_service.cc:1511] Processing CreateTablet for tablet f2b019444ffb4533ac4eb7baefd96ae7 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:03.383742 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b019444ffb4533ac4eb7baefd96ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.399480 15573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42725e017f142629708ff226f2d53e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.418736 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adf54c918c8432f819a78622c9d46bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.419585 15577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f534c2cc884d65b268a74636da80eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.421787 15575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b019444ffb4533ac4eb7baefd96ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.437461 15633 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:03.438158 15633 ts_tablet_manager.cc:1403] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.212s	user 0.012s	sys 0.015s
I20260709 13:04:03.454689 15580 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8042e01976403089e7b30f1a5b5740 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:03.456426 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8042e01976403089e7b30f1a5b5740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.362169 15424 tablet_service.cc:1511] Processing CreateTablet for tablet 4adf54c918c8432f819a78622c9d46bc (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:03.462715 15424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adf54c918c8432f819a78622c9d46bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.463708 15433 tablet_service.cc:1511] Processing CreateTablet for tablet 08f534c2cc884d65b268a74636da80eb (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:03.465157 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f534c2cc884d65b268a74636da80eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.468993 15429 tablet_service.cc:1511] Processing CreateTablet for tablet 0af1111c429c4e6fad608ff1eeac116b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:03.469143 15426 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8042e01976403089e7b30f1a5b5740 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:03.470520 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af1111c429c4e6fad608ff1eeac116b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.382143 15502 tablet_service.cc:1511] Processing CreateTablet for tablet 4adf54c918c8432f819a78622c9d46bc (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:03.482851 15639 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.487934 15640 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.488503 15640 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.493297 15639 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:03.494642 15633 raft_consensus.cc:359] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.497987 15577 tablet_service.cc:1511] Processing CreateTablet for tablet 0af1111c429c4e6fad608ff1eeac116b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:03.487946 15426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8042e01976403089e7b30f1a5b5740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.506006 15640 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:03.502876 15633 raft_consensus.cc:385] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.508638 15639 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:03.520942 15633 raft_consensus.cc:740] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.498946 15503 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8042e01976403089e7b30f1a5b5740 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:03.505652 15505 tablet_service.cc:1511] Processing CreateTablet for tablet 08f534c2cc884d65b268a74636da80eb (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:03.494693 15508 tablet_service.cc:1511] Processing CreateTablet for tablet 0af1111c429c4e6fad608ff1eeac116b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:03.548275 15502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adf54c918c8432f819a78622c9d46bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.540112 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:03.553272 15577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af1111c429c4e6fad608ff1eeac116b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.544637 15504 tablet_service.cc:1511] Processing CreateTablet for tablet f2b019444ffb4533ac4eb7baefd96ae7 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:03.518189 15579 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcd0644c7dd431aa808e206e7ea031e (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:03.573601 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f534c2cc884d65b268a74636da80eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.576365 15504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b019444ffb4533ac4eb7baefd96ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.578454 15499 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcd0644c7dd431aa808e206e7ea031e (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:03.581218 15499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcd0644c7dd431aa808e206e7ea031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.583151 15427 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcd0644c7dd431aa808e206e7ea031e (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:03.579358 15633 consensus_queue.cc:260] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.580581 15507 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0fd3f0f29d4b4abb27cd04e5ce1113 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:03.584681 15427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcd0644c7dd431aa808e206e7ea031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.571099 15431 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0fd3f0f29d4b4abb27cd04e5ce1113 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:03.585928 15431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0fd3f0f29d4b4abb27cd04e5ce1113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.588626 15633 ts_tablet_manager.cc:1434] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.150s	user 0.006s	sys 0.005s
I20260709 13:04:03.589924 15633 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:03.595661 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0fd3f0f29d4b4abb27cd04e5ce1113. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:03.593189 15556 leader_election.cc:343] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.603250 15632 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:03.603967 15632 ts_tablet_manager.cc:1403] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.368s	user 0.010s	sys 0.017s
I20260709 13:04:03.604059 15503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8042e01976403089e7b30f1a5b5740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.608994 15581 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0fd3f0f29d4b4abb27cd04e5ce1113 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:03.612687 15430 tablet_service.cc:1511] Processing CreateTablet for tablet 82533161d7894b3db9b0230e076936b2 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:03.620725 15576 tablet_service.cc:1511] Processing CreateTablet for tablet 82533161d7894b3db9b0230e076936b2 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:03.621675 15430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82533161d7894b3db9b0230e076936b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:03.621903 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:03.629185 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af1111c429c4e6fad608ff1eeac116b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.636974 15428 tablet_service.cc:1511] Processing CreateTablet for tablet 562c25b8842b442a928630e10d13e618 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:03.639992 15634 tablet_bootstrap.cc:654] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.645555 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562c25b8842b442a928630e10d13e618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.646520 15576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82533161d7894b3db9b0230e076936b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.649456 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0fd3f0f29d4b4abb27cd04e5ce1113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.652558 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:03.660888 15579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcd0644c7dd431aa808e206e7ea031e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:03.690021 15406 leader_election.cc:343] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.699795 15500 tablet_service.cc:1511] Processing CreateTablet for tablet 82533161d7894b3db9b0230e076936b2 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:03.702329 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:03.708894 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 562c25b8842b442a928630e10d13e618 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:03.710640 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562c25b8842b442a928630e10d13e618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.718151 15580 tablet_service.cc:1511] Processing CreateTablet for tablet 222e5d29fb564b08bdca15f666c0c986 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:03.713912 15634 tablet_bootstrap.cc:492] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:03.718081 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:03.720150 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e5d29fb564b08bdca15f666c0c986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.721036 15634 ts_tablet_manager.cc:1403] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.414s	user 0.023s	sys 0.011s
W20260709 13:04:03.720876 15407 leader_election.cc:343] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.721560 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:03.607403 15632 raft_consensus.cc:359] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.722486 15632 raft_consensus.cc:385] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.722826 15639 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.723240 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:03.724004 15518 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:03.725428 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:03.726359 15638 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.726715 15638 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.727044 15638 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.727092 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 562c25b8842b442a928630e10d13e618 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:03.728250 15500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82533161d7894b3db9b0230e076936b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.731125 15499 tablet_service.cc:1511] Processing CreateTablet for tablet 222e5d29fb564b08bdca15f666c0c986 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:03.731139 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562c25b8842b442a928630e10d13e618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.722833 15632 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.736884 15632 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.744836 15429 tablet_service.cc:1511] Processing CreateTablet for tablet 222e5d29fb564b08bdca15f666c0c986 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:03.747725 15638 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.751123 15499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e5d29fb564b08bdca15f666c0c986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.751965 15443 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:03.753294 15632 ts_tablet_manager.cc:1434] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.149s	user 0.005s	sys 0.003s
I20260709 13:04:03.754344 15634 raft_consensus.cc:359] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.761431 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:03.770133 15634 raft_consensus.cc:385] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.770591 15592 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:03.771318 15633 tablet_bootstrap.cc:654] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.772341 15638 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:03.773042 15638 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.773105 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:03.773840 15518 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.773608 15638 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.770576 15634 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.777696 15634 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.784541 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:03.785531 15634 ts_tablet_manager.cc:1434] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.062s	user 0.001s	sys 0.006s
I20260709 13:04:03.786803 15634 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:03.788931 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:03.805122 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e5d29fb564b08bdca15f666c0c986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.806802 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:03.812142 15556 leader_election.cc:343] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.814271 15638 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:03.816326 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:03.817131 15518 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:03.817739 15640 raft_consensus.cc:2764] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:04:03.818065 15555 leader_election.cc:343] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.818610 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:03.819875 15638 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.822633 15632 tablet_bootstrap.cc:492] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:03.831691 15505 tablet_service.cc:1511] Processing CreateTablet for tablet dc4f3caf80c04c18bd2d225b9e630e92 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:03.833316 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4f3caf80c04c18bd2d225b9e630e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.836720 15424 tablet_service.cc:1511] Processing CreateTablet for tablet dc4f3caf80c04c18bd2d225b9e630e92 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:03.838325 15424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4f3caf80c04c18bd2d225b9e630e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.843151 15632 tablet_bootstrap.cc:654] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.852850 15634 tablet_bootstrap.cc:654] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.856244 15579 tablet_service.cc:1511] Processing CreateTablet for tablet dc4f3caf80c04c18bd2d225b9e630e92 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:03.856627 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:03.860049 15638 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.860502 15426 tablet_service.cc:1511] Processing CreateTablet for tablet 5b97fcd3d908482fadc6fa54e513304d (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:03.860013 15579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4f3caf80c04c18bd2d225b9e630e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.861559 15638 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:03.861939 15426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b97fcd3d908482fadc6fa54e513304d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.864503 15638 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.868778 15577 tablet_service.cc:1511] Processing CreateTablet for tablet 5b97fcd3d908482fadc6fa54e513304d (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:03.871732 15577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b97fcd3d908482fadc6fa54e513304d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.875406 15427 tablet_service.cc:1511] Processing CreateTablet for tablet bb9e1d3b1096451da3fea10491454092 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:03.885869 15581 tablet_service.cc:1511] Processing CreateTablet for tablet bb9e1d3b1096451da3fea10491454092 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:03.885952 15432 tablet_service.cc:1511] Processing CreateTablet for tablet 41cabc9d5f694971847d85f82e81df84 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:03.883296 15504 tablet_service.cc:1511] Processing CreateTablet for tablet bb9e1d3b1096451da3fea10491454092 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:03.891892 15430 tablet_service.cc:1511] Processing CreateTablet for tablet a6c6411adf9842fc9281582ab8b1842c (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:03.892798 15504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9e1d3b1096451da3fea10491454092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.892681 15576 tablet_service.cc:1511] Processing CreateTablet for tablet 41cabc9d5f694971847d85f82e81df84 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:03.898687 15508 tablet_service.cc:1511] Processing CreateTablet for tablet a6c6411adf9842fc9281582ab8b1842c (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:03.899446 15432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41cabc9d5f694971847d85f82e81df84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.907790 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9e1d3b1096451da3fea10491454092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.918952 15430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c6411adf9842fc9281582ab8b1842c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.890765 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 41cabc9d5f694971847d85f82e81df84 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:03.924569 15341 catalog_manager.cc:5697] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.935686 15501 tablet_service.cc:1511] Processing CreateTablet for tablet 58702c00fb4641ec8337a916d4579ec9 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:03.938189 15633 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:03.938773 15633 ts_tablet_manager.cc:1403] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.349s	user 0.014s	sys 0.007s
I20260709 13:04:03.940456 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c6411adf9842fc9281582ab8b1842c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.942093 15633 raft_consensus.cc:359] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.942922 15633 raft_consensus.cc:385] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.943259 15633 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.944118 15633 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.944211 15502 tablet_service.cc:1511] Processing CreateTablet for tablet 9178296553b44a3f82267d1278be3746 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:03.948822 15633 ts_tablet_manager.cc:1434] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:04:03.948319 15431 tablet_service.cc:1511] Processing CreateTablet for tablet 9178296553b44a3f82267d1278be3746 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:03.951040 15580 tablet_service.cc:1511] Processing CreateTablet for tablet 58702c00fb4641ec8337a916d4579ec9 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:03.951526 15431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9178296553b44a3f82267d1278be3746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.944271 15500 tablet_service.cc:1511] Processing CreateTablet for tablet 5b97fcd3d908482fadc6fa54e513304d (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:03.952442 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58702c00fb4641ec8337a916d4579ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.948318 15429 tablet_service.cc:1511] Processing CreateTablet for tablet 58702c00fb4641ec8337a916d4579ec9 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:03.956583 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58702c00fb4641ec8337a916d4579ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.959941 15576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41cabc9d5f694971847d85f82e81df84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.960013 15427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9e1d3b1096451da3fea10491454092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.960790 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41cabc9d5f694971847d85f82e81df84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.965651 15634 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:03.966310 15634 ts_tablet_manager.cc:1403] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.180s	user 0.005s	sys 0.017s
I20260709 13:04:03.968034 15501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58702c00fb4641ec8337a916d4579ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.973227 15502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9178296553b44a3f82267d1278be3746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.974888 15577 tablet_service.cc:1511] Processing CreateTablet for tablet a6c6411adf9842fc9281582ab8b1842c (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:03.976552 15500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b97fcd3d908482fadc6fa54e513304d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.978018 15634 raft_consensus.cc:359] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:03.982244 15633 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:03.989657 15573 tablet_service.cc:1511] Processing CreateTablet for tablet 9178296553b44a3f82267d1278be3746 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:03.990093 15632 tablet_bootstrap.cc:492] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:03.992966 15632 ts_tablet_manager.cc:1403] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.171s	user 0.018s	sys 0.024s
I20260709 13:04:03.993707 15573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9178296553b44a3f82267d1278be3746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.982844 15634 raft_consensus.cc:385] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.994153 15634 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.995254 15634 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.003806 15505 tablet_service.cc:1511] Processing CreateTablet for tablet 6555b0b9d1524fdcbea2216e3e879bba (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:04.005538 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6555b0b9d1524fdcbea2216e3e879bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.007663 15634 ts_tablet_manager.cc:1434] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:04:04.009044 15634 tablet_bootstrap.cc:492] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:04.010344 15577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c6411adf9842fc9281582ab8b1842c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.011693 15426 tablet_service.cc:1511] Processing CreateTablet for tablet 6555b0b9d1524fdcbea2216e3e879bba (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:04.013744 15426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6555b0b9d1524fdcbea2216e3e879bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.015787 15633 tablet_bootstrap.cc:654] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.023115 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 6555b0b9d1524fdcbea2216e3e879bba (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:04.024739 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6555b0b9d1524fdcbea2216e3e879bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.024570 15632 raft_consensus.cc:359] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.025431 15632 raft_consensus.cc:385] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.025761 15632 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.035796 15428 tablet_service.cc:1511] Processing CreateTablet for tablet bee09de23aee40d689e3f0426ed38fc1 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:04.037386 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee09de23aee40d689e3f0426ed38fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.049090 15574 tablet_service.cc:1511] Processing CreateTablet for tablet bee09de23aee40d689e3f0426ed38fc1 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:04.051389 15574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee09de23aee40d689e3f0426ed38fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.069500 15508 tablet_service.cc:1511] Processing CreateTablet for tablet bee09de23aee40d689e3f0426ed38fc1 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:04.071116 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee09de23aee40d689e3f0426ed38fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.061676 15632 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.119508 15430 tablet_service.cc:1511] Processing CreateTablet for tablet 1915fdd81d344a749443e48f07a1fef8 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:04.121364 15430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1915fdd81d344a749443e48f07a1fef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.121074 15576 tablet_service.cc:1511] Processing CreateTablet for tablet 1915fdd81d344a749443e48f07a1fef8 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:04.127446 15576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1915fdd81d344a749443e48f07a1fef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.130658 15429 tablet_service.cc:1511] Processing CreateTablet for tablet 46abb05486504a60be4a4d104d3295f7 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:04.132193 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46abb05486504a60be4a4d104d3295f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.139453 15580 tablet_service.cc:1511] Processing CreateTablet for tablet a2e2091b55004aafb70a88703ef6fbfc (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:04.141415 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e2091b55004aafb70a88703ef6fbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.141260 15432 tablet_service.cc:1511] Processing CreateTablet for tablet a2e2091b55004aafb70a88703ef6fbfc (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:04.142630 15432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e2091b55004aafb70a88703ef6fbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.145231 15632 ts_tablet_manager.cc:1434] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.152s	user 0.009s	sys 0.000s
I20260709 13:04:04.145147 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 46abb05486504a60be4a4d104d3295f7 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:04.146584 15632 tablet_bootstrap.cc:492] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:04.146855 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46abb05486504a60be4a4d104d3295f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.148000 15640 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.148149 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 1915fdd81d344a749443e48f07a1fef8 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:04.148543 15640 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.149667 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1915fdd81d344a749443e48f07a1fef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.158074 15634 tablet_bootstrap.cc:654] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.171329 15633 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:04.172055 15633 ts_tablet_manager.cc:1403] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.222s	user 0.035s	sys 0.040s
I20260709 13:04:04.175357 15633 raft_consensus.cc:359] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.176278 15433 tablet_service.cc:1511] Processing CreateTablet for tablet f012dbeed0364c8195192ae55ff12fef (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:04.178290 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f012dbeed0364c8195192ae55ff12fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.176344 15633 raft_consensus.cc:385] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.190212 15633 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.231468 15639 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.232438 15639 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.318970 15640 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.319859 15640 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.321854 15443 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.322748 15579 tablet_service.cc:1511] Processing CreateTablet for tablet f012dbeed0364c8195192ae55ff12fef (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:04.324314 15579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f012dbeed0364c8195192ae55ff12fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.320474 15640 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.333575 15640 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.339794 15633 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.340461 15581 tablet_service.cc:1511] Processing CreateTablet for tablet 567ba2de2d424a60ae555fb26b4de59b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:04.345573 15638 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.346683 15639 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.349273 15575 tablet_service.cc:1511] Processing CreateTablet for tablet badc8a91586140ab8a3903619efbd8c9 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:04.350247 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:04.352321 15425 tablet_service.cc:1511] Processing CreateTablet for tablet badc8a91586140ab8a3903619efbd8c9 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:04.355365 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:04.370965 15406 leader_election.cc:343] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.373613 15582 tablet_service.cc:1511] Processing CreateTablet for tablet b48cca7667444b8c8bb999a280076795 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:04.376503 15425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badc8a91586140ab8a3903619efbd8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.394140 15433 tablet_service.cc:1511] Processing CreateTablet for tablet b48cca7667444b8c8bb999a280076795 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:04.396346 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:04.396867 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:04.397235 15591 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:04.398460 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567ba2de2d424a60ae555fb26b4de59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.397418 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b48cca7667444b8c8bb999a280076795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.402613 15575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badc8a91586140ab8a3903619efbd8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.404398 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b48cca7667444b8c8bb999a280076795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.396342 15426 tablet_service.cc:1511] Processing CreateTablet for tablet d8f193cb849d4553a3e9a29aa592583a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:04.409271 15426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f193cb849d4553a3e9a29aa592583a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.392531 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:04.413790 15407 leader_election.cc:343] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.414324 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:04.415629 15639 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.419785 15638 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.420554 15638 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.424268 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:04.426344 15556 leader_election.cc:343] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.390718 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:04.448536 15500 tablet_service.cc:1511] Processing CreateTablet for tablet a2e2091b55004aafb70a88703ef6fbfc (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:04.450199 15500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e2091b55004aafb70a88703ef6fbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.450364 15580 tablet_service.cc:1511] Processing CreateTablet for tablet d8f193cb849d4553a3e9a29aa592583a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:04.451953 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f193cb849d4553a3e9a29aa592583a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.440593 15638 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:04.467348 15504 tablet_service.cc:1511] Processing CreateTablet for tablet f012dbeed0364c8195192ae55ff12fef (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:04.468981 15504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f012dbeed0364c8195192ae55ff12fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.472471 15633 ts_tablet_manager.cc:1434] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.300s	user 0.007s	sys 0.025s
I20260709 13:04:04.474217 15633 tablet_bootstrap.cc:492] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:04.475760 15501 tablet_service.cc:1511] Processing CreateTablet for tablet 46abb05486504a60be4a4d104d3295f7 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:04.477886 15501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46abb05486504a60be4a4d104d3295f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.479893 15427 tablet_service.cc:1511] Processing CreateTablet for tablet 567ba2de2d424a60ae555fb26b4de59b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:04.482059 15427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567ba2de2d424a60ae555fb26b4de59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.485267 15632 tablet_bootstrap.cc:654] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.503350 15634 tablet_bootstrap.cc:492] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:04.503944 15634 ts_tablet_manager.cc:1403] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.495s	user 0.027s	sys 0.018s
I20260709 13:04:04.505460 15633 tablet_bootstrap.cc:654] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.508083 15634 raft_consensus.cc:359] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.508930 15634 raft_consensus.cc:385] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.509274 15634 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.509505 15508 tablet_service.cc:1511] Processing CreateTablet for tablet badc8a91586140ab8a3903619efbd8c9 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:04.510465 15634 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.511103 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badc8a91586140ab8a3903619efbd8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.517284 15502 tablet_service.cc:1511] Processing CreateTablet for tablet b48cca7667444b8c8bb999a280076795 (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:04.519057 15502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b48cca7667444b8c8bb999a280076795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.519851 15499 tablet_service.cc:1511] Processing CreateTablet for tablet d8f193cb849d4553a3e9a29aa592583a (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:04.521910 15638 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.523586 15634 ts_tablet_manager.cc:1434] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:04:04.530966 15634 tablet_bootstrap.cc:492] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:04.531313 15640 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.531878 15640 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.533416 15632 tablet_bootstrap.cc:492] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:04.534137 15632 ts_tablet_manager.cc:1403] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.388s	user 0.022s	sys 0.003s
I20260709 13:04:04.534165 15640 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.536336 15499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f193cb849d4553a3e9a29aa592583a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.539466 15632 raft_consensus.cc:359] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.540674 15632 raft_consensus.cc:385] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.541354 15632 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
W20260709 13:04:04.544162 15482 leader_election.cc:343] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.545075 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:04.545023 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 567ba2de2d424a60ae555fb26b4de59b (DEFAULT_TABLE table=test-workload [id=e108959ab6644de9910456c8ef215ab5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:04.558542 15640 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.559057 15640 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.559480 15640 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.560046 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567ba2de2d424a60ae555fb26b4de59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.574433 15640 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:04.588222 15482 leader_election.cc:343] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.588908 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:04.590003 15665 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:04.590420 15482 leader_election.cc:343] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.592058 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:04.584538 15632 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.601162 15632 ts_tablet_manager.cc:1434] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.066s	user 0.012s	sys 0.006s
I20260709 13:04:04.605003 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:04.605003 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:04.606860 15443 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:04.609254 15634 tablet_bootstrap.cc:654] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:04.617661 15555 leader_election.cc:343] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.620352 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:04.621248 15638 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:04.624476 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:04.628316 15640 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:04.634581 15482 leader_election.cc:343] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.635531 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:04.639889 15633 tablet_bootstrap.cc:492] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:04.640770 15633 ts_tablet_manager.cc:1403] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.167s	user 0.038s	sys 0.040s
I20260709 13:04:04.647843 15640 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.648413 15640 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.648798 15640 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.649719 15633 raft_consensus.cc:359] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.650871 15633 raft_consensus.cc:385] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.651687 15632 tablet_bootstrap.cc:492] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:04.655781 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:04.656548 15592 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.668911 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:04.670936 15482 leader_election.cc:343] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.651295 15633 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.677474 15633 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.682380 15632 tablet_bootstrap.cc:654] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.666970 15640 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.688108 15634 tablet_bootstrap.cc:492] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:04.688709 15634 ts_tablet_manager.cc:1403] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.158s	user 0.029s	sys 0.014s
I20260709 13:04:04.691963 15634 raft_consensus.cc:359] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:04.692734 15634 raft_consensus.cc:385] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.693034 15634 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.696884 15634 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:04.703022 15634 ts_tablet_manager.cc:1434] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:04:04.704722 15634 tablet_bootstrap.cc:492] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:04.710141 15640 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.711617 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:04.711980 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:04.712637 15442 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:04.716024 15482 leader_election.cc:343] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.712749 15633 ts_tablet_manager.cc:1434] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.071s	user 0.011s	sys 0.001s
I20260709 13:04:04.724385 15633 tablet_bootstrap.cc:492] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:04.724627 15592 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:04.726338 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:04.727850 15665 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.728204 15442 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:04.728490 15665 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:04.729677 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:04.729842 15665 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.732375 15640 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.733107 15640 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:04.738790 15634 tablet_bootstrap.cc:654] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.741457 15633 tablet_bootstrap.cc:654] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.734202 15640 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.750065 15632 tablet_bootstrap.cc:492] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:04.750804 15632 ts_tablet_manager.cc:1403] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.125s	user 0.003s	sys 0.013s
I20260709 13:04:04.755179 15633 tablet_bootstrap.cc:492] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:04.754941 15632 raft_consensus.cc:359] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.756204 15632 raft_consensus.cc:385] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.756649 15632 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.757176 15633 ts_tablet_manager.cc:1403] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.001s
I20260709 13:04:04.758033 15632 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.760795 15634 tablet_bootstrap.cc:492] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:04.761489 15634 ts_tablet_manager.cc:1403] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.006s
I20260709 13:04:04.765149 15634 raft_consensus.cc:359] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.766038 15634 raft_consensus.cc:385] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.763230 15633 raft_consensus.cc:359] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.766420 15634 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.766783 15633 raft_consensus.cc:385] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.767462 15633 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.767446 15634 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.769730 15633 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.770298 15634 ts_tablet_manager.cc:1434] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:04.772118 15634 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:04.772221 15632 ts_tablet_manager.cc:1434] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:04:04.771175 15340 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.776532 15632 tablet_bootstrap.cc:492] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:04.780568 15634 tablet_bootstrap.cc:654] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.784363 15632 tablet_bootstrap.cc:654] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.785249 15633 ts_tablet_manager.cc:1434] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:04:04.786538 15633 tablet_bootstrap.cc:492] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:04.795449 15633 tablet_bootstrap.cc:654] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.798422 15634 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:04.799280 15634 ts_tablet_manager.cc:1403] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.002s
I20260709 13:04:04.801203 15667 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.801849 15667 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.805147 15634 raft_consensus.cc:359] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.807325 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:04.807617 15667 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.808182 15518 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:04.808879 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:04.807498 15634 raft_consensus.cc:385] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.809700 15592 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:04.809886 15634 raft_consensus.cc:740] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.809971 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:04.811239 15667 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.810799 15634 consensus_queue.cc:260] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.811792 15667 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.812281 15667 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.813813 15634 ts_tablet_manager.cc:1434] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:04.815367 15634 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:04.820384 15633 tablet_bootstrap.cc:492] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:04.821075 15633 ts_tablet_manager.cc:1403] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 13:04:04.822986 15632 tablet_bootstrap.cc:492] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:04.823707 15632 ts_tablet_manager.cc:1403] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.012s
I20260709 13:04:04.823864 15339 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.823426 15634 tablet_bootstrap.cc:654] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.825085 15633 raft_consensus.cc:359] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:04.825970 15633 raft_consensus.cc:385] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.827752 15632 raft_consensus.cc:359] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.828976 15632 raft_consensus.cc:385] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.831118 15632 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.832259 15632 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.830323 15667 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.835222 15668 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.836174 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:04.835963 15668 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.836850 15518 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.840118 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:04.841305 15442 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:04.843472 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:04.844699 15638 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.845170 15638 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.845650 15638 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.853147 15632 ts_tablet_manager.cc:1434] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:04:04.856093 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:04.856966 15592 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.857622 15632 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:04.854578 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:04.861146 15555 leader_election.cc:343] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.855173 15667 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.855856 15518 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:04.863246 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:04.863708 15668 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:04.864401 15667 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.865238 15667 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:04.865269 15665 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.866178 15665 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:04.866565 15667 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.871176 15665 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:04.871414 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:04.871753 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:04.872439 15442 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:04.828246 15633 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.873736 15633 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:04.874123 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:04.874871 15591 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:04.875751 15665 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.876163 15665 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.876533 15665 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.876775 15633 ts_tablet_manager.cc:1434] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 13:04:04.882288 15638 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.884114 15633 tablet_bootstrap.cc:492] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:04.885308 15665 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:04.887745 15665 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:04.888813 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:04.889518 15591 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.889747 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:04.890376 15442 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.893486 15634 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:04.893687 15633 tablet_bootstrap.cc:654] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.894033 15634 ts_tablet_manager.cc:1403] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.014s
I20260709 13:04:04.896335 15638 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:04.896914 15592 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:04.897416 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:04.898053 15443 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.889689 15632 tablet_bootstrap.cc:654] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.903297 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:04.904363 15591 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:04.897185 15634 raft_consensus.cc:359] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.905282 15634 raft_consensus.cc:385] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.905591 15634 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.906414 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:04.907435 15633 tablet_bootstrap.cc:492] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:04.907368 15665 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:04.907665 15555 leader_election.cc:343] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.908215 15633 ts_tablet_manager.cc:1403] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.010s
I20260709 13:04:04.908877 15665 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:04.909891 15665 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:04.906455 15634 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.916267 15634 ts_tablet_manager.cc:1434] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:04:04.917721 15634 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:04.915302 15340 catalog_manager.cc:5697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.926281 15442 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:04.928831 15633 raft_consensus.cc:359] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.932271 15339 catalog_manager.cc:5697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.933705 15634 tablet_bootstrap.cc:654] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.933800 15633 raft_consensus.cc:385] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.934425 15633 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.935518 15665 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.936081 15665 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.935767 15633 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.940750 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:04.941547 15591 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:04.943482 15665 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.944725 15633 ts_tablet_manager.cc:1434] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:04:04.945412 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:04.945995 15633 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
W20260709 13:04:04.946846 15482 leader_election.cc:343] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.950553 15632 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:04.951207 15632 ts_tablet_manager.cc:1403] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.035s
I20260709 13:04:04.952579 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:04.953565 15633 tablet_bootstrap.cc:654] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.953977 15665 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.954373 15665 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.954823 15665 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.954692 15632 raft_consensus.cc:359] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.955675 15632 raft_consensus.cc:385] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.956010 15632 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.957525 15632 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.966822 15632 ts_tablet_manager.cc:1434] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.004s
I20260709 13:04:04.968135 15632 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:04.970027 15443 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:04.971674 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:04.972843 15638 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.973604 15638 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:04.974860 15638 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.984575 15632 tablet_bootstrap.cc:654] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.986874 15633 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:04.987461 15633 ts_tablet_manager.cc:1403] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.011s
I20260709 13:04:04.990911 15633 raft_consensus.cc:359] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.991532 15633 raft_consensus.cc:385] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.991847 15633 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.992148 15634 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:04.992702 15634 ts_tablet_manager.cc:1403] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.004s
I20260709 13:04:04.992753 15633 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.994092 15665 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.994130 15339 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.995460 15633 ts_tablet_manager.cc:1434] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:04.996676 15665 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:04.997881 15632 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:04.998374 15633 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:04.998312 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:04.999019 15591 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.999006 15634 raft_consensus.cc:359] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.999799 15634 raft_consensus.cc:385] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.000090 15634 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.000504 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:05.000963 15634 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:04.998394 15632 ts_tablet_manager.cc:1403] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.001s
I20260709 13:04:05.003638 15634 ts_tablet_manager.cc:1434] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:05.004948 15632 raft_consensus.cc:359] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.005791 15632 raft_consensus.cc:385] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.006111 15632 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.007169 15634 tablet_bootstrap.cc:492] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:05.006852 15632 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:05.008172 15482 leader_election.cc:343] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.008455 15591 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:05.010167 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:05.011798 15665 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.012113 15633 tablet_bootstrap.cc:654] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.012954 15665 raft_consensus.cc:697] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:05.014519 15634 tablet_bootstrap.cc:654] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.014101 15665 consensus_queue.cc:237] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.014794 15632 ts_tablet_manager.cc:1434] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:04:05.017282 15632 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:05.031682 15632 tablet_bootstrap.cc:654] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.045400 15632 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:05.045998 15632 ts_tablet_manager.cc:1403] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.002s
I20260709 13:04:05.052986 15632 raft_consensus.cc:359] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.053889 15632 raft_consensus.cc:385] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.054211 15632 raft_consensus.cc:740] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.054956 15632 consensus_queue.cc:260] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.057344 15632 ts_tablet_manager.cc:1434] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 13:04:05.058882 15632 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:05.065721 15632 tablet_bootstrap.cc:654] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.079356 15339 catalog_manager.cc:5697] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.087489 15633 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:05.088153 15633 ts_tablet_manager.cc:1403] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.090s	user 0.039s	sys 0.027s
I20260709 13:04:05.088469 15634 tablet_bootstrap.cc:492] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:05.089309 15634 ts_tablet_manager.cc:1403] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.085s	user 0.041s	sys 0.029s
I20260709 13:04:05.090873 15633 raft_consensus.cc:359] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.091434 15633 raft_consensus.cc:385] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.091738 15633 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.092514 15633 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.093714 15634 raft_consensus.cc:359] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.094501 15634 raft_consensus.cc:385] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.094556 15633 ts_tablet_manager.cc:1434] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:05.094913 15634 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.095809 15634 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.096338 15633 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:05.098277 15634 ts_tablet_manager.cc:1434] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:05.099279 15634 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:05.103983 15633 tablet_bootstrap.cc:654] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.105471 15634 tablet_bootstrap.cc:654] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.111236 15634 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:05.111933 15634 ts_tablet_manager.cc:1403] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.007s
I20260709 13:04:05.115022 15634 raft_consensus.cc:359] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.115788 15634 raft_consensus.cc:385] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.116173 15634 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.116844 15632 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:05.117377 15632 ts_tablet_manager.cc:1403] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.018s
I20260709 13:04:05.117512 15634 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.120231 15632 raft_consensus.cc:359] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.121124 15632 raft_consensus.cc:385] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.121461 15632 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.122246 15632 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.123353 15633 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:05.124162 15633 ts_tablet_manager.cc:1403] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.019s
I20260709 13:04:05.124480 15632 ts_tablet_manager.cc:1434] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:05.119993 15634 ts_tablet_manager.cc:1434] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:05.125775 15634 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:05.127131 15633 raft_consensus.cc:359] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.127925 15633 raft_consensus.cc:385] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.128206 15633 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.129089 15633 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.130155 15665 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.130666 15665 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.133018 15665 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.133766 15634 tablet_bootstrap.cc:654] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.133829 15632 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:05.136018 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.136330 15633 ts_tablet_manager.cc:1434] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:04:05.136821 15591 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:05.137449 15633 tablet_bootstrap.cc:492] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:05.137876 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:05.139763 15482 leader_election.cc:343] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.140556 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:05.141921 15665 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.142318 15665 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.142664 15665 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.143721 15632 tablet_bootstrap.cc:654] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.149472 15633 tablet_bootstrap.cc:654] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.151721 15665 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.156080 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:05.159086 15482 leader_election.cc:343] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.162273 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:05.163261 15591 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.171751 15665 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.173069 15633 tablet_bootstrap.cc:492] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:05.173933 15633 ts_tablet_manager.cc:1403] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.013s
I20260709 13:04:05.177100 15633 raft_consensus.cc:359] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.177826 15633 raft_consensus.cc:385] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.178143 15633 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.178105 15591 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:05.179312 15633 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.180426 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:05.181366 15665 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.181981 15633 ts_tablet_manager.cc:1434] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:05.182751 15632 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:05.182675 15665 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:05.183300 15632 ts_tablet_manager.cc:1403] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.008s
I20260709 13:04:05.184028 15665 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.185423 15591 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.186451 15632 raft_consensus.cc:359] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.187255 15632 raft_consensus.cc:385] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.187531 15632 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.187707 15633 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:05.191048 15634 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:05.191809 15634 ts_tablet_manager.cc:1403] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.010s
I20260709 13:04:05.194980 15633 tablet_bootstrap.cc:654] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.196126 15634 raft_consensus.cc:359] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.197129 15634 raft_consensus.cc:385] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.197484 15634 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.198534 15634 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.188603 15632 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.209560 15667 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.210368 15667 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.213991 15633 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:05.214579 15633 ts_tablet_manager.cc:1403] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.007s
I20260709 13:04:05.214471 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:05.216285 15406 leader_election.cc:343] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.217774 15633 raft_consensus.cc:359] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.218400 15633 raft_consensus.cc:385] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.218443 15667 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.218780 15633 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.218895 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.219969 15633 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.220176 15640 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.222558 15633 ts_tablet_manager.cc:1434] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:05.222168 15591 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:05.224167 15633 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:05.220181 15634 ts_tablet_manager.cc:1434] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:04:05.224895 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:05.225919 15634 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:05.227155 15339 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.232734 15633 tablet_bootstrap.cc:654] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.233289 15667 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.233866 15667 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.234191 15634 tablet_bootstrap.cc:654] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.234318 15667 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.240752 15632 ts_tablet_manager.cc:1434] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:04:05.242120 15632 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:05.251293 15639 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.251976 15639 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.254455 15639 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.256217 15667 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.257262 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.259733 15591 raft_consensus.cc:2393] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:05.261153 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.268626 15634 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:05.269351 15634 ts_tablet_manager.cc:1403] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.018s
I20260709 13:04:05.270465 15633 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:05.270879 15633 ts_tablet_manager.cc:1403] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.004s
I20260709 13:04:05.262100 15639 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.271809 15639 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.274048 15406 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:05.275650 15667 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.277822 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:05.278548 15667 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.278713 15592 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.282069 15634 raft_consensus.cc:359] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.283048 15634 raft_consensus.cc:385] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.283563 15634 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.284125 15632 tablet_bootstrap.cc:654] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.288383 15634 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.290668 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:05.293493 15517 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.291465 15633 raft_consensus.cc:359] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.294014 15633 raft_consensus.cc:385] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.294392 15633 raft_consensus.cc:740] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.295820 15633 consensus_queue.cc:260] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.298416 15634 ts_tablet_manager.cc:1434] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:04:05.299966 15634 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:05.298274 15633 ts_tablet_manager.cc:1434] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:04:05.301751 15633 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:05.301549 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.303110 15518 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:05.317040 15406 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:05.319521 15711 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.319912 15639 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.320081 15711 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.320679 15711 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.321333 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.323509 15590 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:05.327344 15443 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.324339 15640 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:05.334488 15592 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:05.338963 15633 tablet_bootstrap.cc:654] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.340888 15667 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.344070 15632 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:05.344692 15632 ts_tablet_manager.cc:1403] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.103s	user 0.015s	sys 0.000s
I20260709 13:04:05.345312 15634 tablet_bootstrap.cc:654] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.345352 15638 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.346619 15638 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.345316 15711 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.349911 15638 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:05.350217 15711 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.385793 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:05.395121 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:05.417050 15517 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:05.418167 15518 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.398641 15640 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.403700 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:05.404651 15665 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.407313 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:05.412097 15633 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:05.411580 15711 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.418232 15638 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.424203 15638 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.425645 15633 ts_tablet_manager.cc:1403] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.001s
I20260709 13:04:05.396181 15632 raft_consensus.cc:359] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.427769 15632 raft_consensus.cc:385] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.428164 15632 raft_consensus.cc:740] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.428994 15667 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.429219 15632 consensus_queue.cc:260] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.429767 15667 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.420537 15639 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.426743 15665 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.436226 15591 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.441177 15720 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.442216 15720 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.466233 15638 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:05.448678 15640 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.481890 15633 raft_consensus.cc:359] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.484215 15633 raft_consensus.cc:385] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.484570 15633 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.469728 15639 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:05.489218 15634 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:05.490710 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:05.499071 15721 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.501367 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.486310 15711 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.510015 15721 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.504163 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.507292 15634 ts_tablet_manager.cc:1403] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.208s	user 0.018s	sys 0.002s
W20260709 13:04:05.486274 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47097.7us
I20260709 13:04:05.510241 15711 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.500419 15633 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.506057 15632 ts_tablet_manager.cc:1434] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.161s	user 0.016s	sys 0.024s
I20260709 13:04:05.516633 15638 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.516782 15720 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.510885 15518 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:05.521281 15723 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:05.521092 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.526116 15721 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.502280 15667 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.531489 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.531997 15665 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:05.510910 15556 leader_election.cc:343] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.511044 15640 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.528402 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.523906 15517 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:05.521011 15638 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.536015 15591 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:05.529273 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.527066 15406 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:05.532557 15590 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
W20260709 13:04:05.533299 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52821.2us
I20260709 13:04:05.539928 15721 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.545581 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.537652 15638 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:05.541410 15711 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.552265 15515 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:05.555455 15667 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.556371 15667 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:05.557437 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:05.558285 15633 ts_tablet_manager.cc:1434] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.132s	user 0.018s	sys 0.005s
I20260709 13:04:05.559966 15721 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.540580 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:05.561861 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:05.562983 15441 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:04:05.563874 15556 leader_election.cc:343] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.564386 15723 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.564841 15723 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.565244 15723 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.567569 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.570503 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:05.557679 15667 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.569180 15640 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:05.571065 15555 leader_election.cc:343] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.574345 15555 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:05.574958 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.574172 15442 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:05.577674 15638 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.577828 15556 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:05.578431 15721 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.578890 15638 raft_consensus.cc:2804] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.579418 15638 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.580068 15638 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.580792 15633 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:05.579340 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:05.584848 15711 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.590418 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.594767 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:05.590415 15591 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:05.602468 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.603502 15590 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:05.589506 15719 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.078s
I20260709 13:04:05.636806 15723 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.641724 15632 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:05.641753 15634 raft_consensus.cc:359] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.643697 15634 raft_consensus.cc:385] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.644201 15634 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.645054 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.647928 15442 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:05.648196 15590 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:05.648102 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:05.650417 15722 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.651758 15727 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.650687 15634 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.652432 15727 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:05.660807 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:05.661590 15638 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.665201 15633 tablet_bootstrap.cc:654] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.676437 15638 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:05.677009 15722 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.672314 15727 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:05.677958 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:05.679608 15441 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.637718 15639 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.698108 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:05.699997 15556 leader_election.cc:343] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:05.701529 15482 leader_election.cc:343] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.701138 15719 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.705710 15634 ts_tablet_manager.cc:1434] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.185s	user 0.008s	sys 0.001s
I20260709 13:04:05.696491 15728 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:05.710448 15723 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.708372 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:05.711958 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:05.713058 15515 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.713711 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:05.714344 15590 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:05.720088 15555 leader_election.cc:343] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.721535 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:05.722544 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:05.727308 15727 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.727810 15727 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.727695 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:05.728305 15727 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.735351 15725 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.735960 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:05.737483 15634 tablet_bootstrap.cc:492] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:05.750409 15590 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:05.742272 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:05.755153 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:05.755455 15482 leader_election.cc:343] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.756361 15639 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.756585 15640 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.759797 15639 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:05.758765 15665 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.759449 15640 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.763224 15640 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.764319 15639 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.773403 15665 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.775153 15725 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.783987 15633 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:05.784783 15633 ts_tablet_manager.cc:1403] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.225s	user 0.009s	sys 0.022s
I20260709 13:04:05.786352 15665 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.792215 15633 raft_consensus.cc:359] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.794113 15441 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:05.794481 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:05.795174 15518 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:05.796495 15633 raft_consensus.cc:385] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.796820 15633 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.797627 15556 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:05.797535 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:05.800084 15728 raft_consensus.cc:2804] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.809672 15632 tablet_bootstrap.cc:654] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.814036 15633 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.820665 15633 ts_tablet_manager.cc:1434] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.008s
I20260709 13:04:05.823336 15728 raft_consensus.cc:697] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:05.827370 15728 consensus_queue.cc:237] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.811470 15640 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.831489 15633 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:05.833814 15640 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:05.833398 15727 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.824616 15341 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.838685 15341 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.843019 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:05.844612 15727 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:05.851285 15742 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:04:05.856069 15556 leader_election.cc:343] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.865168 15633 tablet_bootstrap.cc:654] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.852341 15515 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
W20260709 13:04:05.860111 15482 leader_election.cc:343] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.866106 15719 raft_consensus.cc:2764] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:05.872740 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:05.876376 15665 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.877807 15725 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.878047 15640 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.879949 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:04:05.884387 15555 leader_election.cc:343] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.880952 15727 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.886648 15632 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:05.887127 15632 ts_tablet_manager.cc:1403] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.256s	user 0.018s	sys 0.012s
I20260709 13:04:05.885962 15727 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.888206 15727 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.900214 15634 tablet_bootstrap.cc:654] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.902820 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:05.904214 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:05.908774 15632 raft_consensus.cc:359] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.909626 15632 raft_consensus.cc:385] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.909947 15632 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.905530 15592 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:05.911125 15632 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.940848 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:05.938917 15727 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:05.943812 15515 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:05.949179 15727 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:05.950647 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:05.954833 15482 leader_election.cc:343] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:05.956565 15556 leader_election.cc:343] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.957645 15632 ts_tablet_manager.cc:1434] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.070s	user 0.022s	sys 0.008s
I20260709 13:04:05.968451 15633 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:05.969463 15633 ts_tablet_manager.cc:1403] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.138s	user 0.013s	sys 0.013s
I20260709 13:04:05.974045 15632 tablet_bootstrap.cc:492] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:05.982277 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:05.998237 15665 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.001997 15639 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.006623 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:06.007720 15727 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.016045 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:06.017464 15515 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.018278 15634 tablet_bootstrap.cc:492] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:06.018823 15634 ts_tablet_manager.cc:1403] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.311s	user 0.017s	sys 0.047s
I20260709 13:04:06.022883 15633 raft_consensus.cc:359] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.024251 15633 raft_consensus.cc:385] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.024474 15633 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.024966 15633 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.031085 15633 ts_tablet_manager.cc:1434] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:04:06.034721 15633 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.039700 15634 raft_consensus.cc:359] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.040607 15634 raft_consensus.cc:385] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.040943 15634 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.041343 15515 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:06.041689 15634 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.043697 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:06.045024 15727 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.045589 15727 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:06.046507 15632 tablet_bootstrap.cc:654] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.046547 15727 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.052275 15634 ts_tablet_manager.cc:1434] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:04:06.053591 15634 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:06.054968 15633 tablet_bootstrap.cc:654] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.074455 15634 tablet_bootstrap.cc:654] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.081133 15722 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.087791 15757 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.088440 15757 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.091018 15757 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.092470 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:06.094633 15482 leader_election.cc:343] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.095870 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:06.097714 15482 leader_election.cc:343] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.098323 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:06.100140 15757 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.103073 15633 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.103953 15633 ts_tablet_manager.cc:1403] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.024s
I20260709 13:04:06.106721 15632 tablet_bootstrap.cc:492] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:06.108914 15632 ts_tablet_manager.cc:1403] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.135s	user 0.022s	sys 0.000s
I20260709 13:04:06.107303 15633 raft_consensus.cc:359] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.110503 15633 raft_consensus.cc:385] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.112677 15633 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.114696 15633 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.116422 15632 raft_consensus.cc:359] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.116925 15633 ts_tablet_manager.cc:1434] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:04:06.117247 15632 raft_consensus.cc:385] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.117584 15632 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.118184 15633 tablet_bootstrap.cc:492] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.118497 15632 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.121462 15632 ts_tablet_manager.cc:1434] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:04:06.121675 15727 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.122213 15727 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.122738 15634 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:06.122810 15632 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:06.123313 15634 ts_tablet_manager.cc:1403] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.011s
I20260709 13:04:06.123967 15742 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.124673 15742 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.126688 15634 raft_consensus.cc:359] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.127710 15727 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.127491 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.127491 15634 raft_consensus.cc:385] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.129451 15634 raft_consensus.cc:740] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
W20260709 13:04:06.131177 15556 leader_election.cc:343] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.131605 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.132527 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.133316 15633 tablet_bootstrap.cc:654] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.133424 15556 leader_election.cc:343] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.133502 15515 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:06.130466 15634 consensus_queue.cc:260] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.135282 15742 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.135439 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:06.138612 15742 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.138504 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.139354 15742 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.139968 15742 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:06.140673 15555 leader_election.cc:343] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.141443 15555 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:06.142578 15727 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.148144 15633 tablet_bootstrap.cc:492] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.148895 15633 ts_tablet_manager.cc:1403] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.009s
I20260709 13:04:06.149169 15634 ts_tablet_manager.cc:1434] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 13:04:06.150652 15634 tablet_bootstrap.cc:492] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:06.150812 15632 tablet_bootstrap.cc:654] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.153265 15633 raft_consensus.cc:359] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.154361 15633 raft_consensus.cc:385] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.154783 15633 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.155886 15633 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.158921 15633 ts_tablet_manager.cc:1434] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:06.160262 15633 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.161060 15632 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:06.161638 15632 ts_tablet_manager.cc:1403] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.002s
I20260709 13:04:06.161844 15742 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.165688 15757 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.166373 15757 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.167785 15634 tablet_bootstrap.cc:654] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.167793 15633 tablet_bootstrap.cc:654] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.168740 15757 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.165640 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:06.164938 15632 raft_consensus.cc:359] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.170440 15340 catalog_manager.cc:5697] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.171604 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.174152 15443 raft_consensus.cc:2393] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:06.172380 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:06.176247 15556 leader_election.cc:343] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.179280 15632 raft_consensus.cc:385] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.179728 15632 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.179828 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:06.180576 15632 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.181986 15756 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.184002 15632 ts_tablet_manager.cc:1434] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.005s
I20260709 13:04:06.185598 15632 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:06.192325 15742 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.198846 15634 tablet_bootstrap.cc:492] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:06.202387 15634 ts_tablet_manager.cc:1403] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.006s
I20260709 13:04:06.202273 15722 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.208060 15634 raft_consensus.cc:359] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.208904 15634 raft_consensus.cc:385] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.209237 15634 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.209990 15634 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.199196 15633 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.200500 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:06.211797 15514 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.212414 15634 ts_tablet_manager.cc:1434] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:06.213718 15634 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:06.217553 15756 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.220510 15514 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:06.220881 15632 tablet_bootstrap.cc:654] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.220969 15634 tablet_bootstrap.cc:654] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.222115 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:06.223081 15742 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.225728 15633 ts_tablet_manager.cc:1403] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.066s	user 0.004s	sys 0.028s
I20260709 13:04:06.226294 15742 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:06.227698 15742 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.233172 15633 raft_consensus.cc:359] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.234102 15633 raft_consensus.cc:385] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.234411 15633 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.235190 15633 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.235996 15711 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.238071 15633 ts_tablet_manager.cc:1434] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:04:06.240015 15633 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.237429 15341 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.247125 15633 tablet_bootstrap.cc:654] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.252018 15728 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.252905 15728 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.270310 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.263110 15727 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.271487 15443 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:06.272367 15727 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.278237 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.278725 15728 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:06.280611 15555 leader_election.cc:343] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.281364 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.282416 15517 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:06.288249 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:06.291579 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:06.295194 15556 leader_election.cc:343] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.295858 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:06.296773 15638 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.297188 15638 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.297554 15638 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.297844 15728 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.281697 15727 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.305595 15728 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.306924 15339 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.318711 15638 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.321959 15638 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.323037 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:06.323907 15443 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.325958 15633 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.326713 15633 ts_tablet_manager.cc:1403] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.030s
I20260709 13:04:06.329488 15634 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:06.330097 15634 ts_tablet_manager.cc:1403] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.117s	user 0.037s	sys 0.040s
I20260709 13:04:06.331442 15722 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.333312 15634 raft_consensus.cc:359] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.334117 15634 raft_consensus.cc:385] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.334455 15634 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.333844 15722 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.335435 15638 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.352429 15634 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.336601 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:06.336130 15722 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.357801 15638 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.363981 15634 ts_tablet_manager.cc:1434] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.003s
I20260709 13:04:06.365693 15638 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.360775 15517 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.367372 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.375839 15634 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:06.372285 15756 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.367648 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.379005 15756 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.381747 15756 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.382126 15722 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.378436 15442 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:06.391700 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.392077 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:06.392482 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:06.392719 15515 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:06.392758 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.393637 15723 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:06.394837 15555 leader_election.cc:343] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.373821 15443 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
W20260709 13:04:06.396168 15482 leader_election.cc:343] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.397600 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:06.398726 15742 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.398769 15638 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.399326 15633 raft_consensus.cc:359] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.399184 15742 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.400118 15633 raft_consensus.cc:385] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.400210 15742 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.400516 15633 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.403050 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:06.403971 15589 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:04:06.407805 15482 leader_election.cc:343] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.410785 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:06.404047 15638 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:06.414316 15407 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:06.415661 15756 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.416255 15723 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.405320 15633 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.422842 15633 ts_tablet_manager.cc:1434] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 13:04:06.403851 15517 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:06.419597 15638 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.445086 15742 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.449774 15728 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.460888 15742 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.467985 15339 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.472007 15633 tablet_bootstrap.cc:492] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.488163 15632 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:06.488667 15632 ts_tablet_manager.cc:1403] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.303s	user 0.024s	sys 0.013s
I20260709 13:04:06.496826 15723 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.490056 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:06.496367 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:06.502599 15555 leader_election.cc:343] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.507905 15633 tablet_bootstrap.cc:654] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.510082 15634 tablet_bootstrap.cc:654] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.511287 15756 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.508977 15443 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.511979 15756 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.519968 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.519701 15632 raft_consensus.cc:359] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.520512 15632 raft_consensus.cc:385] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.520780 15632 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.524319 15756 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:06.525068 15482 leader_election.cc:343] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.526602 15632 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.529896 15632 ts_tablet_manager.cc:1434] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 13:04:06.531965 15632 tablet_bootstrap.cc:492] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:06.533465 15723 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.535594 15443 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:06.536113 15723 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.537384 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:06.539353 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.539674 15779 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.540433 15779 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:04:06.541369 15406 leader_election.cc:343] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.541486 15779 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.539776 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:06.548625 15589 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:06.556275 15728 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.543622 15723 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.560680 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:06.561928 15723 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.562315 15723 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.562704 15723 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:06.564827 15556 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:06.564915 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:06.570151 15590 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:06.572297 15634 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:06.572858 15634 ts_tablet_manager.cc:1403] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.208s	user 0.022s	sys 0.023s
I20260709 13:04:06.572326 15728 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.573401 15728 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.576572 15728 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.577924 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.570616 15633 tablet_bootstrap.cc:492] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.579519 15633 ts_tablet_manager.cc:1403] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.118s	user 0.024s	sys 0.021s
W20260709 13:04:06.580293 15556 leader_election.cc:343] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.580178 15634 raft_consensus.cc:359] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.581027 15634 raft_consensus.cc:385] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.581414 15634 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.585282 15341 catalog_manager.cc:5697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.582327 15634 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.589985 15633 raft_consensus.cc:359] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.590883 15633 raft_consensus.cc:385] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.591189 15633 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.591812 15634 ts_tablet_manager.cc:1434] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:06.592095 15633 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.592952 15634 tablet_bootstrap.cc:492] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:06.594563 15633 ts_tablet_manager.cc:1434] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:06.595602 15633 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.596474 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:06.597693 15665 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.598079 15665 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.598429 15665 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.601270 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:06.605259 15555 leader_election.cc:343] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.605875 15555 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:06.606817 15779 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.613106 15632 tablet_bootstrap.cc:654] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.613965 15633 tablet_bootstrap.cc:654] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.615906 15634 tablet_bootstrap.cc:654] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.622603 15665 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.638859 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:06.642077 15482 leader_election.cc:343] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.646339 15633 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.632580 15341 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.646953 15633 ts_tablet_manager.cc:1403] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.013s
I20260709 13:04:06.586686 15723 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.650476 15723 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.651803 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:06.652801 15590 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.653360 15665 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.654009 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:06.654668 15592 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.657172 15633 raft_consensus.cc:359] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.657760 15633 raft_consensus.cc:385] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.658005 15633 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.658783 15633 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.660534 15633 ts_tablet_manager.cc:1434] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 13:04:06.661600 15633 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.661901 15590 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:06.663157 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:06.663213 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:06.664584 15592 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
W20260709 13:04:06.664963 15406 leader_election.cc:343] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.667598 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:06.668325 15633 tablet_bootstrap.cc:654] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.674314 15723 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.674925 15723 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:06.675906 15723 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.677152 15634 tablet_bootstrap.cc:492] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:06.678390 15634 ts_tablet_manager.cc:1403] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.024s
I20260709 13:04:06.668597 15665 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.682368 15634 raft_consensus.cc:359] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.683089 15665 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:06.683468 15634 raft_consensus.cc:385] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.684167 15634 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.685421 15634 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.686756 15632 tablet_bootstrap.cc:492] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:06.687319 15632 ts_tablet_manager.cc:1403] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.156s	user 0.016s	sys 0.009s
I20260709 13:04:06.689301 15634 ts_tablet_manager.cc:1434] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:04:06.691120 15634 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:06.693464 15665 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.690783 15632 raft_consensus.cc:359] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.697546 15632 raft_consensus.cc:385] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.697916 15632 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.698813 15632 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.701804 15632 ts_tablet_manager.cc:1434] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:06.703059 15632 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:06.706328 15634 tablet_bootstrap.cc:654] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.717072 15632 tablet_bootstrap.cc:654] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.732779 15728 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:06.733402 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:06.733418 15728 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.734357 15633 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.734889 15633 ts_tablet_manager.cc:1403] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.023s
I20260709 13:04:06.737742 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.738585 15517 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:06.741056 15632 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:06.741612 15632 ts_tablet_manager.cc:1403] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 13:04:06.741963 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:06.742951 15728 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.742965 15727 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.743570 15727 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.743976 15727 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.745131 15632 raft_consensus.cc:359] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.745913 15632 raft_consensus.cc:385] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.746215 15632 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.746323 15341 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.746344 15634 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:06.747210 15632 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.748799 15634 ts_tablet_manager.cc:1403] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.017s
I20260709 13:04:06.738621 15633 raft_consensus.cc:359] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.750974 15633 raft_consensus.cc:385] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.751312 15633 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.740939 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.752233 15633 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.753980 15633 ts_tablet_manager.cc:1434] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:04:06.754088 15634 raft_consensus.cc:359] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.755002 15634 raft_consensus.cc:385] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.755220 15633 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.755360 15634 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.756731 15632 ts_tablet_manager.cc:1434] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
W20260709 13:04:06.756608 15556 leader_election.cc:343] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.756444 15634 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.758469 15632 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:06.759078 15634 ts_tablet_manager.cc:1434] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:06.760268 15634 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:06.763444 15727 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.766058 15727 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.767473 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:06.768265 15517 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.769940 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:06.771782 15556 leader_election.cc:343] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.773109 15633 tablet_bootstrap.cc:654] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.776576 15632 tablet_bootstrap.cc:654] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.777148 15339 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.779657 15517 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:06.782430 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:06.780908 15634 tablet_bootstrap.cc:654] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.784634 15728 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.785218 15728 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:06.786106 15728 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.795890 15633 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.796487 15633 ts_tablet_manager.cc:1403] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.002s
I20260709 13:04:06.797317 15632 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:06.797618 15443 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.800911 15633 raft_consensus.cc:359] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.801774 15633 raft_consensus.cc:385] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.802028 15633 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.802790 15633 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.805685 15633 ts_tablet_manager.cc:1434] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:06.806866 15633 tablet_bootstrap.cc:492] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.797868 15632 ts_tablet_manager.cc:1403] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.013s
I20260709 13:04:06.810716 15638 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.814734 15633 tablet_bootstrap.cc:654] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.816499 15632 raft_consensus.cc:359] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.817485 15632 raft_consensus.cc:385] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.817951 15632 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.819391 15632 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.823282 15632 ts_tablet_manager.cc:1434] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:06.825726 15632 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:06.836529 15723 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.837208 15723 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.836644 15339 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.839193 15632 tablet_bootstrap.cc:654] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.840530 15633 tablet_bootstrap.cc:492] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.840756 15723 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.841346 15633 ts_tablet_manager.cc:1403] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.016s
I20260709 13:04:06.841602 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:06.842536 15779 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.841691 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.845036 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:06.845767 15665 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.846264 15665 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.847139 15633 raft_consensus.cc:359] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.848246 15633 raft_consensus.cc:385] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.848448 15665 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.848662 15633 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.849169 15723 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.849997 15633 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.853279 15633 ts_tablet_manager.cc:1434] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:06.854885 15633 tablet_bootstrap.cc:492] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.856237 15742 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.856766 15742 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.862758 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.863795 15633 tablet_bootstrap.cc:654] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.868947 15556 leader_election.cc:343] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.871901 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:06.872787 15590 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:06.874038 15633 tablet_bootstrap.cc:492] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:06.874236 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:06.874667 15633 ts_tablet_manager.cc:1403] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:04:06.875206 15632 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:06.875345 15665 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.875875 15665 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.876230 15665 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.877743 15633 raft_consensus.cc:359] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.878523 15633 raft_consensus.cc:385] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.878809 15633 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.879478 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.881513 15441 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:06.884459 15665 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.876214 15632 ts_tablet_manager.cc:1403] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.022s
I20260709 13:04:06.894352 15665 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:06.895234 15638 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.895017 15632 raft_consensus.cc:359] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.895797 15632 raft_consensus.cc:385] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.896148 15632 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.896827 15632 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.897356 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:06.897996 15590 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.898972 15632 ts_tablet_manager.cc:1434] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:06.895738 15638 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.896718 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:06.900137 15440 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.901857 15638 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.902746 15632 tablet_bootstrap.cc:492] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:06.902526 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:06.905150 15634 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:06.905710 15634 ts_tablet_manager.cc:1403] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.005s
W20260709 13:04:06.906616 15556 leader_election.cc:343] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.909162 15634 raft_consensus.cc:359] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.909996 15634 raft_consensus.cc:385] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.879642 15633 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.912341 15633 ts_tablet_manager.cc:1434] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.003s
I20260709 13:04:06.910319 15634 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.910465 15632 tablet_bootstrap.cc:654] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.912757 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.918704 15634 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.919739 15515 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:06.910223 15742 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:06.913151 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:06.921242 15634 ts_tablet_manager.cc:1434] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:06.922364 15634 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:06.924484 15633 tablet_bootstrap.cc:492] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:06.933933 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:04:06.935633 15555 leader_election.cc:343] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.935885 15727 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.936194 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:06.936533 15727 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.937072 15727 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.940646 15638 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.951241 15515 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.955708 15638 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.973171 15634 tablet_bootstrap.cc:654] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.977586 15590 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:06.983242 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:06.984256 15756 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.984820 15756 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:06.985795 15756 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:06.993860 15440 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:06.998358 15638 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.999545 15632 tablet_bootstrap.cc:492] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:07.000430 15632 ts_tablet_manager.cc:1403] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.098s	user 0.031s	sys 0.042s
I20260709 13:04:07.004415 15756 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.004197 15728 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.006174 15756 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.019613 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.021394 15756 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.042277 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.043694 15590 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:07.003855 15727 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.084764 15632 raft_consensus.cc:359] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.092059 15632 raft_consensus.cc:385] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.092357 15632 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.099740 15632 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.088757 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:07.097689 15639 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.119074 15638 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.119299 15639 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.119647 15638 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.121444 15728 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.121714 15638 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:07.109138 15727 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:07.110857 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:07.111706 15756 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.118391 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:07.122025 15728 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.131058 15633 tablet_bootstrap.cc:654] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.121724 15639 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.135470 15728 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:07.136312 15634 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:07.136813 15634 ts_tablet_manager.cc:1403] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.215s	user 0.029s	sys 0.062s
I20260709 13:04:07.130218 15517 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.138991 15632 ts_tablet_manager.cc:1434] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.138s	user 0.015s	sys 0.057s
I20260709 13:04:07.140379 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:07.142235 15441 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.142822 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:07.147527 15556 leader_election.cc:343] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.148708 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.149439 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.150476 15592 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:07.150341 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:07.152051 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:07.152354 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:07.148746 15556 leader_election.cc:343] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.153752 15639 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:07.155105 15556 leader_election.cc:343] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.161798 15639 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.163062 15517 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:07.164708 15711 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.165387 15756 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:07.169986 15555 leader_election.cc:343] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.170593 15555 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:07.171456 15728 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:07.172079 15555 leader_election.cc:343] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.172612 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:07.173336 15728 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.183485 15632 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:07.189152 15341 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.190234 15809 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:07.192512 15728 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.193671 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:07.198938 15728 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.201644 15728 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:07.202700 15728 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.210808 15634 raft_consensus.cc:359] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.212272 15634 raft_consensus.cc:385] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.212608 15634 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.213636 15634 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.216598 15634 ts_tablet_manager.cc:1434] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.002s
I20260709 13:04:07.230032 15632 tablet_bootstrap.cc:654] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.247447 15634 tablet_bootstrap.cc:492] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:07.250942 15723 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.252200 15723 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.256276 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.258807 15723 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.263314 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:07.268726 15517 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:07.270459 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:07.272769 15723 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.276625 15633 tablet_bootstrap.cc:492] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:07.277212 15633 ts_tablet_manager.cc:1403] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.353s	user 0.012s	sys 0.018s
I20260709 13:04:07.284626 15723 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.285008 15811 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.290000 15632 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:07.290577 15632 ts_tablet_manager.cc:1403] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.005s
I20260709 13:04:07.291275 15633 raft_consensus.cc:359] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.292066 15633 raft_consensus.cc:385] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.292387 15633 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.293119 15632 raft_consensus.cc:359] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.293097 15633 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.293838 15632 raft_consensus.cc:385] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.294225 15632 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.295022 15632 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.297631 15632 ts_tablet_manager.cc:1434] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:07.298846 15632 tablet_bootstrap.cc:492] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:07.304471 15811 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.306505 15632 tablet_bootstrap.cc:654] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.306617 15633 ts_tablet_manager.cc:1434] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:04:07.308214 15633 tablet_bootstrap.cc:492] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:07.313109 15340 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.315518 15634 tablet_bootstrap.cc:654] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.325063 15757 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.325793 15757 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.331112 15633 tablet_bootstrap.cc:654] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.369619 15632 tablet_bootstrap.cc:492] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:07.370429 15632 ts_tablet_manager.cc:1403] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.072s	user 0.031s	sys 0.006s
I20260709 13:04:07.378852 15632 raft_consensus.cc:359] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.379689 15632 raft_consensus.cc:385] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.380003 15632 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.380927 15632 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.383788 15634 tablet_bootstrap.cc:492] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:07.384403 15634 ts_tablet_manager.cc:1403] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.152s	user 0.023s	sys 0.020s
I20260709 13:04:07.384986 15757 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.387621 15634 raft_consensus.cc:359] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.388341 15632 ts_tablet_manager.cc:1434] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:04:07.387706 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.389150 15590 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:07.390107 15632 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:07.392953 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:07.394153 15633 tablet_bootstrap.cc:492] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:07.394706 15633 ts_tablet_manager.cc:1403] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.014s
I20260709 13:04:07.397755 15633 raft_consensus.cc:359] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.398643 15633 raft_consensus.cc:385] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.399091 15633 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.399299 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.403514 15441 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:07.403975 15633 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.406850 15633 ts_tablet_manager.cc:1434] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:04:07.407027 15632 tablet_bootstrap.cc:654] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.400004 15811 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.407816 15811 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.408197 15633 tablet_bootstrap.cc:492] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:07.408385 15811 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.416028 15809 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.416908 15809 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.418228 15633 tablet_bootstrap.cc:654] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.401975 15638 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.402676 15634 raft_consensus.cc:385] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.421368 15634 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.422216 15634 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.422756 15632 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:07.424746 15634 ts_tablet_manager.cc:1434] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:04:07.426929 15634 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:07.427825 15632 ts_tablet_manager.cc:1403] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.004s
I20260709 13:04:07.428004 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:07.431291 15406 leader_election.cc:343] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.431391 15632 raft_consensus.cc:359] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.436455 15632 raft_consensus.cc:385] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.436811 15632 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.437458 15809 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.443411 15634 tablet_bootstrap.cc:654] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.437628 15632 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.438823 15757 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.447165 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.449759 15632 ts_tablet_manager.cc:1434] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:04:07.459400 15632 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
W20260709 13:04:07.466826 15407 leader_election.cc:343] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.467435 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:07.467962 15633 tablet_bootstrap.cc:492] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:07.468492 15633 ts_tablet_manager.cc:1403] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.004s
I20260709 13:04:07.468786 15723 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.472924 15633 raft_consensus.cc:359] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.473758 15633 raft_consensus.cc:385] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.474186 15633 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.475116 15633 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.481676 15638 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.483681 15811 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.491982 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:07.492755 15443 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.494120 15633 ts_tablet_manager.cc:1434] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:04:07.500765 15632 tablet_bootstrap.cc:654] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.506300 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:07.507067 15590 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.528115 15633 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:07.496675 15811 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.532343 15638 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.533236 15638 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.537639 15443 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:07.527192 15590 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:07.548909 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:07.561991 15638 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:07.562628 15811 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.563171 15811 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:07.564126 15811 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.565222 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:07.565995 15517 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:07.566720 15665 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.567226 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.568452 15440 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:07.569249 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:07.574211 15634 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:07.574757 15634 ts_tablet_manager.cc:1403] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.148s	user 0.020s	sys 0.016s
I20260709 13:04:07.576406 15665 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.577188 15665 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.581302 15665 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.582252 15634 raft_consensus.cc:359] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.583106 15634 raft_consensus.cc:385] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.586649 15633 tablet_bootstrap.cc:654] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.586294 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.583426 15634 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.587348 15591 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:07.589299 15634 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.588364 15638 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:07.591260 15638 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.591794 15638 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.592934 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:07.598469 15634 ts_tablet_manager.cc:1434] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:04:07.603629 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.605581 15665 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:07.606016 15556 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.606204 15665 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.606693 15665 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.607559 15634 tablet_bootstrap.cc:492] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:07.617516 15634 tablet_bootstrap.cc:654] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.626062 15665 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.637351 15665 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.638242 15727 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.638731 15634 tablet_bootstrap.cc:492] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:07.639487 15634 ts_tablet_manager.cc:1403] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.006s
I20260709 13:04:07.638981 15727 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.642661 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.644176 15727 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:07.634594 15638 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:07.628376 15482 leader_election.cc:343] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:07.644677 15556 leader_election.cc:343] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.649524 15638 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:07.651767 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:07.628877 15340 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.653421 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:07.653671 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:07.646708 15632 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:07.654501 15632 ts_tablet_manager.cc:1403] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.195s	user 0.016s	sys 0.010s
I20260709 13:04:07.646616 15634 raft_consensus.cc:359] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:07.655213 15482 leader_election.cc:343] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.655301 15634 raft_consensus.cc:385] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.655746 15634 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.655951 15441 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.655872 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:07.655992 15555 leader_election.cc:343] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.657829 15518 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.658039 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:07.659296 15633 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:07.659734 15638 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.659811 15727 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.660785 15633 ts_tablet_manager.cc:1403] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.157s	user 0.016s	sys 0.009s
I20260709 13:04:07.662837 15634 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.665216 15634 ts_tablet_manager.cc:1434] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:04:07.666323 15634 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:07.670522 15441 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:07.651626 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:07.672044 15665 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.672045 15556 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:07.669305 15632 raft_consensus.cc:359] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.673568 15632 raft_consensus.cc:385] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.673854 15632 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.672597 15633 raft_consensus.cc:359] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.674507 15632 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.675338 15633 raft_consensus.cc:385] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.675761 15633 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.676501 15633 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.678194 15633 ts_tablet_manager.cc:1434] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:04:07.678675 15632 ts_tablet_manager.cc:1434] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:04:07.678669 15518 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:07.679862 15632 tablet_bootstrap.cc:492] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:07.680272 15727 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.680776 15727 raft_consensus.cc:697] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:07.682010 15727 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.672573 15665 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.688623 15665 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.672049 15590 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.691377 15633 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:07.699630 15590 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:07.705120 15634 tablet_bootstrap.cc:654] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.707948 15809 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.708529 15809 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.709177 15632 tablet_bootstrap.cc:654] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.710908 15809 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.712996 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:07.717782 15406 leader_election.cc:343] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.718688 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.719471 15590 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:07.721010 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:07.721895 15809 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.722273 15809 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.722643 15809 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.726675 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.727604 15441 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:07.730154 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:07.732136 15811 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.732712 15811 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.733193 15811 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.733690 15633 tablet_bootstrap.cc:654] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.741973 15665 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.742614 15665 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.743388 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.744215 15590 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:07.745033 15665 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.748710 15339 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 2, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.753495 15809 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.754813 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:07.762874 15665 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.763617 15665 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:07.765113 15665 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.773427 15811 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.761483 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:07.761921 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:07.777266 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:07.777796 15590 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.778024 15591 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:07.756254 15809 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:07.781235 15406 leader_election.cc:343] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.775615 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.782584 15441 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:07.797361 15633 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:07.798040 15633 ts_tablet_manager.cc:1403] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.008s
I20260709 13:04:07.801636 15633 raft_consensus.cc:359] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.802441 15633 raft_consensus.cc:385] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.802728 15633 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.803606 15633 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.804141 15590 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:07.806432 15633 ts_tablet_manager.cc:1434] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:07.809986 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:07.811852 15811 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.813925 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:07.814369 15757 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.814782 15757 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.815122 15757 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.816366 15809 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:07.816717 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:07.816916 15809 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:07.817834 15809 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.825870 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:07.826671 15441 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.826124 15341 catalog_manager.cc:5697] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.833684 15632 tablet_bootstrap.cc:492] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:07.834309 15632 ts_tablet_manager.cc:1403] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.034s
I20260709 13:04:07.835074 15441 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:07.837495 15633 tablet_bootstrap.cc:492] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:07.840132 15757 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.842507 15757 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:07.844269 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:07.844460 15632 raft_consensus.cc:359] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.845098 15591 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.845332 15632 raft_consensus.cc:385] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.845745 15632 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.846601 15632 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.848908 15632 ts_tablet_manager.cc:1434] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:07.850126 15632 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:07.854027 15591 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:07.859309 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:07.860457 15443 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.866752 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:07.868045 15757 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.869517 15634 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:07.870190 15634 ts_tablet_manager.cc:1403] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.204s	user 0.050s	sys 0.040s
I20260709 13:04:07.869544 15757 raft_consensus.cc:697] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:07.872545 15757 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.874755 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:07.875573 15590 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.886740 15634 raft_consensus.cc:359] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.887710 15634 raft_consensus.cc:385] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.888056 15634 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.888844 15634 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.893874 15634 ts_tablet_manager.cc:1434] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:04:07.892552 15443 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:07.895612 15634 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:07.897114 15632 tablet_bootstrap.cc:654] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.896956 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:07.898844 15665 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.899401 15665 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:07.900274 15665 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.901877 15590 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:07.902951 15633 tablet_bootstrap.cc:654] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.909650 15341 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.914579 15728 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.915428 15728 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.919404 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:07.918792 15340 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.918871 15728 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:07.923103 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:07.925920 15555 leader_election.cc:343] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:07.927150 15556 leader_election.cc:343] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.927655 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:07.929881 15779 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.936297 15634 tablet_bootstrap.cc:654] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.949648 15634 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:07.950198 15634 ts_tablet_manager.cc:1403] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.003s
I20260709 13:04:07.952977 15634 raft_consensus.cc:359] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.953699 15634 raft_consensus.cc:385] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.954010 15634 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.954246 15340 catalog_manager.cc:5697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.954759 15634 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.957502 15634 ts_tablet_manager.cc:1434] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:07.958721 15634 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:07.963864 15633 tablet_bootstrap.cc:492] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:07.966094 15633 ts_tablet_manager.cc:1403] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.004s
I20260709 13:04:07.968357 15665 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.968957 15633 raft_consensus.cc:359] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.971058 15633 raft_consensus.cc:385] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.971330 15633 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.965278 15634 tablet_bootstrap.cc:654] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.975244 15632 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:07.975811 15632 ts_tablet_manager.cc:1403] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.126s	user 0.023s	sys 0.024s
I20260709 13:04:07.979036 15632 raft_consensus.cc:359] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.979811 15632 raft_consensus.cc:385] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.980093 15632 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.980762 15632 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.983456 15632 ts_tablet_manager.cc:1434] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:07.984680 15632 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:07.972208 15633 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:07.991297 15632 tablet_bootstrap.cc:654] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.997784 15633 ts_tablet_manager.cc:1434] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:04:08.002305 15632 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:08.003000 15632 ts_tablet_manager.cc:1403] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.008s
I20260709 13:04:07.999356 15633 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:08.006349 15632 raft_consensus.cc:359] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.007284 15632 raft_consensus.cc:385] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.007694 15632 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.008603 15632 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.011227 15632 ts_tablet_manager.cc:1434] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:04:08.012410 15632 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:08.017634 15634 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:08.018242 15634 ts_tablet_manager.cc:1403] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.017s
I20260709 13:04:08.019438 15441 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.020125 15632 tablet_bootstrap.cc:654] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.021510 15634 raft_consensus.cc:359] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.022344 15634 raft_consensus.cc:385] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.022650 15634 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.025274 15633 tablet_bootstrap.cc:654] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.023463 15634 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.034403 15634 ts_tablet_manager.cc:1434] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:04:08.035640 15634 tablet_bootstrap.cc:492] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:08.039598 15638 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.040216 15638 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.043962 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.045660 15633 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:08.046433 15633 ts_tablet_manager.cc:1403] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.000s
W20260709 13:04:08.046990 15556 leader_election.cc:343] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.048377 15811 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.049016 15811 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.049726 15634 tablet_bootstrap.cc:654] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.050930 15633 raft_consensus.cc:359] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.052227 15633 raft_consensus.cc:385] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.052635 15633 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.053794 15633 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.054674 15756 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.060132 15633 ts_tablet_manager.cc:1434] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:04:08.061571 15633 tablet_bootstrap.cc:492] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:08.062888 15634 tablet_bootstrap.cc:492] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:08.063485 15634 ts_tablet_manager.cc:1403] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.008s
I20260709 13:04:08.065387 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.068459 15633 tablet_bootstrap.cc:654] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.069067 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:08.069232 15634 raft_consensus.cc:359] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.069916 15517 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:08.070278 15634 raft_consensus.cc:385] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.070670 15634 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.071449 15634 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:08.076507 15482 leader_election.cc:343] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.077466 15638 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:08.082458 15633 tablet_bootstrap.cc:492] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:08.083294 15633 ts_tablet_manager.cc:1403] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:04:08.085660 15634 ts_tablet_manager.cc:1434] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:08.086993 15634 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:08.087852 15633 raft_consensus.cc:359] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.088899 15633 raft_consensus.cc:385] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.089254 15633 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.090631 15633 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.094367 15633 ts_tablet_manager.cc:1434] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:08.095379 15633 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:08.095469 15634 tablet_bootstrap.cc:654] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.098030 15632 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:08.098606 15632 ts_tablet_manager.cc:1403] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.038s
I20260709 13:04:08.101699 15632 raft_consensus.cc:359] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.102546 15632 raft_consensus.cc:385] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.103190 15633 tablet_bootstrap.cc:654] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.102807 15632 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.104197 15723 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.103971 15632 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.104794 15723 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.107069 15632 ts_tablet_manager.cc:1434] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:04:08.108741 15632 tablet_bootstrap.cc:492] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:08.109669 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:08.112416 15406 leader_election.cc:343] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.115337 15723 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.115893 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:08.116314 15633 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:08.116791 15633 ts_tablet_manager.cc:1403] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
W20260709 13:04:08.117635 15407 leader_election.cc:343] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.118144 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:08.120257 15633 raft_consensus.cc:359] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.121096 15633 raft_consensus.cc:385] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.121392 15633 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.122362 15632 tablet_bootstrap.cc:654] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.122722 15723 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.122382 15633 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.127710 15811 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.128119 15633 ts_tablet_manager.cc:1434] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:08.137485 15555 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:08.165060 15723 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.165680 15723 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.142261 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:08.167498 15590 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:08.146091 15634 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:08.167753 15638 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.171499 15638 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.172006 15638 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.171849 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:08.164872 15633 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:08.171566 15634 ts_tablet_manager.cc:1403] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.025s
I20260709 13:04:08.172670 15632 tablet_bootstrap.cc:492] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:08.161587 15665 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.173206 15632 ts_tablet_manager.cc:1403] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.029s
I20260709 13:04:08.173579 15665 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.176226 15632 raft_consensus.cc:359] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.168802 15728 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.176952 15632 raft_consensus.cc:385] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.179322 15728 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.183447 15638 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.189680 15728 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:08.189626 15591 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:08.191133 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.191500 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:08.191876 15441 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:08.183465 15633 tablet_bootstrap.cc:654] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:08.193241 15556 leader_election.cc:343] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.183626 15723 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.194137 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:08.195055 15728 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.195494 15728 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.195706 15407 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:08.183655 15632 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.197233 15723 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.186708 15634 raft_consensus.cc:359] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.197778 15723 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.197907 15634 raft_consensus.cc:385] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.197126 15638 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:08.198220 15723 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.198418 15634 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.198010 15632 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.200031 15634 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.200860 15632 ts_tablet_manager.cc:1434] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:04:08.197427 15728 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.206326 15632 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:08.208561 15634 ts_tablet_manager.cc:1434] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:04:08.210355 15634 tablet_bootstrap.cc:492] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:08.187435 15665 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.184978 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:08.213145 15518 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:08.187071 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:08.216013 15665 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.216431 15665 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.216732 15665 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.220152 15723 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.223881 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:08.224311 15723 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.226213 15632 tablet_bootstrap.cc:654] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.224594 15517 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.230051 15665 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.232788 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.235131 15440 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:08.244163 15441 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:08.246517 15859 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.243428 15665 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.236464 15858 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.253094 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:08.264833 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:08.265590 15515 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.268038 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:08.269590 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:08.283258 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:08.284444 15728 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.285806 15633 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:08.281404 15665 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:04:08.286361 15633 ts_tablet_manager.cc:1403] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.122s	user 0.030s	sys 0.032s
I20260709 13:04:08.286299 15591 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:08.288187 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:08.315924 15441 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.292219 15518 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:08.263247 15858 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.319684 15665 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.321835 15443 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.322625 15858 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.320310 15665 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.333593 15779 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.334120 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.329602 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:08.335929 15592 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.328593 15633 raft_consensus.cc:359] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.345242 15633 raft_consensus.cc:385] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.352715 15633 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.351984 15728 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:08.350852 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:08.353367 15665 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.354287 15634 tablet_bootstrap.cc:654] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.329671 15515 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:08.355415 15633 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.352873 15517 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:08.361475 15665 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.366459 15633 ts_tablet_manager.cc:1434] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:04:08.367707 15756 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.374317 15442 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:08.374588 15728 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.374187 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:08.385146 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:08.387370 15518 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:08.380800 15555 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:08.378243 15728 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.389052 15723 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.390117 15859 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.390585 15728 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:08.390530 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.390727 15859 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:08.392733 15441 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:08.401600 15518 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.402246 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.392988 15438 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:08.393273 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:08.418330 15592 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:08.419395 15591 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:08.422268 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:08.422716 15859 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.425952 15632 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:08.426553 15632 ts_tablet_manager.cc:1403] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.220s	user 0.013s	sys 0.025s
W20260709 13:04:08.432585 15555 leader_election.cc:343] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.426915 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:08.451059 15592 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:08.454092 15756 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.457317 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:08.458864 15757 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.459416 15757 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:08.460314 15757 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.467937 15633 tablet_bootstrap.cc:492] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:08.444918 15723 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:08.469892 15723 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.468896 15482 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:08.487341 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:08.481462 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:08.493399 15632 raft_consensus.cc:359] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.494349 15632 raft_consensus.cc:385] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.494794 15632 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.496244 15632 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.511466 15638 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.493578 15811 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.520231 15811 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.522387 15811 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.488490 15756 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.536520 15868 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:08.531883 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50539.4us
I20260709 13:04:08.538689 15868 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:08.539122 15556 leader_election.cc:343] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.541831 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:08.541946 15811 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.544215 15811 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.544905 15859 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.547417 15632 ts_tablet_manager.cc:1434] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.120s	user 0.004s	sys 0.007s
I20260709 13:04:08.553661 15633 tablet_bootstrap.cc:654] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.556633 15632 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:08.557265 15634 tablet_bootstrap.cc:492] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:08.556675 15339 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.557920 15634 ts_tablet_manager.cc:1403] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.348s	user 0.022s	sys 0.038s
I20260709 13:04:08.568917 15634 raft_consensus.cc:359] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.570226 15634 raft_consensus.cc:385] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.570674 15634 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.571647 15634 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.575314 15809 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:08.576175 15809 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.579139 15634 ts_tablet_manager.cc:1434] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
W20260709 13:04:08.586548 15618 tablet.cc:2406] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:08.590085 15634 tablet_bootstrap.cc:492] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:08.602043 15809 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.604084 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:08.611873 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:08.627612 15340 catalog_manager.cc:5697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.717811 15406 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:08.720384 15859 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.721333 15859 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.735471 15871 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:08.757611 15858 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.761479 15859 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:08.759344 15858 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.764050 15633 tablet_bootstrap.cc:492] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:08.764627 15633 ts_tablet_manager.cc:1403] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.309s	user 0.022s	sys 0.011s
I20260709 13:04:08.764629 15858 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:08.770938 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.774264 15634 tablet_bootstrap.cc:654] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:08.780568 15556 leader_election.cc:343] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.782805 15632 tablet_bootstrap.cc:654] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.782315 15633 raft_consensus.cc:359] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.783672 15633 raft_consensus.cc:385] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.783999 15633 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.784585 15633 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:08.792824 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 303965us
I20260709 13:04:08.793911 15665 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.799149 15633 ts_tablet_manager.cc:1434] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:04:08.802234 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:08.802955 15589 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.806193 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:08.807088 15633 tablet_bootstrap.cc:492] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:08.807222 15439 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.828049 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:08.834318 15589 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:08.837566 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:08.838073 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:08.843415 15727 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.851804 15439 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:08.854784 15633 tablet_bootstrap.cc:654] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.858821 15665 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.864588 15727 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.865263 15858 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.869513 15632 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:08.870267 15632 ts_tablet_manager.cc:1403] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.314s	user 0.009s	sys 0.012s
W20260709 13:04:08.897666 15482 leader_election.cc:343] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.902810 15634 tablet_bootstrap.cc:492] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:08.903366 15634 ts_tablet_manager.cc:1403] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.314s	user 0.016s	sys 0.039s
I20260709 13:04:08.906128 15727 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:08.907527 15555 leader_election.cc:343] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.908047 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:08.909735 15779 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.910998 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:08.912803 15556 leader_election.cc:343] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.918213 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:08.921337 15482 leader_election.cc:343] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.921782 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:08.924599 15632 raft_consensus.cc:359] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.925499 15632 raft_consensus.cc:385] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.925859 15632 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.928885 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:08.928675 15632 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.932682 15757 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.936441 15858 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.939167 15632 ts_tablet_manager.cc:1434] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.008s
I20260709 13:04:08.943140 15632 tablet_bootstrap.cc:492] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:08.941212 15634 raft_consensus.cc:359] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.943624 15634 raft_consensus.cc:385] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.943976 15723 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.944047 15634 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.944830 15633 tablet_bootstrap.cc:492] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:08.944530 15723 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.944895 15634 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:08.946762 15633 ts_tablet_manager.cc:1403] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.140s	user 0.028s	sys 0.013s
I20260709 13:04:08.959384 15634 ts_tablet_manager.cc:1434] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.003s
I20260709 13:04:08.961005 15634 tablet_bootstrap.cc:492] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:08.961894 15858 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:08.972242 15858 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.008540 15634 tablet_bootstrap.cc:654] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.018345 15723 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.025559 15632 tablet_bootstrap.cc:654] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.025766 15723 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.181599 15634 tablet_bootstrap.cc:492] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:09.182245 15634 ts_tablet_manager.cc:1403] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.222s	user 0.023s	sys 0.017s
W20260709 13:04:09.033385 15555 leader_election.cc:343] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.046303 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.192783 15633 raft_consensus.cc:359] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.200603 15633 raft_consensus.cc:385] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.201053 15633 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.050683 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:09.180332 15858 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.198786 15632 tablet_bootstrap.cc:492] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:09.201875 15592 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:09.198756 15341 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.202582 15632 ts_tablet_manager.cc:1403] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.260s	user 0.018s	sys 0.005s
I20260709 13:04:09.201925 15858 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.194446 15723 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.204219 15555 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:09.208634 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 175288us
I20260709 13:04:09.208796 15727 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.210187 15779 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.211753 15723 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.214481 15723 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.205732 15728 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.216078 15728 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.214800 15634 raft_consensus.cc:359] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.217113 15634 raft_consensus.cc:385] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.218675 15728 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:09.206180 15633 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.217437 15634 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.222101 15633 ts_tablet_manager.cc:1434] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.275s	user 0.011s	sys 0.016s
I20260709 13:04:09.224296 15634 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.232623 15633 tablet_bootstrap.cc:492] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:09.231649 15437 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:09.232563 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:09.237689 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:09.238016 15406 leader_election.cc:343] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.246580 15517 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:09.235605 15632 raft_consensus.cc:359] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.249861 15632 raft_consensus.cc:385] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.250276 15632 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.239286 15809 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:04:09.252549 15632 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.253788 15871 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.254719 15871 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.255721 15858 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.258503 15633 tablet_bootstrap.cc:654] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.261497 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:09.261613 15871 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.270915 15634 ts_tablet_manager.cc:1434] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.001s
I20260709 13:04:09.275296 15779 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.276158 15779 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.280212 15634 tablet_bootstrap.cc:492] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:09.289754 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:09.290658 15591 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:09.292585 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:09.292621 15632 ts_tablet_manager.cc:1434] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.001s
I20260709 13:04:09.279150 15779 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:09.298614 15556 leader_election.cc:343] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.299281 15632 tablet_bootstrap.cc:492] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:09.296339 15340 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.304842 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:09.308180 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.311188 15633 tablet_bootstrap.cc:492] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:09.311831 15633 ts_tablet_manager.cc:1403] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.012s
I20260709 13:04:09.318423 15890 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:09.314734 15556 leader_election.cc:343] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.325209 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.328917 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.329468 15727 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.329761 15514 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:09.330070 15727 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.333595 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:09.334079 15727 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:09.345467 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:09.346504 15435 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:09.346410 15727 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.353199 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:09.349653 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:09.354048 15588 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:09.354996 15727 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.355487 15727 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.355926 15727 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.357501 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:09.359092 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:09.359472 15757 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.362160 15884 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.362787 15884 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.363276 15884 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:09.363448 15482 leader_election.cc:343] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.363312 15868 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.377207 15633 raft_consensus.cc:359] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.378428 15633 raft_consensus.cc:385] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.378830 15633 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.365365 15868 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.382460 15633 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.375280 15757 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.382318 15868 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.387590 15633 ts_tablet_manager.cc:1434] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 13:04:09.395757 15632 tablet_bootstrap.cc:654] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:09.389267 15555 leader_election.cc:343] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.387499 15757 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.407914 15634 tablet_bootstrap.cc:654] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.409938 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:09.416993 15757 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.416910 15727 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.428913 15809 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.432857 15809 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.433284 15809 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.429385 15633 tablet_bootstrap.cc:492] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:09.389070 15406 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:09.446851 15723 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.448807 15884 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.419392 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:09.456395 15779 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.459478 15779 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.469039 15859 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:09.465758 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79918.3us
I20260709 13:04:09.480163 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:09.480790 15406 leader_election.cc:343] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.480163 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:09.481846 15588 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:09.477747 15727 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:09.479238 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 91113.6us
I20260709 13:04:09.517326 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:09.518041 15779 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:09.519757 15811 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.520475 15811 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.520833 15811 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.527318 15632 tablet_bootstrap.cc:492] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:09.531157 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:09.532369 15632 ts_tablet_manager.cc:1403] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.235s	user 0.032s	sys 0.026s
I20260709 13:04:09.475682 15868 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:09.534123 15556 leader_election.cc:343] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.537559 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:09.539378 15633 tablet_bootstrap.cc:654] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.539292 15779 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.541965 15634 tablet_bootstrap.cc:492] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:09.542141 15884 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.543377 15632 raft_consensus.cc:359] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.545835 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.546680 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.546864 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:09.547950 15811 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.553730 15634 ts_tablet_manager.cc:1403] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.274s	user 0.020s	sys 0.020s
I20260709 13:04:09.553833 15632 raft_consensus.cc:385] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.563045 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:09.555332 15757 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:09.554497 15779 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.569293 15779 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.570133 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:09.572046 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:09.572873 15588 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.567907 15632 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.567363 15868 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.575562 15634 raft_consensus.cc:359] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.578001 15634 raft_consensus.cc:385] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.578342 15634 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.578833 15632 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:09.577644 15555 leader_election.cc:343] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.580464 15632 ts_tablet_manager.cc:1434] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
W20260709 13:04:09.581106 15555 leader_election.cc:343] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.581671 15632 tablet_bootstrap.cc:492] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:09.587839 15515 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:09.595806 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:09.599628 15899 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.599486 15634 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.602792 15809 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.604775 15437 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:09.607164 15634 ts_tablet_manager.cc:1434] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:04:09.608422 15634 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:09.610023 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:09.612655 15728 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.613747 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:09.619433 15588 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:09.619310 15779 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.621075 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:09.624274 15809 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.625082 15809 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.625607 15809 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:09.627617 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:09.634146 15589 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:09.633972 15884 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.634233 15592 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:09.636072 15779 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:09.637271 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:09.638638 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:09.639456 15556 leader_election.cc:343] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.640771 15728 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.626832 15809 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.641497 15728 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.640851 15899 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.646380 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:09.647890 15556 leader_election.cc:343] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.652047 15811 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.652592 15728 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:09.656797 15482 leader_election.cc:343] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.661310 15632 tablet_bootstrap.cc:654] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:09.662662 15482 leader_election.cc:343] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.665526 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:09.670835 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:09.671834 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:09.672266 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.672946 15518 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
W20260709 13:04:09.673112 15406 leader_election.cc:343] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.675343 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:09.678561 15728 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.678969 15728 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.679107 15633 tablet_bootstrap.cc:492] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:09.679399 15728 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.679698 15633 ts_tablet_manager.cc:1403] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.255s	user 0.020s	sys 0.000s
I20260709 13:04:09.682500 15634 tablet_bootstrap.cc:654] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.685681 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:09.674479 15757 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.693539 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:09.693638 15514 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:04:09.708765 15482 leader_election.cc:343] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.704737 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:09.710889 15779 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.706488 15633 raft_consensus.cc:359] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.718770 15633 raft_consensus.cc:385] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.719333 15633 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.741056 15588 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:09.722445 15633 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.744946 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:09.748140 15811 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.748978 15811 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:09.750264 15811 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.756482 15633 ts_tablet_manager.cc:1434] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.076s	user 0.014s	sys 0.000s
I20260709 13:04:09.757700 15633 tablet_bootstrap.cc:492] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:09.758225 15340 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:09.772871 15406 leader_election.cc:343] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.773438 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:09.774233 15632 tablet_bootstrap.cc:492] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:09.774791 15632 ts_tablet_manager.cc:1403] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.193s	user 0.013s	sys 0.024s
I20260709 13:04:09.775802 15868 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.778530 15728 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.779273 15632 raft_consensus.cc:359] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.780042 15632 raft_consensus.cc:385] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.780342 15632 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.781123 15632 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.782675 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:09.786901 15728 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:09.788566 15556 leader_election.cc:343] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.793146 15632 ts_tablet_manager.cc:1434] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:04:09.794301 15632 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:09.803736 15633 tablet_bootstrap.cc:654] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.807268 15632 tablet_bootstrap.cc:654] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.814841 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:09.815915 15515 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.810053 15634 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:09.831916 15634 ts_tablet_manager.cc:1403] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.224s	user 0.010s	sys 0.009s
I20260709 13:04:09.835603 15341 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.843722 15515 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:09.847520 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:09.849514 15728 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.850087 15728 raft_consensus.cc:697] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:09.850988 15728 consensus_queue.cc:237] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.863200 15633 tablet_bootstrap.cc:492] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:09.863888 15633 ts_tablet_manager.cc:1403] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.010s
I20260709 13:04:09.875133 15632 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:09.876173 15632 ts_tablet_manager.cc:1403] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.023s
I20260709 13:04:09.876914 15633 raft_consensus.cc:359] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.877683 15633 raft_consensus.cc:385] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.878027 15633 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.878697 15633 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.871649 15634 raft_consensus.cc:359] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.883652 15634 raft_consensus.cc:385] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.884018 15634 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.883787 15632 raft_consensus.cc:359] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.884891 15632 raft_consensus.cc:385] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.885185 15632 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.885957 15632 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.888319 15632 ts_tablet_manager.cc:1434] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:09.885210 15634 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.890306 15632 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:09.880963 15633 ts_tablet_manager.cc:1434] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:04:09.894740 15633 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:09.895247 15339 catalog_manager.cc:5697] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.897382 15632 tablet_bootstrap.cc:654] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.901834 15633 tablet_bootstrap.cc:654] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.913165 15634 ts_tablet_manager.cc:1434] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:04:09.932152 15868 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.932711 15868 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.933597 15632 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:09.934155 15632 ts_tablet_manager.cc:1403] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.008s
I20260709 13:04:09.936723 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:09.937508 15591 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:09.937223 15632 raft_consensus.cc:359] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.938087 15632 raft_consensus.cc:385] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.938318 15868 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.938400 15632 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.939112 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.939329 15632 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.939860 15515 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:09.941174 15406 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:09.941659 15632 ts_tablet_manager.cc:1434] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:09.942135 15809 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.942502 15809 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.942780 15632 tablet_bootstrap.cc:492] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:09.942836 15809 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.950023 15632 tablet_bootstrap.cc:654] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.950488 15809 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.964188 15632 tablet_bootstrap.cc:492] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:09.955066 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:09.966914 15632 ts_tablet_manager.cc:1403] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 13:04:09.967183 15591 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.957228 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:09.968021 15515 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.953138 15634 tablet_bootstrap.cc:492] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:09.956210 15809 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.964188 15633 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:09.972066 15633 ts_tablet_manager.cc:1403] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.003s
I20260709 13:04:09.975406 15633 raft_consensus.cc:359] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.976230 15633 raft_consensus.cc:385] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.976016 15632 raft_consensus.cc:359] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.976560 15633 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.976751 15632 raft_consensus.cc:385] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.977052 15632 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.977517 15633 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.978312 15632 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.979307 15868 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.979810 15868 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:09.980568 15632 ts_tablet_manager.cc:1434] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:09.981654 15632 tablet_bootstrap.cc:492] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:09.982209 15868 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:09.984400 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:09.985148 15514 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:09.986322 15634 tablet_bootstrap.cc:654] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.987309 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:09.988471 15868 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.988916 15868 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.989074 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:09.989871 15588 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:09.989463 15868 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.977921 15591 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:09.994031 15632 tablet_bootstrap.cc:654] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.995384 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:09.996670 15809 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.997186 15809 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:09.998047 15809 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.004612 15634 tablet_bootstrap.cc:492] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:10.005609 15634 ts_tablet_manager.cc:1403] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.005s
I20260709 13:04:10.000312 15633 ts_tablet_manager.cc:1434] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:04:10.008816 15634 raft_consensus.cc:359] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.009706 15634 raft_consensus.cc:385] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.009692 15868 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.010157 15634 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.009382 15633 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:10.010902 15634 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.015877 15634 ts_tablet_manager.cc:1434] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:04:10.017060 15634 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:10.024186 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:10.024977 15516 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.027660 15515 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:10.055213 15632 tablet_bootstrap.cc:492] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:10.055809 15632 ts_tablet_manager.cc:1403] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.013s
I20260709 13:04:10.059233 15632 raft_consensus.cc:359] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.060170 15632 raft_consensus.cc:385] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.060498 15632 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.061247 15632 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.062151 15634 tablet_bootstrap.cc:654] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.061021 15728 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.068205 15728 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.069998 15632 ts_tablet_manager.cc:1434] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:10.071659 15632 tablet_bootstrap.cc:492] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:10.071866 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:10.073613 15556 leader_election.cc:343] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.073915 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:10.071918 15728 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:10.076505 15555 leader_election.cc:343] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.077278 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:10.079027 15728 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.080098 15723 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.080659 15723 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.082590 15516 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:10.083063 15723 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:10.085115 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:10.085214 15868 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:10.086076 15514 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:10.088384 15633 tablet_bootstrap.cc:654] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.088915 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:10.089725 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:10.090471 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:10.091064 15591 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:10.091131 15588 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.092895 15868 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.093952 15868 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:10.101949 15632 tablet_bootstrap.cc:654] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.102502 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:10.103389 15809 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.105553 15340 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.106480 15634 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:10.107007 15634 ts_tablet_manager.cc:1403] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.015s
I20260709 13:04:10.095082 15868 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.109265 15728 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.109790 15728 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.113045 15809 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.108490 15588 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:10.117928 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:10.119132 15435 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:10.118202 15728 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:10.123240 15556 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:10.124708 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:10.124980 15632 tablet_bootstrap.cc:492] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:10.125710 15632 ts_tablet_manager.cc:1403] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.000s
W20260709 13:04:10.127070 15555 leader_election.cc:343] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.128556 15728 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.128173 15634 raft_consensus.cc:359] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.128954 15728 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.129402 15634 raft_consensus.cc:385] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.129865 15728 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.129882 15634 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.134574 15632 raft_consensus.cc:359] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.135447 15632 raft_consensus.cc:385] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.135784 15632 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.137368 15632 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.139184 15632 ts_tablet_manager.cc:1434] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:10.140352 15632 tablet_bootstrap.cc:492] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:10.131130 15634 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.147379 15728 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.150471 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:10.151208 15435 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.160907 15884 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.161794 15634 ts_tablet_manager.cc:1434] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.008s
I20260709 13:04:10.161563 15884 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.162992 15634 tablet_bootstrap.cc:492] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:10.163666 15341 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.166759 15435 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:10.167395 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:10.168470 15556 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:10.169341 15555 leader_election.cc:343] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.169607 15899 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.170153 15899 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:10.172117 15728 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:10.171149 15899 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.176211 15809 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.199657 15723 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.215924 15435 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.221858 15884 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:10.222872 15809 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.223695 15809 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.206408 15723 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.242041 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:10.242552 15723 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:10.243052 15592 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:10.245952 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:10.246755 15516 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:10.248917 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:10.249275 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:10.250063 15436 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:10.250768 15723 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.251334 15723 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.253930 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:10.251824 15723 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.258821 15811 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.280689 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:10.287743 15406 leader_election.cc:343] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.273612 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:10.296698 15592 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:10.296999 15809 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:10.321801 15633 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:10.322638 15633 ts_tablet_manager.cc:1403] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.314s	user 0.011s	sys 0.003s
W20260709 13:04:10.307783 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49764.4us
I20260709 13:04:10.327919 15340 catalog_manager.cc:5697] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:10.341653 15632 tablet_bootstrap.cc:654] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.353175 15634 tablet_bootstrap.cc:654] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.353946 15871 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.354561 15871 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.359031 15871 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:10.390786 15811 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.412385 15633 raft_consensus.cc:359] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.413367 15633 raft_consensus.cc:385] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.413678 15633 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.414398 15633 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.423899 15723 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.428447 15723 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:10.442725 15633 ts_tablet_manager.cc:1434] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.003s
I20260709 13:04:10.428546 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:10.455505 15633 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:10.456924 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:10.457858 15589 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.463449 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:10.464331 15512 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:10.462697 15406 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.470557 15728 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.471380 15728 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.451959 15899 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.481827 15728 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:10.484704 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:10.475517 15811 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:04:10.499387 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:10.487044 15899 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.508318 15757 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:04:10.535826 15634 tablet_bootstrap.cc:492] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:10.536384 15634 ts_tablet_manager.cc:1403] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.374s	user 0.052s	sys 0.065s
I20260709 13:04:10.541128 15633 tablet_bootstrap.cc:654] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.521605 15585 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:10.544332 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:10.555621 15632 tablet_bootstrap.cc:492] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:10.558375 15632 ts_tablet_manager.cc:1403] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.418s	user 0.045s	sys 0.065s
I20260709 13:04:10.537158 15590 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:10.597291 15589 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:10.605602 15634 raft_consensus.cc:359] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.611351 15634 raft_consensus.cc:385] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.611953 15634 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.615239 15899 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:10.619612 15512 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:10.615410 15634 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:10.628068 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.639228 15634 ts_tablet_manager.cc:1434] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.103s	user 0.010s	sys 0.001s
I20260709 13:04:10.642935 15634 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:10.645442 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:10.646379 15723 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.647416 15723 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:10.648260 15723 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:10.641053 15556 leader_election.cc:343] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.659020 15632 raft_consensus.cc:359] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.662514 15930 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.663355 15632 raft_consensus.cc:385] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.666285 15632 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
W20260709 13:04:10.668267 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:10.666574 15929 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:10.675591 15632 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.684387 15859 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:10.696861 15512 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.698025 15632 ts_tablet_manager.cc:1434] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.139s	user 0.009s	sys 0.000s
I20260709 13:04:10.679373 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:10.711233 15632 tablet_bootstrap.cc:492] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:10.711424 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:10.714859 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:10.720094 15930 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.721853 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:10.722709 15435 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.724225 15929 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.724751 15929 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.725118 15929 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.725971 15723 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.725481 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:10.746367 15634 tablet_bootstrap.cc:654] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.780944 15633 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:10.781822 15633 ts_tablet_manager.cc:1403] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.327s	user 0.025s	sys 0.015s
I20260709 13:04:10.768112 15871 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:10.792775 15871 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:10.793499 15871 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.792616 15633 raft_consensus.cc:359] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.794082 15633 raft_consensus.cc:385] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.794525 15633 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.831413 15341 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:10.844460 15555 leader_election.cc:343] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:10.845337 15555 leader_election.cc:343] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.823594 15633 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.845813 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:10.847976 15728 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:10.851349 15943 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.111s	user 0.003s	sys 0.001s
I20260709 13:04:10.853706 15859 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.854369 15859 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.867136 15939 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:04:10.871474 15632 tablet_bootstrap.cc:654] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.876754 15633 ts_tablet_manager.cc:1434] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.094s	user 0.013s	sys 0.002s
I20260709 13:04:10.892115 15633 tablet_bootstrap.cc:492] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:10.890415 15929 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:10.941231 15859 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:10.954253 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:10.955797 15436 raft_consensus.cc:2393] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:10.986689 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:10.989223 15633 tablet_bootstrap.cc:654] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.953553 15859 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:04:10.999568 15932 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.000372 15932 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:11.003080 15556 leader_election.cc:343] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.006199 15634 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:11.006747 15634 ts_tablet_manager.cc:1403] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.364s	user 0.024s	sys 0.011s
W20260709 13:04:11.009141 15949 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 13:04:11.014921 15632 tablet_bootstrap.cc:492] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:11.015686 15632 ts_tablet_manager.cc:1403] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.307s	user 0.029s	sys 0.015s
W20260709 13:04:11.022351 15555 leader_election.cc:343] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.025848 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:11.031507 15859 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.037317 15929 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:11.059945 15950 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
I20260709 13:04:11.068717 15809 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:11.069726 15809 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.077639 15634 raft_consensus.cc:359] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.078737 15634 raft_consensus.cc:385] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.079067 15634 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.083364 15871 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.085942 15871 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.087872 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:11.088127 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:11.092042 15634 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:11.103400 15406 leader_election.cc:343] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.107591 15632 raft_consensus.cc:359] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.108354 15632 raft_consensus.cc:385] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.108623 15632 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.109324 15632 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.111004 15634 ts_tablet_manager.cc:1434] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.104s	user 0.010s	sys 0.001s
I20260709 13:04:11.112834 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:11.113617 15728 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.121806 15632 ts_tablet_manager.cc:1434] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.106s	user 0.009s	sys 0.000s
I20260709 13:04:11.115762 15932 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.136350 15633 tablet_bootstrap.cc:492] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:11.136977 15633 ts_tablet_manager.cc:1403] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.251s	user 0.020s	sys 0.005s
I20260709 13:04:11.144413 15632 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:11.136402 15809 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.164577 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:11.152271 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:11.170564 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:11.173525 15634 tablet_bootstrap.cc:492] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:11.181005 15728 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.151609 15442 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:11.201395 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:11.204177 15929 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:11.207358 15633 raft_consensus.cc:359] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.208186 15633 raft_consensus.cc:385] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.208485 15633 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.209239 15633 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.150092 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:11.211772 15633 ts_tablet_manager.cc:1434] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 13:04:11.216636 15633 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:11.190213 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:11.185104 15930 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:04:11.204869 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:11.238077 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:11.240219 15941 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:11.244200 15941 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:11.244786 15941 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:11.267844 15940 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:11.280025 15941 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.287611 15941 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:11.290866 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 151015us
I20260709 13:04:11.295945 15939 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:11.304373 15964 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:04:11.274205 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:11.298844 15939 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.331715 15929 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:11.345219 15634 tablet_bootstrap.cc:654] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.351971 15632 tablet_bootstrap.cc:654] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:11.341298 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 78008us
W20260709 13:04:11.356222 15965 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:11.361393 15871 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.366439 15939 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:11.368309 15509 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.371861 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:11.374776 15584 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:11.387224 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:11.390663 15555 leader_election.cc:343] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.392028 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:11.400449 15556 leader_election.cc:343] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.401002 15556 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:11.393509 15809 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.405787 15779 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.416766 15633 tablet_bootstrap.cc:654] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.414963 15809 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:11.427826 15809 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.455695 15969 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.478637 15728 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.479410 15728 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.501745 15728 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:11.503391 15634 tablet_bootstrap.cc:492] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:11.491775 15969 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.504796 15632 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:11.504343 15634 ts_tablet_manager.cc:1403] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.331s	user 0.012s	sys 0.028s
I20260709 13:04:11.514846 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:11.516185 15518 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:11.524742 15871 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.525655 15871 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.555157 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:11.556329 15436 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:11.560972 15633 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:11.562582 15633 ts_tablet_manager.cc:1403] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.346s	user 0.015s	sys 0.015s
I20260709 13:04:11.562609 15632 ts_tablet_manager.cc:1403] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.433s	user 0.022s	sys 0.020s
I20260709 13:04:11.569579 15633 raft_consensus.cc:359] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.571131 15633 raft_consensus.cc:385] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.574709 15633 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.575578 15633 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.577603 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:11.578670 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 72173.4us
I20260709 13:04:11.573038 15871 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.579185 15728 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:11.579876 15728 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.580384 15728 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.575893 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:11.583798 15633 ts_tablet_manager.cc:1434] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:04:11.587827 15634 raft_consensus.cc:359] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.588691 15634 raft_consensus.cc:385] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.588989 15634 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.589713 15634 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.591473 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:11.590793 15632 raft_consensus.cc:359] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.592818 15632 raft_consensus.cc:385] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.593132 15632 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.593806 15632 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:11.596659 15406 leader_election.cc:343] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.601282 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:11.602067 15591 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:11.602537 15632 ts_tablet_manager.cc:1434] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 13:04:11.603700 15632 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:11.600860 15633 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
W20260709 13:04:11.605726 15556 leader_election.cc:343] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.630659 15634 ts_tablet_manager.cc:1434] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.125s	user 0.004s	sys 0.004s
I20260709 13:04:11.640259 15728 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.641494 15634 tablet_bootstrap.cc:492] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:11.653376 15941 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.659727 15941 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.662045 15941 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.665452 15728 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:11.666463 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:11.667286 15439 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:11.667804 15969 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:11.668478 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:11.669230 15586 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:11.670265 15633 tablet_bootstrap.cc:654] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.671588 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:11.672185 15518 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.674909 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:11.682052 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:11.684875 15954 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:11.685544 15954 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.685906 15954 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.688827 15632 tablet_bootstrap.cc:654] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.690064 15518 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:11.673209 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:11.691763 15929 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.692157 15929 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.692516 15929 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.692736 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:11.693509 15439 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.675679 15339 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:11.708349 15555 leader_election.cc:343] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.708976 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:11.709826 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:11.710551 15728 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.706480 15954 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.711278 15634 tablet_bootstrap.cc:654] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.716269 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:11.717103 15728 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:11.717587 15728 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:11.718560 15728 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.723037 15633 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:11.723654 15633 ts_tablet_manager.cc:1403] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.002s
I20260709 13:04:11.726594 15633 raft_consensus.cc:359] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.727360 15633 raft_consensus.cc:385] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.734347 15633 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.718400 15929 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.740278 15929 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.739449 15633 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.741556 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:11.742231 15518 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.743723 15633 ts_tablet_manager.cc:1434] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:04:11.744976 15633 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:11.750597 15518 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:11.750728 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:11.751498 15586 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.751820 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:11.752722 15930 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.753419 15930 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:11.754521 15930 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.739606 15439 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:11.771410 15954 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.774670 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:11.775434 15439 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.778218 15632 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:11.778844 15632 ts_tablet_manager.cc:1403] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.175s	user 0.012s	sys 0.008s
I20260709 13:04:11.780031 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:11.780689 15591 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.794288 15591 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:11.796012 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:11.796810 15954 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:11.797382 15954 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:11.798274 15954 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.799873 15439 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:11.802444 15633 tablet_bootstrap.cc:654] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.805832 15586 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:11.815907 15632 raft_consensus.cc:359] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.816980 15632 raft_consensus.cc:385] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.817396 15632 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.818483 15632 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.820118 15634 tablet_bootstrap.cc:492] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:11.821182 15634 ts_tablet_manager.cc:1403] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.187s	user 0.013s	sys 0.003s
I20260709 13:04:11.822532 15632 ts_tablet_manager.cc:1434] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:04:11.824596 15632 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:11.824656 15634 raft_consensus.cc:359] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.825537 15634 raft_consensus.cc:385] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.825826 15634 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.826992 15633 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:11.826722 15634 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.827494 15633 ts_tablet_manager.cc:1403] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.001s
I20260709 13:04:11.829517 15634 ts_tablet_manager.cc:1434] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:11.830654 15633 raft_consensus.cc:359] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.831578 15633 raft_consensus.cc:385] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.831857 15633 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.832242 15632 tablet_bootstrap.cc:654] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.830660 15634 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:11.835232 15633 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.838042 15633 ts_tablet_manager.cc:1434] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:11.848742 15634 tablet_bootstrap.cc:654] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.850167 15341 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 2, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.856468 15929 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.857414 15633 tablet_bootstrap.cc:492] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:11.857167 15929 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.862924 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:11.865258 15406 leader_election.cc:343] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.865736 15948 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.866581 15948 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.871727 15929 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.871631 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:11.872522 15948 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:11.872920 15586 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:11.871619 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:11.874147 15439 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:11.875480 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:11.875654 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:11.875483 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:11.878590 15555 leader_election.cc:343] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.879055 15339 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 2, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.880227 15948 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.881430 15929 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.881875 15929 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.882202 15929 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.880887 15948 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.883510 15948 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.928507 15929 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.932262 15633 tablet_bootstrap.cc:654] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.933174 15972 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.934592 15632 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:11.933727 15972 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.935250 15632 ts_tablet_manager.cc:1403] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.111s	user 0.029s	sys 0.036s
I20260709 13:04:11.937526 15634 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:11.937795 15972 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:11.938215 15634 ts_tablet_manager.cc:1403] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.108s	user 0.045s	sys 0.025s
I20260709 13:04:11.939587 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:11.938983 15632 raft_consensus.cc:359] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.940842 15632 raft_consensus.cc:385] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.940698 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:11.941195 15632 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.941504 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:11.942095 15406 leader_election.cc:343] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:11.943130 15555 leader_election.cc:343] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.941814 15929 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:11.943939 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:11.944139 15632 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.947240 15632 ts_tablet_manager.cc:1434] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:04:11.948602 15632 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:11.945189 15634 raft_consensus.cc:359] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.949716 15634 raft_consensus.cc:385] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.949858 15439 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:11.949277 15339 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.950150 15634 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.951656 15634 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.954805 15556 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:11.956296 15972 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.956771 15972 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.957130 15972 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.957314 15634 ts_tablet_manager.cc:1434] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:04:11.964229 15634 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:11.969164 15632 tablet_bootstrap.cc:654] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.969913 15948 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.971360 15586 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:11.973169 15948 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:11.974376 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:11.976826 15634 tablet_bootstrap.cc:654] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:11.976747 15555 leader_election.cc:343] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.978302 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:11.979275 15439 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:11.979393 15972 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.980700 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:11.981563 15971 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.982586 15632 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:11.983412 15632 ts_tablet_manager.cc:1403] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.006s
I20260709 13:04:11.983793 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:11.983896 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:11.984696 15438 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.985275 15929 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.983439 15971 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.988639 15971 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.990432 15634 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:11.991114 15634 ts_tablet_manager.cc:1403] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:04:11.991891 15632 raft_consensus.cc:359] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:11.992605 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:11.998951 15632 raft_consensus.cc:385] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.999807 15632 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.001181 15632 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.004477 15632 ts_tablet_manager.cc:1434] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
W20260709 13:04:12.004829 15555 leader_election.cc:343] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.005530 15971 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:12.008514 15972 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:12.009382 15930 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:12.010421 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:12.014595 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:12.015412 15436 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:12.024142 15634 raft_consensus.cc:359] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.024976 15634 raft_consensus.cc:385] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.025249 15634 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.025976 15634 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.027740 15634 ts_tablet_manager.cc:1434] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.000s
W20260709 13:04:12.014724 15555 leader_election.cc:343] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.028919 15634 tablet_bootstrap.cc:492] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:12.032114 15556 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:12.032894 15633 tablet_bootstrap.cc:492] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:12.033478 15633 ts_tablet_manager.cc:1403] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.177s	user 0.017s	sys 0.021s
I20260709 13:04:12.033595 15948 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.034039 15948 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.034433 15948 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.035413 15632 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:12.035308 15438 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:12.038018 15633 raft_consensus.cc:359] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.047904 15633 raft_consensus.cc:385] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.055704 15633 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.056656 15633 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.057768 15929 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.061000 15929 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.067668 15929 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:12.068742 15634 tablet_bootstrap.cc:654] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.069648 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:12.070416 15589 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:12.070704 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:12.070017 15633 ts_tablet_manager.cc:1434] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 13:04:12.071735 15518 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.073835 15633 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:12.078511 15948 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.072685 15407 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:12.080268 15556 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:12.080372 15406 leader_election.cc:343] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.085191 15632 tablet_bootstrap.cc:654] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.085760 15871 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.086265 15871 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.092865 15871 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.095288 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:12.096100 15438 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.082752 15971 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.097730 15971 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:12.101676 15948 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:12.100622 15929 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:12.104738 15971 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.106841 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:12.110028 15555 leader_election.cc:343] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.119124 15871 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.134523 15516 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:12.144650 15634 tablet_bootstrap.cc:492] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:12.147670 15634 ts_tablet_manager.cc:1403] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.014s
I20260709 13:04:12.148567 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:12.152421 15406 leader_election.cc:343] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.159065 15438 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:12.150628 15972 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:12.163008 15556 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:12.165074 15633 tablet_bootstrap.cc:654] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.165552 15871 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:12.167870 15634 raft_consensus.cc:359] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.168903 15634 raft_consensus.cc:385] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.169305 15634 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.170539 15634 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.180080 15634 ts_tablet_manager.cc:1434] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:04:12.182546 15948 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.194808 15948 raft_consensus.cc:697] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:12.196241 15948 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.197651 15438 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:12.206599 15634 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:12.220808 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:12.221900 15586 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.229146 15972 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:12.223162 15940 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.230806 15940 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.232641 15438 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:12.224763 15339 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.241050 15941 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:04:12.259514 15940 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:12.262609 15633 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:12.263341 15633 ts_tablet_manager.cc:1403] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.190s	user 0.031s	sys 0.013s
I20260709 13:04:12.273629 15930 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:12.279985 15871 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:12.283042 15632 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:12.284534 15632 ts_tablet_manager.cc:1403] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.249s	user 0.041s	sys 0.043s
I20260709 13:04:12.286371 15633 raft_consensus.cc:359] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.287251 15633 raft_consensus.cc:385] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.288367 15633 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.308080 15633 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.317289 15591 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:12.307089 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:12.326177 15586 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:12.349982 15633 ts_tablet_manager.cc:1434] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:04:12.327360 15934 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:04:12.333973 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:12.345286 15407 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:12.368606 15930 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.369210 15930 raft_consensus.cc:697] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:12.370194 15930 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.370290 15632 raft_consensus.cc:359] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.375938 15632 raft_consensus.cc:385] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.376578 15632 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.378019 15632 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.384280 15585 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:12.386344 15634 tablet_bootstrap.cc:654] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.395673 15632 ts_tablet_manager.cc:1434] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.001s
I20260709 13:04:12.396934 15632 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:12.400224 15633 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:12.423270 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:12.432008 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 120019us
W20260709 13:04:12.435261 15482 leader_election.cc:343] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.437243 15940 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.445561 15728 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.446327 15728 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.447741 15940 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.460968 15728 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:12.454229 16012 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.483326 15634 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:12.484207 15634 ts_tablet_manager.cc:1403] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.278s	user 0.035s	sys 0.012s
I20260709 13:04:12.466718 15940 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.500355 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:12.510000 15556 leader_election.cc:343] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.504436 15954 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.512842 15954 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:12.498636 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45106.7us
W20260709 13:04:12.541950 16010 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:04:12.482577 16012 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.515347 15954 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:12.565166 16012 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:12.566113 15340 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:12.589535 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 72486.8us
I20260709 13:04:12.596297 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:12.597080 15586 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:12.640729 15632 tablet_bootstrap.cc:654] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.700716 15971 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.701437 15971 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.799378 15871 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.800237 15871 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.803076 15871 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:12.812994 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:12.835840 16012 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.836498 16012 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.836930 16012 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.852334 15940 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.854786 15940 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:12.849558 15634 raft_consensus.cc:359] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.858937 15634 raft_consensus.cc:385] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.859318 15634 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.860092 15634 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.878371 15513 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.871850 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:12.885257 15634 ts_tablet_manager.cc:1434] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.401s	user 0.022s	sys 0.014s
I20260709 13:04:12.888144 15634 tablet_bootstrap.cc:492] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:12.888466 15971 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:12.865674 16015 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:12.891649 16015 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.872443 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:12.913977 16024 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.914777 16024 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.920876 15633 tablet_bootstrap.cc:654] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.893025 16012 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.930125 15634 tablet_bootstrap.cc:654] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.932505 16015 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:12.936103 15632 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:12.936704 15632 ts_tablet_manager.cc:1403] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.540s	user 0.016s	sys 0.015s
I20260709 13:04:12.935212 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:12.946141 16024 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:12.946782 15510 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
W20260709 13:04:12.947871 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:12.949033 16012 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:12.955443 15555 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:12.955292 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:12.956347 15518 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:12.954576 15512 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:12.954916 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:12.961391 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:12.962224 15585 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:12.965804 15632 raft_consensus.cc:359] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.950807 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:12.972483 15632 raft_consensus.cc:385] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.973054 15632 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.974346 15632 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:12.976002 15589 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.981101 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:12.982204 15585 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:12.988881 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:12.991921 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:12.971710 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:12.998431 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:13.000532 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:13.000916 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:13.001309 15590 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.006145 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:13.009297 15809 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.009756 15809 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.010156 15809 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.010346 15632 ts_tablet_manager.cc:1434] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.002s
I20260709 13:04:13.001323 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:13.018858 16011 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:04:13.008970 16024 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:13.020357 16024 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.020778 16024 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.009838 15439 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:04:13.037115 15406 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.038589 15971 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:13.039086 15971 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:13.039454 15971 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:13.042299 15482 leader_election.cc:343] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:13.047195 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 75577.2us
I20260709 13:04:13.053103 15809 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.054499 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:13.054247 15633 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:13.055395 15633 ts_tablet_manager.cc:1403] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.668s	user 0.035s	sys 0.053s
I20260709 13:04:13.056213 15632 tablet_bootstrap.cc:492] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
W20260709 13:04:13.062471 15555 leader_election.cc:343] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.062347 16015 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.063285 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:13.010206 15589 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:13.077610 15809 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.080497 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:13.083738 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 74776.9us
W20260709 13:04:13.097455 15482 leader_election.cc:343] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:13.098456 15482 leader_election.cc:343] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.103626 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:13.094870 15340 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.104427 15584 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.106052 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:13.112875 16024 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.104456 15956 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:13.114518 15434 raft_consensus.cc:2368] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:13.117619 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:13.118613 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:13.117532 15633 raft_consensus.cc:359] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.120765 15633 raft_consensus.cc:385] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.121101 15633 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.121829 15633 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.124312 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:13.128572 15633 ts_tablet_manager.cc:1434] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:04:13.128499 15509 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.125924 15590 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:13.130451 15948 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.131155 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:13.131496 15728 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:13.134168 15556 leader_election.cc:343] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.136708 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:13.143384 15633 tablet_bootstrap.cc:492] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
W20260709 13:04:13.144490 15406 leader_election.cc:343] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.141240 16011 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.161602 15556 leader_election.cc:400] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:13.141868 16024 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.141544 15940 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:13.172643 15406 leader_election.cc:343] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.190824 15971 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.191967 15585 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.195951 15971 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:13.198390 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:13.199405 15440 raft_consensus.cc:2368] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:13.201674 15584 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:13.206377 15634 tablet_bootstrap.cc:492] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:13.207864 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:13.209290 15956 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.210397 15632 tablet_bootstrap.cc:654] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.210611 15634 ts_tablet_manager.cc:1403] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.324s	user 0.016s	sys 0.007s
I20260709 13:04:13.210147 15956 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:13.207901 15509 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:13.212446 15956 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.214474 15556 leader_election.cc:400] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:13.214869 15556 leader_election.cc:403] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:13.221622 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:13.230448 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:13.231966 15871 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:13.232667 15871 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:13.231362 15940 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.235528 15940 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.238011 15940 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.240365 15633 tablet_bootstrap.cc:654] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.233844 15871 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.231602 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:13.242893 15509 raft_consensus.cc:2368] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:13.246363 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:13.248384 16013 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.248468 15585 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:13.251714 16011 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:13.249567 16013 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:13.255625 16013 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.249128 15940 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.273921 15940 raft_consensus.cc:697] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:13.278512 15940 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.281731 15930 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.282335 15930 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.280490 15634 raft_consensus.cc:359] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.288475 15634 raft_consensus.cc:385] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.290367 15634 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.294162 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:13.296213 15555 leader_election.cc:400] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:13.297314 15930 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.297014 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:13.296604 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:13.317642 15632 tablet_bootstrap.cc:492] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:13.318095 15440 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:13.318243 15632 ts_tablet_manager.cc:1403] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.262s	user 0.014s	sys 0.034s
I20260709 13:04:13.317651 15590 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 1: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:13.315687 15633 tablet_bootstrap.cc:492] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:13.321185 15633 ts_tablet_manager.cc:1403] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.179s	user 0.025s	sys 0.011s
W20260709 13:04:13.300851 15406 leader_election.cc:343] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.294170 15634 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.296659 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:13.329929 15633 raft_consensus.cc:359] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.334542 15634 ts_tablet_manager.cc:1434] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.123s	user 0.015s	sys 0.000s
I20260709 13:04:13.334619 15633 raft_consensus.cc:385] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:13.333986 15407 leader_election.cc:343] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.335160 15633 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.335918 15634 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:13.335834 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:13.333665 15632 raft_consensus.cc:359] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.336998 15930 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.337298 15632 raft_consensus.cc:385] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.337730 15632 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.336606 15633 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.338541 15632 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.341157 15632 ts_tablet_manager.cc:1434] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:04:13.342568 15632 tablet_bootstrap.cc:492] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:13.352303 15633 ts_tablet_manager.cc:1434] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:04:13.353963 15633 tablet_bootstrap.cc:492] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:13.363900 15632 tablet_bootstrap.cc:654] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.363642 15482 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:13.367904 16012 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.376579 15948 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.377729 15634 tablet_bootstrap.cc:654] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.377353 15948 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.392076 15633 tablet_bootstrap.cc:654] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.383738 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:13.392871 16012 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:13.393965 15556 leader_election.cc:343] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.385569 15948 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:13.399626 15930 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.400724 15930 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.408861 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:13.410051 15930 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.414819 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:13.416875 15587 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
W20260709 13:04:13.417088 15555 leader_election.cc:343] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.417622 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:13.418861 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:13.419231 15728 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.420710 15871 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.421114 15871 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.421506 15871 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.422596 16012 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.423111 16012 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.425212 16012 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.426954 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:13.427634 15587 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:13.429745 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:13.429301 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:13.433099 16012 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.428010 15341 catalog_manager.cc:5697] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.433514 16012 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.433892 16012 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.434453 15341 catalog_manager.cc:5697] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.441373 16012 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:13.446449 15406 leader_election.cc:343] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.450253 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:13.451455 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:13.454121 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:13.454988 15587 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.464893 15634 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:13.467839 15634 ts_tablet_manager.cc:1403] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.011s
I20260709 13:04:13.467270 15633 tablet_bootstrap.cc:492] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
W20260709 13:04:13.469357 15482 leader_election.cc:343] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.470124 15633 ts_tablet_manager.cc:1403] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.008s
I20260709 13:04:13.473479 15632 tablet_bootstrap.cc:492] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:13.474085 15632 ts_tablet_manager.cc:1403] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.132s	user 0.005s	sys 0.022s
I20260709 13:04:13.466652 15871 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.477013 15633 raft_consensus.cc:359] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.477888 15633 raft_consensus.cc:385] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.478286 15633 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.478166 15632 raft_consensus.cc:359] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.472512 15634 raft_consensus.cc:359] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:13.470503 15482 leader_election.cc:343] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.479771 15634 raft_consensus.cc:385] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.479600 15632 raft_consensus.cc:385] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.478837 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:13.480211 15634 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.480252 15632 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.481189 15634 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.480806 15339 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.481499 15632 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.483387 15634 ts_tablet_manager.cc:1434] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:04:13.479205 15633 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.484155 15632 ts_tablet_manager.cc:1434] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:04:13.470988 15587 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:13.486105 15633 ts_tablet_manager.cc:1434] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:04:13.486186 16012 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.486272 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:13.485476 15632 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:13.487394 15633 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:13.484004 15339 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 3, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:13.493068 15406 leader_election.cc:343] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.494112 15634 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:13.487254 16012 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.499850 16012 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:13.501086 16012 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.506785 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:13.507615 15585 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.504518 15871 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.517331 15634 tablet_bootstrap.cc:654] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.521652 15633 tablet_bootstrap.cc:654] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.547569 15340 catalog_manager.cc:5697] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.551148 15633 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:13.551787 15633 ts_tablet_manager.cc:1403] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.009s
I20260709 13:04:13.557765 15634 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:13.558329 15634 ts_tablet_manager.cc:1403] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.007s
I20260709 13:04:13.563619 16017 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.564239 16017 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.565411 15634 raft_consensus.cc:359] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.566224 15634 raft_consensus.cc:385] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.566483 16017 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.566533 15634 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.568347 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:13.569242 15587 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:13.569911 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:13.554884 15633 raft_consensus.cc:359] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.571148 15633 raft_consensus.cc:385] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.571455 15633 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.571723 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:13.567498 15634 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.572602 16017 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.572973 15633 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.579849 15585 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:13.581477 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:13.582096 16017 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.582726 15871 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.583302 15871 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:13.584303 15871 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.595571 15633 ts_tablet_manager.cc:1434] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:04:13.596909 15633 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:13.601480 15634 ts_tablet_manager.cc:1434] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:04:13.602849 15634 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:13.608701 15632 tablet_bootstrap.cc:654] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.609642 15340 catalog_manager.cc:5697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.625193 15634 tablet_bootstrap.cc:654] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.637219 15585 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:13.638409 15632 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:13.638939 15632 ts_tablet_manager.cc:1403] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.154s	user 0.009s	sys 0.003s
I20260709 13:04:13.617993 15633 tablet_bootstrap.cc:654] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.640955 15956 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:04:13.654031 15632 raft_consensus.cc:359] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.654842 15632 raft_consensus.cc:385] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.655108 15632 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.657076 15632 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.675674 15511 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.682654 15632 ts_tablet_manager.cc:1434] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.009s
I20260709 13:04:13.691021 15632 tablet_bootstrap.cc:492] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:13.697106 15633 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:13.697715 15633 ts_tablet_manager.cc:1403] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.101s	user 0.039s	sys 0.010s
I20260709 13:04:13.698079 15513 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:13.699901 15634 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:13.700505 15634 ts_tablet_manager.cc:1403] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.098s	user 0.034s	sys 0.016s
I20260709 13:04:13.703714 15956 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.704800 15633 raft_consensus.cc:359] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.705559 15633 raft_consensus.cc:385] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.705833 15633 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.707653 15633 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.710172 15956 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.712837 15634 raft_consensus.cc:359] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.713690 15634 raft_consensus.cc:385] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.713965 15634 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.717880 15633 ts_tablet_manager.cc:1434] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:04:13.719141 15633 tablet_bootstrap.cc:492] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:13.719872 15515 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.722182 15634 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.724985 15634 ts_tablet_manager.cc:1434] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:04:13.726454 15634 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:13.730628 15632 tablet_bootstrap.cc:654] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.730832 16012 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.731696 16012 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.737133 15633 tablet_bootstrap.cc:654] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.737852 15956 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.738426 15956 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.749027 16025 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.749704 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:13.750422 16011 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.750744 15512 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:13.749861 15956 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.754261 16012 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.749672 16025 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.751020 16011 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.756901 16025 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:13.757984 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:13.764010 16011 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:13.764195 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:13.765132 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:13.765797 15434 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 0.
I20260709 13:04:13.767208 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:13.771301 15556 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:13.771960 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:13.773360 15555 leader_election.cc:343] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.778813 16027 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.779263 16027 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.779625 16027 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.776518 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:13.780669 15406 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:13.789896 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:13.790795 15591 raft_consensus.cc:2393] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 1: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:13.789932 15956 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:13.791512 15956 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.791905 15956 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.794540 15407 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:13.784672 15940 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.780153 16025 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:04:13.783929 16012 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:04:13.797978 16031 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.810144 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:13.811106 15585 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
W20260709 13:04:13.850098 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 50030.3us
I20260709 13:04:13.884637 15940 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:04:13.918970 15633 tablet_bootstrap.cc:492] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:13.919832 15633 ts_tablet_manager.cc:1403] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.201s	user 0.016s	sys 0.016s
I20260709 13:04:13.919967 16031 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.900920 15811 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:04:13.923431 15634 tablet_bootstrap.cc:654] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.931876 15971 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.923291 15633 raft_consensus.cc:359] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.934520 15633 raft_consensus.cc:385] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.934880 15633 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.938978 15633 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.940886 15633 ts_tablet_manager.cc:1434] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:04:13.935801 15971 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.944857 15971 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:13.926198 16027 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:13.948596 16027 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:13.941985 15633 tablet_bootstrap.cc:492] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:13.955339 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:13.956091 15443 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:13.971321 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 87527.8us
I20260709 13:04:13.983702 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:13.966061 15971 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.996361 15632 tablet_bootstrap.cc:492] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:13.997231 15632 ts_tablet_manager.cc:1403] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.306s	user 0.011s	sys 0.017s
I20260709 13:04:14.001953 15443 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:14.003209 15556 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:14.004112 15728 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.996690 15971 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.017730 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:14.019097 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:13.995643 15956 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.017233 15632 raft_consensus.cc:359] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.022130 15632 raft_consensus.cc:385] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.032835 15956 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.035522 15971 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:14.040825 15633 tablet_bootstrap.cc:654] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.040959 15634 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:14.075035 15634 ts_tablet_manager.cc:1403] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.349s	user 0.018s	sys 0.009s
I20260709 13:04:14.075476 15632 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.076458 15632 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.078344 15634 raft_consensus.cc:359] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.079188 15634 raft_consensus.cc:385] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.079521 15634 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.081184 15728 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:14.081221 15634 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.080389 15510 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.082465 15728 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.088883 15632 ts_tablet_manager.cc:1434] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 13:04:14.094524 15632 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:14.106743 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:14.107494 15590 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.099246 15634 ts_tablet_manager.cc:1434] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:04:14.113354 15634 tablet_bootstrap.cc:492] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:14.114657 15632 tablet_bootstrap.cc:654] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.117784 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:14.118721 15518 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.120149 15590 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:14.122438 15633 tablet_bootstrap.cc:492] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:14.122962 15633 ts_tablet_manager.cc:1403] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.181s	user 0.015s	sys 0.017s
I20260709 13:04:14.126945 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:14.128033 15632 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:14.128695 15632 ts_tablet_manager.cc:1403] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.010s
I20260709 13:04:14.128846 16031 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:14.131851 15633 raft_consensus.cc:359] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.132644 16062 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:14.133330 16062 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:14.135314 15482 consensus_peers.cc:597] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:14.062968 15556 leader_election.cc:343] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:14.143904 15555 leader_election.cc:343] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.134018 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:14.134979 16062 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.146327 15555 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:14.147076 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44445.3us
I20260709 13:04:14.147145 15728 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:14.148567 15555 leader_election.cc:343] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:14.150588 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 87661.2us
I20260709 13:04:14.132675 15633 raft_consensus.cc:385] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.154242 15633 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.155041 15633 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.157114 16013 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:14.161598 15632 raft_consensus.cc:359] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.162840 15632 raft_consensus.cc:385] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.179459 15633 ts_tablet_manager.cc:1434] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:04:14.181212 15518 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:14.181445 15633 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918: Bootstrap starting.
I20260709 13:04:14.184552 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:14.163280 15632 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.204823 15632 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:14.207000 15406 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:14.207778 15555 leader_election.cc:343] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:14.209450 15556 leader_election.cc:343] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.210983 15556 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:14.226037 15728 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:14.210429 16077 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.228127 16077 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:14.230942 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:14.233119 16077 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:14.234999 15632 ts_tablet_manager.cc:1434] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.003s
I20260709 13:04:14.208684 16070 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:04:14.238801 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:14.241596 15634 tablet_bootstrap.cc:654] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:14.243671 15555 leader_election.cc:343] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.266047 15632 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:14.286017 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:14.291190 15556 leader_election.cc:343] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.291757 15556 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:14.293216 16073 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:14.309962 15632 tablet_bootstrap.cc:654] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.314881 15633 tablet_bootstrap.cc:654] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.322485 16031 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.323161 16031 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.325799 16031 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.332540 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:14.334174 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:14.336329 15634 tablet_bootstrap.cc:492] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:14.339517 15634 ts_tablet_manager.cc:1403] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.226s	user 0.024s	sys 0.018s
I20260709 13:04:14.344832 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:14.346117 15956 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:14.338100 15339 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.358249 15634 raft_consensus.cc:359] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.359246 15634 raft_consensus.cc:385] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.359638 15634 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.360450 15634 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.363150 15634 ts_tablet_manager.cc:1434] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.002s
I20260709 13:04:14.364864 15634 tablet_bootstrap.cc:492] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:14.367805 15632 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:14.373037 15634 tablet_bootstrap.cc:654] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.368587 15632 ts_tablet_manager.cc:1403] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.003s
I20260709 13:04:14.378916 15632 raft_consensus.cc:359] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.379837 15632 raft_consensus.cc:385] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.380149 15632 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.380738 16031 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.381060 15632 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.381661 16031 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.385842 15632 ts_tablet_manager.cc:1434] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:14.387247 15632 tablet_bootstrap.cc:492] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:14.388175 16031 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.388845 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:14.389681 15509 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:14.391916 15634 tablet_bootstrap.cc:492] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:14.392702 15634 ts_tablet_manager.cc:1403] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 13:04:14.393594 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:14.394356 15585 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:14.395921 15406 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:14.398023 15956 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.398438 15633 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918: No bootstrap required, opened a new log
I20260709 13:04:14.398638 15956 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.399034 15633 ts_tablet_manager.cc:1403] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918: Time spent bootstrapping tablet: real 0.218s	user 0.015s	sys 0.000s
I20260709 13:04:14.399245 15956 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.402823 15633 raft_consensus.cc:359] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.403648 15633 raft_consensus.cc:385] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.403942 15633 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.415472 15634 raft_consensus.cc:359] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.416689 15634 raft_consensus.cc:385] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.417054 15634 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.418049 15634 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.417614 15632 tablet_bootstrap.cc:654] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.428719 15956 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.435856 15633 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.438460 15633 ts_tablet_manager.cc:1434] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:04:14.439142 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:14.438326 15509 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.439878 15512 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.441334 15956 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.442222 15634 ts_tablet_manager.cc:1434] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.002s
I20260709 13:04:14.443212 15634 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:14.444425 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:14.445118 15587 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.477181 15341 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 0 to 1, leader changed from <none> to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.480435 15512 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:14.492466 15632 tablet_bootstrap.cc:492] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:14.493191 15632 ts_tablet_manager.cc:1403] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.106s	user 0.036s	sys 0.021s
I20260709 13:04:14.494666 15587 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:14.496201 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:14.497040 15956 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:14.496865 15632 raft_consensus.cc:359] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.497573 15956 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:14.497761 15632 raft_consensus.cc:385] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.498746 15632 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.506335 15634 tablet_bootstrap.cc:654] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.507074 15632 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.498517 15956 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.524691 15632 ts_tablet_manager.cc:1434] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
I20260709 13:04:14.526217 15632 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
W20260709 13:04:14.527267 15555 consensus_peers.cc:597] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:14.545755 15587 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:14.555152 15435 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.562841 16031 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:14.564725 16012 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.565397 16012 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.566787 15340 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.573254 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:14.574025 15509 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:14.574103 15439 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:14.576426 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:14.576995 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:14.577478 16022 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.577726 15587 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:14.577867 16022 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.578320 16022 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.586706 16012 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.587525 15948 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:14.593705 16031 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:14.597220 16022 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.599632 16022 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.606698 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:14.607765 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:14.608431 15434 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.609083 15634 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:14.609602 15634 ts_tablet_manager.cc:1403] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.167s	user 0.008s	sys 0.015s
I20260709 13:04:14.607486 15587 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.637616 15634 raft_consensus.cc:359] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.638425 15634 raft_consensus.cc:385] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.638715 15634 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.640017 15930 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.640555 15930 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.643349 15930 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.643759 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:14.645596 15406 leader_election.cc:343] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.653028 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:14.654021 15584 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:14.660200 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:14.639472 15634 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.663172 15632 tablet_bootstrap.cc:654] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.678565 15634 ts_tablet_manager.cc:1434] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.001s
I20260709 13:04:14.663089 16017 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.685585 16017 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.705597 16017 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.746742 16017 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.748798 15434 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:14.749832 16017 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.750206 15632 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:14.750764 15632 ts_tablet_manager.cc:1403] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.225s	user 0.022s	sys 0.018s
I20260709 13:04:14.755066 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:14.756880 15406 leader_election.cc:343] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.767634 15632 raft_consensus.cc:359] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.768751 15632 raft_consensus.cc:385] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.769061 15632 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.771210 15632 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.772446 15634 tablet_bootstrap.cc:492] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:14.775713 15632 ts_tablet_manager.cc:1434] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:04:14.780115 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:14.780889 15584 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.788882 15584 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:14.793850 15587 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:14.809918 15634 tablet_bootstrap.cc:654] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.796290 15632 tablet_bootstrap.cc:492] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:14.804673 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:14.815389 15930 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:14.816015 15930 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:14.816978 15930 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.792706 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:14.825857 16070 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:14.828342 15632 tablet_bootstrap.cc:654] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.831820 16070 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:14.835300 16070 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.847422 16012 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.854136 16012 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.863030 16012 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.869001 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:14.870337 15439 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:14.872215 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:14.872504 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:14.873085 16068 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.873282 15587 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:14.873514 16068 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.873905 16068 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.879088 15340 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.881268 15634 tablet_bootstrap.cc:492] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:14.881984 15634 ts_tablet_manager.cc:1403] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.035s
I20260709 13:04:14.884009 16068 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.907025 16068 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.895890 15634 raft_consensus.cc:359] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.914624 15634 raft_consensus.cc:385] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.915155 15634 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.916162 15634 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.920862 15634 ts_tablet_manager.cc:1434] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:04:14.919261 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:14.918344 16070 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.921947 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:14.930796 15435 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.932890 15634 tablet_bootstrap.cc:492] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:14.928414 15871 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:14.946269 15340 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.925020 15587 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.929833 16070 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.960346 16065 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:14.971789 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:14.973417 15632 tablet_bootstrap.cc:492] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:14.974035 15632 ts_tablet_manager.cc:1403] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.178s	user 0.024s	sys 0.022s
W20260709 13:04:14.976425 15482 leader_election.cc:343] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.977828 16070 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:14.979204 15632 raft_consensus.cc:359] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.980082 15632 raft_consensus.cc:385] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.980389 15632 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.981140 15632 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:14.983615 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:14.984540 15584 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:14.986979 15634 tablet_bootstrap.cc:654] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.988626 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:15.008483 15632 ts_tablet_manager.cc:1434] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:04:15.009804 15632 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:14.991461 15435 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:15.012224 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:15.000061 16070 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.015336 16070 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.020290 16070 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.022809 15587 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:15.013794 16068 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.029170 16068 raft_consensus.cc:697] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:15.032473 16068 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.032532 15632 tablet_bootstrap.cc:654] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.061769 15634 tablet_bootstrap.cc:492] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:15.062395 15634 ts_tablet_manager.cc:1403] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.012s
I20260709 13:04:15.077143 16070 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.093603 15634 raft_consensus.cc:359] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.094559 15634 raft_consensus.cc:385] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.094883 15634 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.095604 15634 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.097152 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:15.097811 15439 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.101377 16070 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:15.109290 15439 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:15.111024 15634 ts_tablet_manager.cc:1434] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 13:04:15.111308 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:15.112188 16070 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.112778 16070 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:15.113690 16070 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.119357 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:15.120126 15585 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.122637 15634 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:15.130525 15585 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:15.131933 15634 tablet_bootstrap.cc:654] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.133821 15632 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:15.134377 15632 ts_tablet_manager.cc:1403] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.020s
I20260709 13:04:15.137408 15632 raft_consensus.cc:359] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.138240 15632 raft_consensus.cc:385] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.138533 15632 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.139361 15632 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.143337 15632 ts_tablet_manager.cc:1434] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:15.146147 15634 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:15.146834 15634 ts_tablet_manager.cc:1403] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:04:15.150043 15634 raft_consensus.cc:359] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.151160 15634 raft_consensus.cc:385] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.151518 15634 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.152328 15634 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.154371 15632 tablet_bootstrap.cc:492] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Bootstrap starting.
I20260709 13:04:15.154928 15634 ts_tablet_manager.cc:1434] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:04:15.156525 15634 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:15.156145 15340 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.158000 15340 catalog_manager.cc:5697] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.161994 15632 tablet_bootstrap.cc:654] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.164534 15634 tablet_bootstrap.cc:654] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.176277 15632 tablet_bootstrap.cc:492] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: No bootstrap required, opened a new log
I20260709 13:04:15.176927 15632 ts_tablet_manager.cc:1403] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:04:15.179983 15632 raft_consensus.cc:359] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.180765 15632 raft_consensus.cc:385] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.181043 15632 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.181922 15632 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.185530 15632 ts_tablet_manager.cc:1434] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:15.202647 15634 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:15.203274 15634 ts_tablet_manager.cc:1403] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.012s
I20260709 13:04:15.207998 15634 raft_consensus.cc:359] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.208808 15634 raft_consensus.cc:385] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.209088 15634 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.209801 15634 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.212229 15634 ts_tablet_manager.cc:1434] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:15.213239 15634 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Bootstrap starting.
I20260709 13:04:15.214120 16068 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.214699 16068 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.216848 16068 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:15.221408 15634 tablet_bootstrap.cc:654] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.221626 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:15.222335 15435 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:15.239506 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:15.240281 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:15.240407 15587 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 0.
I20260709 13:04:15.241317 16068 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.242426 16068 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.242856 16068 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.249922 15634 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: No bootstrap required, opened a new log
I20260709 13:04:15.250567 15634 ts_tablet_manager.cc:1403] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.001s
I20260709 13:04:15.252607 16068 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.253756 15634 raft_consensus.cc:359] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.258123 15634 raft_consensus.cc:385] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.258498 15634 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.259363 15634 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.260792 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:15.261474 15435 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.261826 15634 ts_tablet_manager.cc:1434] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:15.262476 16068 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:15.268440 15435 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:15.270212 16031 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.272779 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:15.273506 15587 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.270666 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:15.277094 16068 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.277663 16068 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:15.278720 16068 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:15.291615 15389 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:15.303298 15587 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:15.306737 16070 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.308948 16012 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:15.330153 15511 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.329875 15339 catalog_manager.cc:5697] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.338754 16031 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.339480 16031 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.343009 16031 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:15.344610 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:15.346053 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:15.346698 15587 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:15.346781 15512 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 0.
I20260709 13:04:15.349145 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:15.350266 15871 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.350689 15871 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.351068 15871 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.365576 15930 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:15.365285 15871 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.370039 15871 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:15.377345 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:15.378191 15511 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.381953 15518 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.385435 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:15.386178 15585 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.395578 15585 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:15.396862 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:15.397153 15511 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:15.398490 15930 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.399040 15930 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:15.399991 15930 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:15.435717 15340 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.587297 16013 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:15.658468 16070 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.689456 16126 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.694948 16126 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.728560 16126 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.776633 16012 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.975832 15930 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.992355 15930 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.752446 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:16.790201 16139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.790336 16136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.794530 16137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:16.795450 14293 server_base.cc:1061] running on GCE node
I20260709 13:04:16.799481 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:16.800045 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:16.800328 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602256800306 us; error 0 us; skew 500 ppm
I20260709 13:04:16.800984 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:16.804441 14293 webserver.cc:533] Webserver started at http://127.13.245.68:36755/ using document root <none> and password file <none>
I20260709 13:04:16.805183 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:16.805438 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:16.805776 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:16.808102 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-3-root/instance:
uuid: "6ff41728dec842afad5b53c20446a5a0"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-fc6v"
I20260709 13:04:16.816424 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:04:16.820952 16144 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.821900 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:04:16.822510 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-3-root
uuid: "6ff41728dec842afad5b53c20446a5a0"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-fc6v"
I20260709 13:04:16.822868 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:16.845119 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:16.846895 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:16.849329 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:16.852769 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:16.853039 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.853415 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:16.853582 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.938325 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.68:33529
I20260709 13:04:16.938448 16206 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.68:33529 every 8 connection(s)
I20260709 13:04:16.948939 14293 auto_leader_rebalancer-test.cc:384] add a tserver: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:16.981891 16207 heartbeater.cc:344] Connected to a master server at 127.13.245.126:46019
I20260709 13:04:16.982576 16207 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:16.983747 16207 heartbeater.cc:507] Master 127.13.245.126:46019 requested a full tablet report, sending...
I20260709 13:04:16.986301 15340 ts_manager.cc:194] Registered new tserver with Master: 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:16.988327 15340 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51916
I20260709 13:04:17.468815 15518 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:17.486649 15440 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.486954 15591 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.489127 16012 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.490382 16068 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:17.509720 15482 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba3252dd04824c9ca1c0b6dfd9c7c387. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.515802 16211 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.523483 15440 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.541069 15340 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.564226 15440 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:17.566936 15587 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.597550 15591 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.605880 16024 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.609824 15512 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.616931 16024 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:17.637889 15407 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75927b236d9342309d9e8c7a6a9b2f95. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.643062 16031 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.652784 15591 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.655725 15512 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.673875 15341 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.730494 15587 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:17.742347 15512 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.745146 15435 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.744164 16132 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:04:17.746970 16233 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:17.758234 15556 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4152881cdccb4731a3bd4a47c960307b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.766064 16077 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.771574 15435 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.776954 15511 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.800338 15435 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:17.802857 15340 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.812355 15587 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:17.815517 15407 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2b019444ffb4533ac4eb7baefd96ae7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.816349 16232 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.821192 15512 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.827072 16031 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.843777 16230 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.849264 15587 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.863803 15511 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:17.877344 15341 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.923372 16241 ts_tablet_manager.cc:933] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:17.928759 16241 tablet_copy_client.cc:323] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:04:17.950523 15528 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet ba3252dd04824c9ca1c0b6dfd9c7c387 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:04:17.951252 15528 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet ba3252dd04824c9ca1c0b6dfd9c7c387 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-ba3252dd04824c9ca1c0b6dfd9c7c387
I20260709 13:04:17.962026 15528 tablet_copy_source_session.cc:215] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:17.967096 16241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3252dd04824c9ca1c0b6dfd9c7c387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.983780 16241 tablet_copy_client.cc:806] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:17.984563 16241 tablet_copy_client.cc:670] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:17.991824 16241 tablet_copy_client.cc:538] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:17.992954 16207 heartbeater.cc:499] Master 127.13.245.126:46019 was elected leader, sending a full tablet report...
I20260709 13:04:18.007910 16241 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:18.033303 16241 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.034242 16241 tablet_bootstrap.cc:492] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:18.034988 16241 ts_tablet_manager.cc:1403] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.000s
I20260709 13:04:18.037807 16241 raft_consensus.cc:359] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:18.038645 16241 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:18.039295 16241 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:18.042529 16241 ts_tablet_manager.cc:1434] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.007s	user 0.010s	sys 0.000s
I20260709 13:04:18.044584 15528 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-ba3252dd04824c9ca1c0b6dfd9c7c387 received from {username='slave'} at 127.0.0.1:34302
I20260709 13:04:18.045145 15528 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-ba3252dd04824c9ca1c0b6dfd9c7c387 on tablet ba3252dd04824c9ca1c0b6dfd9c7c387 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:18.199604 16241 ts_tablet_manager.cc:933] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:18.204170 16241 tablet_copy_client.cc:323] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:04:18.219007 15453 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 75927b236d9342309d9e8c7a6a9b2f95 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:04:18.219698 15453 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 75927b236d9342309d9e8c7a6a9b2f95 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-75927b236d9342309d9e8c7a6a9b2f95
I20260709 13:04:18.223721 16249 ts_tablet_manager.cc:933] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:18.227757 15453 tablet_copy_source_session.cc:215] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:18.231534 16249 tablet_copy_client.cc:323] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:04:18.234076 15452 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet f2b019444ffb4533ac4eb7baefd96ae7 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:04:18.234808 15452 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet f2b019444ffb4533ac4eb7baefd96ae7 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-f2b019444ffb4533ac4eb7baefd96ae7
I20260709 13:04:18.236101 16241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75927b236d9342309d9e8c7a6a9b2f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.260320 15452 tablet_copy_source_session.cc:215] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:18.265748 16249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b019444ffb4533ac4eb7baefd96ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.279153 16241 tablet_copy_client.cc:806] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:18.280467 16241 tablet_copy_client.cc:670] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:18.287899 16249 tablet_copy_client.cc:806] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:18.288903 16249 tablet_copy_client.cc:670] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:18.290706 16241 tablet_copy_client.cc:538] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:18.295192 16249 tablet_copy_client.cc:538] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:18.304462 16241 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:18.308475 16249 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:18.356374 16241 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.358109 16241 tablet_bootstrap.cc:492] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:18.358918 16241 ts_tablet_manager.cc:1403] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.021s
I20260709 13:04:18.362262 16241 raft_consensus.cc:359] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:18.363246 16241 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:18.364142 16241 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:18.374528 16241 ts_tablet_manager.cc:1434] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:04:18.376060 16253 ts_tablet_manager.cc:933] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:18.389022 15452 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-75927b236d9342309d9e8c7a6a9b2f95 received from {username='slave'} at 127.0.0.1:47420
I20260709 13:04:18.389693 15452 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-75927b236d9342309d9e8c7a6a9b2f95 on tablet 75927b236d9342309d9e8c7a6a9b2f95 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:18.400107 16253 tablet_copy_client.cc:323] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.67:37005
I20260709 13:04:18.552937 16182 raft_consensus.cc:1217] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:18.563386 15602 tablet_copy_service.cc:140] P d225833a2cbf4a5995fdbbb1292d1918: Received BeginTabletCopySession request for tablet 4152881cdccb4731a3bd4a47c960307b from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:51310)
I20260709 13:04:18.564127 15602 tablet_copy_service.cc:161] P d225833a2cbf4a5995fdbbb1292d1918: Beginning new tablet copy session on tablet 4152881cdccb4731a3bd4a47c960307b from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:51310: session id = 6ff41728dec842afad5b53c20446a5a0-4152881cdccb4731a3bd4a47c960307b
I20260709 13:04:18.589044 15602 tablet_copy_source_session.cc:215] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:18.593451 16253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4152881cdccb4731a3bd4a47c960307b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.599728 16249 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.601303 16249 tablet_bootstrap.cc:492] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:18.605120 16249 ts_tablet_manager.cc:1403] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.297s	user 0.082s	sys 0.132s
I20260709 13:04:18.608610 16249 raft_consensus.cc:359] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:18.609572 16249 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:18.610404 16249 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:18.613176 16249 ts_tablet_manager.cc:1434] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:04:18.615108 15452 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-f2b019444ffb4533ac4eb7baefd96ae7 received from {username='slave'} at 127.0.0.1:47420
I20260709 13:04:18.615629 15452 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-f2b019444ffb4533ac4eb7baefd96ae7 on tablet f2b019444ffb4533ac4eb7baefd96ae7 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:18.621990 16253 tablet_copy_client.cc:806] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:18.622715 16253 tablet_copy_client.cc:670] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:18.631772 16182 raft_consensus.cc:1217] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:18.649827 16253 tablet_copy_client.cc:538] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:18.672997 16253 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
W20260709 13:04:18.674789 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43536.8us
I20260709 13:04:18.695631 16182 raft_consensus.cc:1217] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:18.715392 16253 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.716552 16253 tablet_bootstrap.cc:492] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:18.717338 16253 ts_tablet_manager.cc:1403] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.007s
I20260709 13:04:18.720815 16253 raft_consensus.cc:359] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:18.721772 16253 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:18.722455 16253 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:18.724992 16253 ts_tablet_manager.cc:1434] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:18.726989 15602 tablet_copy_service.cc:342] P d225833a2cbf4a5995fdbbb1292d1918: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-4152881cdccb4731a3bd4a47c960307b received from {username='slave'} at 127.0.0.1:51310
I20260709 13:04:18.727517 15602 tablet_copy_service.cc:434] P d225833a2cbf4a5995fdbbb1292d1918: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-4152881cdccb4731a3bd4a47c960307b on tablet 4152881cdccb4731a3bd4a47c960307b with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:18.922461 16182 raft_consensus.cc:1217] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:04:18.979285 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 45404.6us
I20260709 13:04:19.008837 16219 raft_consensus.cc:1064] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:19.011829 16219 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:19.023811 15587 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.023811 16182 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.026371 16219 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.026775 15434 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.027904 16068 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.048121 16219 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.079245 16257 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.093444 15436 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.096714 16182 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.133816 15584 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.135421 15340 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.198884 15512 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:19.200883 16260 raft_consensus.cc:1064] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:19.207264 16182 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.207315 16260 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:19.209405 16257 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.213155 15436 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.217063 16257 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:19.223683 16230 raft_consensus.cc:1064] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:19.226563 16068 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.228615 16182 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.239944 16230 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:19.248202 15584 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.250025 16181 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.250396 16260 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.250120 15509 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.250516 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba3252dd04824c9ca1c0b6dfd9c7c387 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:19.253489 16259 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.241595 15436 raft_consensus.cc:2955] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.259475 15338 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.265196 16260 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.281572 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet ba3252dd04824c9ca1c0b6dfd9c7c387 with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55290
I20260709 13:04:19.284461 16275 tablet_replica.cc:333] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:04:19.292557 16231 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.299314 15584 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.301776 16230 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.303395 16180 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.304991 15512 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.306473 16230 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.307525 16260 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.301654 16181 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.331892 15518 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.347720 16233 raft_consensus.cc:1064] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:19.353904 16233 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:19.418138 16231 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.452070 15341 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.467736 15509 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.475032 15585 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.482380 15590 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.482023 16182 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.500200 16182 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.515309 15518 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.515152 16280 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.519115 15434 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.521097 16132 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.525354 16281 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.526943 16275 raft_consensus.cc:2243] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.512503 15340 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.533054 16275 raft_consensus.cc:2272] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.562916 16275 ts_tablet_manager.cc:1916] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:19.619779 15435 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:19.638343 15434 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:19.642416 16181 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.646404 16260 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:19.650862 16181 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.655718 16180 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.656762 15585 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.659755 16260 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:19.662536 16260 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.670583 15585 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.673472 15509 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.678555 16231 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:19.682127 16231 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.686616 16180 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.644608 16280 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.698192 15585 raft_consensus.cc:2955] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.701323 16283 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.715598 16182 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.744897 15436 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.763531 15339 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.765869 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2b019444ffb4533ac4eb7baefd96ae7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:19.766463 16275 ts_tablet_manager.cc:1929] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:19.762956 15584 raft_consensus.cc:2955] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.767009 16275 log.cc:1199] T ba3252dd04824c9ca1c0b6dfd9c7c387 P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/ba3252dd04824c9ca1c0b6dfd9c7c387
I20260709 13:04:19.790158 15338 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.794780 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet 75927b236d9342309d9e8c7a6a9b2f95 with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40658
I20260709 13:04:19.791165 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet ba3252dd04824c9ca1c0b6dfd9c7c387 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:19.802254 15339 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.822203 16288 tablet_replica.cc:333] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:04:19.828143 16288 raft_consensus.cc:2243] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.829136 16288 raft_consensus.cc:2272] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.836076 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75927b236d9342309d9e8c7a6a9b2f95 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:19.834255 16288 ts_tablet_manager.cc:1916] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:19.843240 15584 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:19.860626 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b019444ffb4533ac4eb7baefd96ae7 with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40658
I20260709 13:04:19.868903 16182 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.872577 16246 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:19.879187 15512 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.880223 16288 ts_tablet_manager.cc:1929] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:19.880782 16288 log.cc:1199] T 75927b236d9342309d9e8c7a6a9b2f95 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/75927b236d9342309d9e8c7a6a9b2f95
I20260709 13:04:19.882699 16288 tablet_replica.cc:333] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:04:19.883963 16288 raft_consensus.cc:2243] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.884673 16288 raft_consensus.cc:2272] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.885066 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet 75927b236d9342309d9e8c7a6a9b2f95 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:19.885216 16281 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:19.890605 16132 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.895776 16182 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.903216 16288 ts_tablet_manager.cc:1916] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:19.902420 15509 raft_consensus.cc:2955] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.918638 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4152881cdccb4731a3bd4a47c960307b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:19.943511 16288 ts_tablet_manager.cc:1929] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:19.944123 16288 log.cc:1199] T f2b019444ffb4533ac4eb7baefd96ae7 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/f2b019444ffb4533ac4eb7baefd96ae7
I20260709 13:04:19.942744 15338 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:19.954281 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet f2b019444ffb4533ac4eb7baefd96ae7 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:19.966120 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet 4152881cdccb4731a3bd4a47c960307b with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46586
I20260709 13:04:19.968427 16289 tablet_replica.cc:333] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:04:19.969642 16289 raft_consensus.cc:2243] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.970556 16289 raft_consensus.cc:2272] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.973956 16289 ts_tablet_manager.cc:1916] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:19.990587 16289 ts_tablet_manager.cc:1929] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:19.990989 16289 log.cc:1199] T 4152881cdccb4731a3bd4a47c960307b P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/4152881cdccb4731a3bd4a47c960307b
I20260709 13:04:19.992749 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet 4152881cdccb4731a3bd4a47c960307b (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:21.040302 15509 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:04:21.049261 15482 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8f193cb849d4553a3e9a29aa592583a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.051025 15436 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:21.051208 15584 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:21.053148 16068 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.054081 16256 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.064138 16256 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.070402 15436 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.072741 15590 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.091145 15436 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:21.093154 15340 catalog_manager.cc:5697] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.102646 15590 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:21.108940 15407 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b48413efda34be880a83df9e239fb3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.111450 16231 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:21.112525 15512 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:21.115204 16290 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:21.123876 16290 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.125666 15584 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.153563 15584 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:21.162971 15512 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.169116 15509 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:21.175387 15436 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:21.183351 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8071c427f08433d8ffd6bd0809b1076. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.183015 15339 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.184288 16306 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:21.186601 16132 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.217309 16233 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.219501 15509 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.229204 15436 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.256228 15518 consensus_queue.cc:237] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:21.263849 15340 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
W20260709 13:04:21.274538 15482 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77b747e7ea77471f95bf6fbb4eb03bab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.275179 15435 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:21.276491 15584 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:21.281599 16293 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:21.283864 16256 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:21.317869 16068 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.320020 15436 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.330528 15584 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.347508 15339 catalog_manager.cc:5697] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:21.686806 16313 ts_tablet_manager.cc:933] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:21.696058 16313 tablet_copy_client.cc:323] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:04:21.700416 15528 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet d8f193cb849d4553a3e9a29aa592583a from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:04:21.701174 15528 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet d8f193cb849d4553a3e9a29aa592583a from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-d8f193cb849d4553a3e9a29aa592583a
I20260709 13:04:21.711057 15528 tablet_copy_source_session.cc:215] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:21.715863 16313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f193cb849d4553a3e9a29aa592583a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:21.727311 16315 ts_tablet_manager.cc:933] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:21.758795 16313 tablet_copy_client.cc:806] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:21.759706 16313 tablet_copy_client.cc:670] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:21.769832 16313 tablet_copy_client.cc:538] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:21.789592 16317 ts_tablet_manager.cc:933] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:21.796336 16313 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:21.808933 16315 tablet_copy_client.cc:323] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:04:21.814965 15452 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 3b48413efda34be880a83df9e239fb3c from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:04:21.815771 15452 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 3b48413efda34be880a83df9e239fb3c from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-3b48413efda34be880a83df9e239fb3c
I20260709 13:04:21.944832 16317 tablet_copy_client.cc:323] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.67:37005
I20260709 13:04:21.947415 15452 tablet_copy_source_session.cc:215] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:21.947654 15602 tablet_copy_service.cc:140] P d225833a2cbf4a5995fdbbb1292d1918: Received BeginTabletCopySession request for tablet f8071c427f08433d8ffd6bd0809b1076 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:51310)
I20260709 13:04:21.953228 15602 tablet_copy_service.cc:161] P d225833a2cbf4a5995fdbbb1292d1918: Beginning new tablet copy session on tablet f8071c427f08433d8ffd6bd0809b1076 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:51310: session id = 6ff41728dec842afad5b53c20446a5a0-f8071c427f08433d8ffd6bd0809b1076
I20260709 13:04:21.963483 15602 tablet_copy_source_session.cc:215] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:21.967881 16317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8071c427f08433d8ffd6bd0809b1076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:21.975126 16313 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.994575 16315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b48413efda34be880a83df9e239fb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:21.994901 16313 tablet_bootstrap.cc:492] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:21.995997 16313 ts_tablet_manager.cc:1403] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.200s	user 0.024s	sys 0.030s
I20260709 13:04:21.999588 16313 raft_consensus.cc:359] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:22.000473 16313 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:22.001166 16313 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:22.073935 16313 ts_tablet_manager.cc:1434] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.007s
I20260709 13:04:22.076538 15528 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-d8f193cb849d4553a3e9a29aa592583a received from {username='slave'} at 127.0.0.1:34302
I20260709 13:04:22.077052 15528 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-d8f193cb849d4553a3e9a29aa592583a on tablet d8f193cb849d4553a3e9a29aa592583a with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:22.170321 16326 ts_tablet_manager.cc:933] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:22.186918 16315 tablet_copy_client.cc:806] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:22.199733 16315 tablet_copy_client.cc:670] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
W20260709 13:04:22.188561 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 99018.4us
I20260709 13:04:22.189165 16326 tablet_copy_client.cc:323] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:04:22.198870 16317 tablet_copy_client.cc:806] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:22.209019 16317 tablet_copy_client.cc:670] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:22.212985 15528 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet 77b747e7ea77471f95bf6fbb4eb03bab from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:04:22.213665 15528 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet 77b747e7ea77471f95bf6fbb4eb03bab from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-77b747e7ea77471f95bf6fbb4eb03bab
I20260709 13:04:22.218114 16317 tablet_copy_client.cc:538] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:22.230037 16180 raft_consensus.cc:1217] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:22.227252 15528 tablet_copy_source_session.cc:215] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:22.244210 16326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b747e7ea77471f95bf6fbb4eb03bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:22.261963 16315 tablet_copy_client.cc:538] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:22.279620 16317 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
W20260709 13:04:22.288691 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47131.1us
I20260709 13:04:22.306106 16315 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:22.321478 16317 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:22.322753 16317 tablet_bootstrap.cc:492] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:22.323843 16317 ts_tablet_manager.cc:1403] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.014s
I20260709 13:04:22.332194 16317 raft_consensus.cc:359] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:22.333242 16317 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:22.334482 16317 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:22.337549 16317 ts_tablet_manager.cc:1434] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:04:22.339715 15602 tablet_copy_service.cc:342] P d225833a2cbf4a5995fdbbb1292d1918: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-f8071c427f08433d8ffd6bd0809b1076 received from {username='slave'} at 127.0.0.1:51310
I20260709 13:04:22.340217 15602 tablet_copy_service.cc:434] P d225833a2cbf4a5995fdbbb1292d1918: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-f8071c427f08433d8ffd6bd0809b1076 on tablet f8071c427f08433d8ffd6bd0809b1076 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:22.354743 16326 tablet_copy_client.cc:806] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:22.355649 16326 tablet_copy_client.cc:670] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:22.362246 16326 tablet_copy_client.cc:538] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:22.377120 16326 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:22.385519 16315 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:22.386761 16315 tablet_bootstrap.cc:492] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:22.387751 16315 ts_tablet_manager.cc:1403] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.082s	user 0.025s	sys 0.007s
I20260709 13:04:22.391812 16315 raft_consensus.cc:359] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:22.394151 16315 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:22.395011 16315 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:22.401983 16315 ts_tablet_manager.cc:1434] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:04:22.404824 15452 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-3b48413efda34be880a83df9e239fb3c received from {username='slave'} at 127.0.0.1:47420
I20260709 13:04:22.405347 15452 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-3b48413efda34be880a83df9e239fb3c on tablet 3b48413efda34be880a83df9e239fb3c with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:22.420480 16326 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:22.421581 16326 tablet_bootstrap.cc:492] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:22.422504 16326 ts_tablet_manager.cc:1403] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.010s
I20260709 13:04:22.426344 16326 raft_consensus.cc:359] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:22.427409 16326 raft_consensus.cc:740] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:22.428198 16326 consensus_queue.cc:260] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:22.430613 16326 ts_tablet_manager.cc:1434] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:04:22.433037 15528 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-77b747e7ea77471f95bf6fbb4eb03bab received from {username='slave'} at 127.0.0.1:34302
I20260709 13:04:22.433529 15528 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-77b747e7ea77471f95bf6fbb4eb03bab on tablet 77b747e7ea77471f95bf6fbb4eb03bab with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:22.706091 16180 raft_consensus.cc:1217] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:22.810899 16320 raft_consensus.cc:1064] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:22.813508 16320 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:22.819694 16180 raft_consensus.cc:1217] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:22.835807 15591 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.836845 16180 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.840363 16256 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.841066 15434 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.844630 16320 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:22.856125 16320 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:22.881229 16256 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:22.886019 16180 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:22.898330 15435 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:22.928841 16182 raft_consensus.cc:1217] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:22.946528 15340 catalog_manager.cc:5697] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:04:22.978300 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 45512.7us
I20260709 13:04:22.982672 15591 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.043299 15513 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:23.054183 16180 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.054955 15591 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.055649 16292 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:23.058059 16320 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:23.071166 16256 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.076503 16180 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.086822 15591 raft_consensus.cc:2955] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.089609 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8f193cb849d4553a3e9a29aa592583a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:23.093014 15341 catalog_manager.cc:5697] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.109488 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet d8f193cb849d4553a3e9a29aa592583a with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46586
I20260709 13:04:23.136227 16344 tablet_replica.cc:333] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:04:23.138262 16344 raft_consensus.cc:2243] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.140600 16344 raft_consensus.cc:2272] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.145769 16344 ts_tablet_manager.cc:1916] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.172020 16344 ts_tablet_manager.cc:1929] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:23.173696 16344 log.cc:1199] T d8f193cb849d4553a3e9a29aa592583a P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/d8f193cb849d4553a3e9a29aa592583a
I20260709 13:04:23.176478 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet d8f193cb849d4553a3e9a29aa592583a (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:23.203804 16309 raft_consensus.cc:1064] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:23.206743 16309 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:23.220162 16180 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.222119 15435 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.225772 16309 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:23.227434 15513 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.227970 16328 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:23.232328 16329 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:23.257352 16309 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.258997 15509 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.282513 16180 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.301097 15341 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.324664 15435 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.338459 15585 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:23.347453 16180 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.352689 16329 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:23.355768 15435 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.357610 16329 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:23.370808 16180 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.372318 15434 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.372709 16328 raft_consensus.cc:2955] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.395570 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8071c427f08433d8ffd6bd0809b1076 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:23.410144 15339 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.417659 16283 raft_consensus.cc:1064] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:23.420900 16283 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:23.422899 16292 raft_consensus.cc:1064] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:23.425976 16292 consensus_queue.cc:237] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:23.441870 15585 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.444818 16180 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.445482 16182 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.447193 16339 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:23.447953 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet f8071c427f08433d8ffd6bd0809b1076 with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40658
I20260709 13:04:23.453346 16349 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:23.455642 15435 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.454044 15513 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.456704 16231 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:23.458863 16353 tablet_replica.cc:333] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:04:23.465193 16353 raft_consensus.cc:2243] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.469043 16353 raft_consensus.cc:2272] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.454044 15585 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:23.478720 16325 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:23.471989 16292 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:23.521441 16325 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.524636 16339 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:23.527246 16180 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.555869 15339 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.557742 15513 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.511883 16353 ts_tablet_manager.cc:1916] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.583016 15591 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.591985 16292 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.593370 15440 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:23.605978 16353 ts_tablet_manager.cc:1929] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:23.606639 16353 log.cc:1199] T f8071c427f08433d8ffd6bd0809b1076 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/f8071c427f08433d8ffd6bd0809b1076
I20260709 13:04:23.613328 16180 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.615358 16283 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:23.626322 16283 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.631769 16182 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.636500 15513 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:04:23.636627 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 45368.3us
I20260709 13:04:23.640441 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b48413efda34be880a83df9e239fb3c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:23.657864 15341 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.663348 16325 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:23.668246 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet f8071c427f08433d8ffd6bd0809b1076 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:23.674149 15435 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.690038 15513 raft_consensus.cc:2955] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.700914 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b48413efda34be880a83df9e239fb3c with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55290
I20260709 13:04:23.730572 15339 catalog_manager.cc:5697] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.731750 16182 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.736713 16361 tablet_replica.cc:333] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:04:23.739871 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 58072.4us
I20260709 13:04:23.740756 16361 raft_consensus.cc:2243] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.746526 16361 raft_consensus.cc:2272] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.762569 15590 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.767175 16361 ts_tablet_manager.cc:1916] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.771723 15513 consensus_queue.cc:237] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:23.814545 16182 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.815853 15590 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.816540 16339 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:23.819450 16339 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:23.832340 16320 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.834511 15591 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.841265 16361 ts_tablet_manager.cc:1929] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:23.841951 16361 log.cc:1199] T 3b48413efda34be880a83df9e239fb3c P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/3b48413efda34be880a83df9e239fb3c
I20260709 13:04:23.844138 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet 3b48413efda34be880a83df9e239fb3c (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:23.843322 16182 raft_consensus.cc:2955] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:23.855196 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77b747e7ea77471f95bf6fbb4eb03bab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:23.867317 15339 catalog_manager.cc:5697] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.883396 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet 77b747e7ea77471f95bf6fbb4eb03bab with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46586
I20260709 13:04:23.885526 16362 tablet_replica.cc:333] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:04:23.886480 16362 raft_consensus.cc:2243] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.887223 16362 raft_consensus.cc:2272] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.890869 16362 ts_tablet_manager.cc:1916] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.907789 16362 ts_tablet_manager.cc:1929] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:23.908254 16362 log.cc:1199] T 77b747e7ea77471f95bf6fbb4eb03bab P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/77b747e7ea77471f95bf6fbb4eb03bab
I20260709 13:04:23.909912 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet 77b747e7ea77471f95bf6fbb4eb03bab (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:24.963291 15509 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:04:24.972862 15482 consensus_peers.cc:597] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 653fb1b09eaf49f98c8993fbea783b3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.973843 15440 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.974480 15590 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.976688 16320 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.977734 16292 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.986779 16320 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:24.988818 15590 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:24.994164 15435 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.006579 15440 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:25.020526 15340 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:25.046988 15407 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 496a555ec7cc49798fc4d775f6d151ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.048560 15591 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:25.049913 15509 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:25.052099 16325 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.053186 16368 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:25.091872 16325 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.094446 15509 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.107450 15591 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.117758 15440 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:25.153477 15341 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.172564 15513 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:25.174242 16368 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:25.176959 15407 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b48cca7667444b8c8bb999a280076795. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.178968 15591 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:25.180696 16368 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:25.192802 15509 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.192672 16325 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.210268 15591 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.219988 15509 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:25.217571 15340 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.247715 15440 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:25.248000 15482 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc4f3caf80c04c18bd2d225b9e630e92. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.248939 15590 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:25.249526 16292 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.251006 16320 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.262327 16339 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.264241 15590 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.272468 15436 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.284255 15341 catalog_manager.cc:5697] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:25.496155 16382 ts_tablet_manager.cc:933] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:25.498486 16382 tablet_copy_client.cc:323] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:04:25.500995 15528 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet 653fb1b09eaf49f98c8993fbea783b3d from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:04:25.501561 15528 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet 653fb1b09eaf49f98c8993fbea783b3d from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-653fb1b09eaf49f98c8993fbea783b3d
I20260709 13:04:25.510653 15528 tablet_copy_source_session.cc:215] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:25.514557 16382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653fb1b09eaf49f98c8993fbea783b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:25.531333 16382 tablet_copy_client.cc:806] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:25.531994 16382 tablet_copy_client.cc:670] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:25.535810 16382 tablet_copy_client.cc:538] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:25.544462 16382 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:25.571161 16382 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.572749 16382 tablet_bootstrap.cc:492] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:25.573783 16382 ts_tablet_manager.cc:1403] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.008s
I20260709 13:04:25.582608 16382 raft_consensus.cc:359] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:25.583781 16382 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:25.584887 16386 ts_tablet_manager.cc:933] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:25.584574 16382 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:25.595386 16382 ts_tablet_manager.cc:1434] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.008s
I20260709 13:04:25.599105 15528 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-653fb1b09eaf49f98c8993fbea783b3d received from {username='slave'} at 127.0.0.1:34302
I20260709 13:04:25.599648 15528 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-653fb1b09eaf49f98c8993fbea783b3d on tablet 653fb1b09eaf49f98c8993fbea783b3d with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:25.600538 16386 tablet_copy_client.cc:323] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:04:25.604401 15452 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 496a555ec7cc49798fc4d775f6d151ed from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:04:25.605268 15452 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 496a555ec7cc49798fc4d775f6d151ed from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-496a555ec7cc49798fc4d775f6d151ed
I20260709 13:04:25.621979 15452 tablet_copy_source_session.cc:215] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:25.634246 16386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496a555ec7cc49798fc4d775f6d151ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:25.729743 16382 ts_tablet_manager.cc:933] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:25.767019 16382 tablet_copy_client.cc:323] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:04:25.793419 16386 tablet_copy_client.cc:806] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:25.810966 16392 ts_tablet_manager.cc:933] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:25.811937 16386 tablet_copy_client.cc:670] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:25.830344 16392 tablet_copy_client.cc:323] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:04:25.832443 15452 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet b48cca7667444b8c8bb999a280076795 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:04:25.836292 15452 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet b48cca7667444b8c8bb999a280076795 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-b48cca7667444b8c8bb999a280076795
I20260709 13:04:25.857275 15452 tablet_copy_source_session.cc:215] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:25.860855 16386 tablet_copy_client.cc:538] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:25.863811 15528 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet dc4f3caf80c04c18bd2d225b9e630e92 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:04:25.864698 15528 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet dc4f3caf80c04c18bd2d225b9e630e92 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-dc4f3caf80c04c18bd2d225b9e630e92
I20260709 13:04:25.877786 16382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b48cca7667444b8c8bb999a280076795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:25.886013 16386 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:25.900928 15528 tablet_copy_source_session.cc:215] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:25.911863 16392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4f3caf80c04c18bd2d225b9e630e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:25.964890 16386 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.977417 16382 tablet_copy_client.cc:806] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:25.978425 16382 tablet_copy_client.cc:670] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:25.978575 16386 tablet_bootstrap.cc:492] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:25.979751 16386 ts_tablet_manager.cc:1403] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.094s	user 0.025s	sys 0.030s
I20260709 13:04:25.987092 16382 tablet_copy_client.cc:538] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:25.989733 16386 raft_consensus.cc:359] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:25.991676 16386 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:25.992784 16386 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:26.021797 16386 ts_tablet_manager.cc:1434] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:04:26.027486 16382 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:26.037806 15452 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-496a555ec7cc49798fc4d775f6d151ed received from {username='slave'} at 127.0.0.1:47420
I20260709 13:04:26.038535 15452 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-496a555ec7cc49798fc4d775f6d151ed on tablet 496a555ec7cc49798fc4d775f6d151ed with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:26.050088 16392 tablet_copy_client.cc:806] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:26.051008 16392 tablet_copy_client.cc:670] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:26.059932 16392 tablet_copy_client.cc:538] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:26.080503 16392 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:26.084381 16382 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:26.087507 16382 tablet_bootstrap.cc:492] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:26.088518 16382 ts_tablet_manager.cc:1403] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.006s
I20260709 13:04:26.092635 16382 raft_consensus.cc:359] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:26.093730 16382 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:26.094571 16382 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:26.096760 16382 ts_tablet_manager.cc:1434] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:26.102931 15452 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-b48cca7667444b8c8bb999a280076795 received from {username='slave'} at 127.0.0.1:47420
I20260709 13:04:26.103660 15452 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-b48cca7667444b8c8bb999a280076795 on tablet b48cca7667444b8c8bb999a280076795 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:26.109906 16182 raft_consensus.cc:1217] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:26.123657 16180 raft_consensus.cc:1217] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:26.147693 16392 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:26.153379 16392 tablet_bootstrap.cc:492] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:26.154992 16392 ts_tablet_manager.cc:1403] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.014s
I20260709 13:04:26.159296 16392 raft_consensus.cc:359] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:26.161628 16392 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:26.162590 16392 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:26.165766 16392 ts_tablet_manager.cc:1434] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:04:26.168632 15528 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-dc4f3caf80c04c18bd2d225b9e630e92 received from {username='slave'} at 127.0.0.1:34302
I20260709 13:04:26.169221 15528 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-dc4f3caf80c04c18bd2d225b9e630e92 on tablet dc4f3caf80c04c18bd2d225b9e630e92 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:26.188476 16180 raft_consensus.cc:1217] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:26.320770 16180 raft_consensus.cc:1217] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:26.572952 16325 raft_consensus.cc:1064] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:26.575994 16325 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:26.598564 15585 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.601398 16325 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.601928 15513 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.602828 16180 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.603627 16393 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.609135 16389 raft_consensus.cc:1064] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:26.609654 16377 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.612661 16389 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:26.645991 16325 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:26.649109 15590 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:26.650696 15585 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.651950 16180 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.652406 15435 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.653455 16292 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.655479 16292 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.656572 16339 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.659198 15513 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:26.675858 15339 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:26.696213 16339 raft_consensus.cc:1064] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:26.759364 16182 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:26.772590 16339 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:26.868611 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 56017.2us
I20260709 13:04:26.872149 16389 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:26.879426 16415 raft_consensus.cc:1064] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:26.890543 16415 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:26.919370 16182 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.924156 15584 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.927211 16182 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.928565 15513 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.929178 16393 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.932984 16412 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.939944 15584 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.943167 16414 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.954727 15435 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.961143 15584 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:26.967773 16180 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.031931 16292 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:27.045727 16421 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:04:27.054441 16415 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.060149 15509 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.092114 16411 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:27.092993 15434 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.101106 16411 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:27.122757 15337 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.139724 15437 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:27.149698 15590 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.149641 16181 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.175271 16182 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:27.177698 15509 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:27.179903 16417 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.194532 16414 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.198107 16417 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.206260 16182 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.215342 15509 raft_consensus.cc:2955] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.229019 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 496a555ec7cc49798fc4d775f6d151ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:27.240027 15341 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.282919 16389 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.286172 15338 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.286549 16180 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.299165 15509 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:27.299342 15437 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:27.313750 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet 496a555ec7cc49798fc4d775f6d151ed with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55290
I20260709 13:04:27.334128 15440 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.340387 16180 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:27.344329 15590 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:27.340309 15338 catalog_manager.cc:5697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.351809 16412 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.357622 16414 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.361666 16180 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:27.362313 15440 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:27.373762 16412 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.381357 15587 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.381225 15584 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.399931 16431 tablet_replica.cc:333] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:04:27.401589 16431 raft_consensus.cc:2243] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:27.403126 16431 raft_consensus.cc:2272] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:27.407428 16431 ts_tablet_manager.cc:1916] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:27.412216 16389 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.424320 16410 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.409279 16180 raft_consensus.cc:2955] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.427047 15341 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.462086 16431 ts_tablet_manager.cc:1929] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:27.462952 16431 log.cc:1199] T 496a555ec7cc49798fc4d775f6d151ed P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/496a555ec7cc49798fc4d775f6d151ed
I20260709 13:04:27.465737 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet 496a555ec7cc49798fc4d775f6d151ed (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:27.470769 15509 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:27.473484 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet b48cca7667444b8c8bb999a280076795 with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40658
I20260709 13:04:27.479811 16432 tablet_replica.cc:333] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:04:27.481312 16432 raft_consensus.cc:2243] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:27.482195 16432 raft_consensus.cc:2272] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:27.507035 16180 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:27.507143 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b48cca7667444b8c8bb999a280076795 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:27.513383 16339 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.514923 15584 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:27.518363 16418 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.523590 16432 ts_tablet_manager.cc:1916] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:27.535929 15435 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.538957 16411 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.543041 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 653fb1b09eaf49f98c8993fbea783b3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:27.529024 16180 raft_consensus.cc:2955] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.547408 16389 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.549863 15340 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.558681 16182 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.567256 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet 653fb1b09eaf49f98c8993fbea783b3d with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55290
I20260709 13:04:27.568486 16431 tablet_replica.cc:333] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:04:27.569835 16431 raft_consensus.cc:2243] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:27.570816 16431 raft_consensus.cc:2272] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:27.574555 15587 raft_consensus.cc:2955] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.582371 16431 ts_tablet_manager.cc:1916] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:27.604588 16432 ts_tablet_manager.cc:1929] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:27.606099 16432 log.cc:1199] T b48cca7667444b8c8bb999a280076795 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/b48cca7667444b8c8bb999a280076795
I20260709 13:04:27.620751 15337 catalog_manager.cc:5697] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:27.628167 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dc4f3caf80c04c18bd2d225b9e630e92 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:27.629127 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet b48cca7667444b8c8bb999a280076795 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:27.647099 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet dc4f3caf80c04c18bd2d225b9e630e92 with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46586
I20260709 13:04:27.651990 16433 tablet_replica.cc:333] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:04:27.653613 16433 raft_consensus.cc:2243] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:27.654628 16433 raft_consensus.cc:2272] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:27.654752 16431 ts_tablet_manager.cc:1929] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:27.655319 16431 log.cc:1199] T 653fb1b09eaf49f98c8993fbea783b3d P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/653fb1b09eaf49f98c8993fbea783b3d
I20260709 13:04:27.659394 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet 653fb1b09eaf49f98c8993fbea783b3d (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:27.665208 16433 ts_tablet_manager.cc:1916] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:27.683854 16433 ts_tablet_manager.cc:1929] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:27.684233 16433 log.cc:1199] T dc4f3caf80c04c18bd2d225b9e630e92 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/dc4f3caf80c04c18bd2d225b9e630e92
I20260709 13:04:27.686343 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet dc4f3caf80c04c18bd2d225b9e630e92 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:28.789783 15440 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:28.798210 15584 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.798264 15509 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:28.798838 15407 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dc152f2e639487986baac02b0324f06. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.800110 16414 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.801290 16415 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.812215 16414 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.814975 15509 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.825341 15584 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.848732 15340 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.850737 15587 consensus_queue.cc:237] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:04:28.870999 15556 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65c950883b754dd6bb39c54f8c8134aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.873412 15435 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.882169 16435 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:28.882472 15509 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.887233 16442 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:28.899686 16442 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.906361 15512 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.909324 15435 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.923630 15513 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:28.932660 15341 catalog_manager.cc:5697] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.951982 15587 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.955279 16389 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:04:28.964927 15482 consensus_peers.cc:597] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c098e199a9c74c79bc225b7ce9d73ff4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.967025 15435 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.969859 16389 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:28.981006 16389 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.984338 15584 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:28.997467 15435 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:29.014114 15440 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.010146 15341 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:29.040799 15584 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:29.042656 15407 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41cabc9d5f694971847d85f82e81df84. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.043645 16449 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.044466 15512 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.045864 16449 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.053761 16414 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:29.055260 15584 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:29.064543 15513 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:29.075028 15341 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:29.282366 16455 ts_tablet_manager.cc:933] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:29.284962 16455 tablet_copy_client.cc:323] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.67:37005
I20260709 13:04:29.289502 15602 tablet_copy_service.cc:140] P d225833a2cbf4a5995fdbbb1292d1918: Received BeginTabletCopySession request for tablet 65c950883b754dd6bb39c54f8c8134aa from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:51310)
I20260709 13:04:29.290263 15602 tablet_copy_service.cc:161] P d225833a2cbf4a5995fdbbb1292d1918: Beginning new tablet copy session on tablet 65c950883b754dd6bb39c54f8c8134aa from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:51310: session id = 6ff41728dec842afad5b53c20446a5a0-65c950883b754dd6bb39c54f8c8134aa
I20260709 13:04:29.300781 15602 tablet_copy_source_session.cc:215] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:29.310910 16455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c950883b754dd6bb39c54f8c8134aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.338632 16455 tablet_copy_client.cc:806] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:29.339452 16455 tablet_copy_client.cc:670] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:29.345134 16455 tablet_copy_client.cc:538] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:29.355921 16455 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:29.422221 16459 ts_tablet_manager.cc:933] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:29.438774 16457 ts_tablet_manager.cc:933] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:29.443202 16459 tablet_copy_client.cc:323] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:04:29.446363 15528 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet c098e199a9c74c79bc225b7ce9d73ff4 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:04:29.447062 15528 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet c098e199a9c74c79bc225b7ce9d73ff4 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-c098e199a9c74c79bc225b7ce9d73ff4
I20260709 13:04:29.454619 16455 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:29.456249 16455 tablet_bootstrap.cc:492] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:29.457438 16455 ts_tablet_manager.cc:1403] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.029s
I20260709 13:04:29.461609 16455 raft_consensus.cc:359] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.463160 16455 raft_consensus.cc:740] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:29.466141 16455 consensus_queue.cc:260] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.479678 15528 tablet_copy_source_session.cc:215] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:29.484543 16457 tablet_copy_client.cc:323] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:04:29.485749 16459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c098e199a9c74c79bc225b7ce9d73ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.487680 15452 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 8dc152f2e639487986baac02b0324f06 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:04:29.488294 15452 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 8dc152f2e639487986baac02b0324f06 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-8dc152f2e639487986baac02b0324f06
I20260709 13:04:29.506389 15452 tablet_copy_source_session.cc:215] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:29.508268 16455 ts_tablet_manager.cc:1434] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.011s
I20260709 13:04:29.510367 16457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc152f2e639487986baac02b0324f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.512964 15602 tablet_copy_service.cc:342] P d225833a2cbf4a5995fdbbb1292d1918: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-65c950883b754dd6bb39c54f8c8134aa received from {username='slave'} at 127.0.0.1:51310
I20260709 13:04:29.513571 15602 tablet_copy_service.cc:434] P d225833a2cbf4a5995fdbbb1292d1918: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-65c950883b754dd6bb39c54f8c8134aa on tablet 65c950883b754dd6bb39c54f8c8134aa with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:29.523831 16459 tablet_copy_client.cc:806] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:29.524609 16459 tablet_copy_client.cc:670] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:29.529162 16459 tablet_copy_client.cc:538] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:29.540649 16459 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:29.557670 16455 ts_tablet_manager.cc:933] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:29.560662 16455 tablet_copy_client.cc:323] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:04:29.563895 15452 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 41cabc9d5f694971847d85f82e81df84 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:04:29.564549 15452 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 41cabc9d5f694971847d85f82e81df84 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-41cabc9d5f694971847d85f82e81df84
I20260709 13:04:29.573922 16459 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:29.575171 16459 tablet_bootstrap.cc:492] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:29.576045 16459 ts_tablet_manager.cc:1403] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.007s
I20260709 13:04:29.578837 16457 tablet_copy_client.cc:806] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:29.579628 16457 tablet_copy_client.cc:670] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:29.583791 15452 tablet_copy_source_session.cc:215] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:29.579730 16459 raft_consensus.cc:359] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.588378 16457 tablet_copy_client.cc:538] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:29.590289 16455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41cabc9d5f694971847d85f82e81df84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.586458 16459 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:29.595013 16459 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.600239 16457 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:29.601085 16459 ts_tablet_manager.cc:1434] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 13:04:29.603212 15528 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-c098e199a9c74c79bc225b7ce9d73ff4 received from {username='slave'} at 127.0.0.1:34302
I20260709 13:04:29.603745 15528 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-c098e199a9c74c79bc225b7ce9d73ff4 on tablet c098e199a9c74c79bc225b7ce9d73ff4 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:29.633342 16455 tablet_copy_client.cc:806] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:29.634213 16455 tablet_copy_client.cc:670] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:29.638667 16455 tablet_copy_client.cc:538] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:29.651379 16455 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:29.652133 16457 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:29.653496 16457 tablet_bootstrap.cc:492] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:29.654311 16457 ts_tablet_manager.cc:1403] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.014s
I20260709 13:04:29.658910 16457 raft_consensus.cc:359] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.660775 16457 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:29.662233 16457 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.667138 16457 ts_tablet_manager.cc:1434] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:04:29.669850 15452 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-8dc152f2e639487986baac02b0324f06 received from {username='slave'} at 127.0.0.1:47420
I20260709 13:04:29.670426 15452 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-8dc152f2e639487986baac02b0324f06 on tablet 8dc152f2e639487986baac02b0324f06 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:29.699577 16455 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:29.702368 16455 tablet_bootstrap.cc:492] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:29.703400 16455 ts_tablet_manager.cc:1403] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.022s
I20260709 13:04:29.707207 16455 raft_consensus.cc:359] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.708244 16455 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:29.708971 16455 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:29.721405 16455 ts_tablet_manager.cc:1434] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:04:29.725273 15452 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-41cabc9d5f694971847d85f82e81df84 received from {username='slave'} at 127.0.0.1:47420
I20260709 13:04:29.725831 15452 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-41cabc9d5f694971847d85f82e81df84 on tablet 41cabc9d5f694971847d85f82e81df84 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:29.788168 16180 raft_consensus.cc:1217] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:29.816687 16179 raft_consensus.cc:1217] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:29.817545 16180 raft_consensus.cc:1217] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:29.949985 16180 raft_consensus.cc:1217] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:04:30.258862 16389 raft_consensus.cc:1064] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:30.261950 16468 raft_consensus.cc:1064] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:30.266930 16389 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:30.270251 16468 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:30.285418 16179 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.288952 15584 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.289449 15512 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.292335 16179 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.292721 15584 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.288187 16467 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:04:30.294929 15435 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.294878 16414 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.296877 16434 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:30.297011 16449 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:30.312664 16434 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.313931 16413 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:30.350569 16400 raft_consensus.cc:1064] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:30.352336 15513 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.353821 16400 consensus_queue.cc:237] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:30.359266 16468 raft_consensus.cc:1064] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:30.362160 16468 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:30.350168 16414 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.405006 15341 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.433421 15512 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:30.436203 16467 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.452937 16389 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:04:30.469055 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 99712.6us
I20260709 13:04:30.475737 16180 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:30.490036 16467 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.493300 15584 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:30.502285 15584 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.509225 15341 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:30.521885 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 65120.1us
I20260709 13:04:30.535879 16448 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.546090 16180 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.546082 15587 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.562319 15435 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.571956 15511 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:30.598407 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54567.7us
I20260709 13:04:30.639297 16179 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:30.651412 16473 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:30.656526 16467 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.663102 15437 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:30.672447 16181 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.672571 15437 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.674862 16486 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.675284 15512 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:30.678061 16486 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.691967 16181 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.702059 16486 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.702206 15435 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:30.718621 16180 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.719163 15585 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.753331 15341 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.763096 16434 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:30.766232 16389 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:04:30.799383 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 77706.5us
W20260709 13:04:30.809444 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50153.8us
I20260709 13:04:30.817497 15512 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.821758 16483 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.827482 15437 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.836118 15585 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:30.838402 16179 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:30.838737 15341 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.843474 15435 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:30.865080 16414 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:04:30.852005 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet c098e199a9c74c79bc225b7ce9d73ff4 with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55290
I20260709 13:04:30.885406 16448 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:30.903872 16414 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.907035 15584 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.925242 16179 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.926746 16180 raft_consensus.cc:2955] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.932446 16181 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:30.945766 15341 catalog_manager.cc:5697] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.960415 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8dc152f2e639487986baac02b0324f06 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:30.961230 16496 tablet_replica.cc:333] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:04:30.973311 15584 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:04:30.971485 16180 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:04:30.975965 16414 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:04:30.990785 16467 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:30.977763 16496 raft_consensus.cc:2243] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.993934 16496 raft_consensus.cc:2272] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:31.010339 15340 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 1 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.011864 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c098e199a9c74c79bc225b7ce9d73ff4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:31.021462 16467 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.032866 16180 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.039414 15585 raft_consensus.cc:2955] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.055187 15340 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.069854 16496 ts_tablet_manager.cc:1916] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:31.144248 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41cabc9d5f694971847d85f82e81df84 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:04:31.165302 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 89822.9us
I20260709 13:04:31.191757 15585 consensus_queue.cc:237] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:31.198546 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dc152f2e639487986baac02b0324f06 with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40658
I20260709 13:04:31.198709 15504 tablet_service.cc:1558] Processing DeleteTablet for tablet 41cabc9d5f694971847d85f82e81df84 with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40658
I20260709 13:04:31.202597 16179 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:31.205453 15512 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.207753 16486 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:31.218107 16499 tablet_replica.cc:333] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:04:31.217393 16398 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.223069 16180 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.226248 16499 raft_consensus.cc:2243] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:31.245776 16499 raft_consensus.cc:2272] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:31.242897 16496 ts_tablet_manager.cc:1929] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:31.267781 15340 catalog_manager.cc:5697] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.272758 15440 raft_consensus.cc:2955] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.274179 16499 ts_tablet_manager.cc:1916] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:31.276317 16496 log.cc:1199] T c098e199a9c74c79bc225b7ce9d73ff4 P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/c098e199a9c74c79bc225b7ce9d73ff4
I20260709 13:04:31.278571 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet c098e199a9c74c79bc225b7ce9d73ff4 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:31.286126 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c950883b754dd6bb39c54f8c8134aa with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46586
W20260709 13:04:31.304730 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 48673.7us
I20260709 13:04:31.309289 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65c950883b754dd6bb39c54f8c8134aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:31.322902 15512 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:31.346122 16501 tablet_replica.cc:333] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:04:31.346715 16499 ts_tablet_manager.cc:1929] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:31.348508 16499 log.cc:1199] T 8dc152f2e639487986baac02b0324f06 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/8dc152f2e639487986baac02b0324f06
I20260709 13:04:31.347918 16501 raft_consensus.cc:2243] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:31.350700 16499 tablet_replica.cc:333] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:04:31.350911 16501 raft_consensus.cc:2272] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:31.352157 16499 raft_consensus.cc:2243] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:31.353235 16499 raft_consensus.cc:2272] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:31.357848 16499 ts_tablet_manager.cc:1916] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:31.361886 16501 ts_tablet_manager.cc:1916] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:31.368028 16398 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:04:31.369952 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet 8dc152f2e639487986baac02b0324f06 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:31.386989 16499 ts_tablet_manager.cc:1929] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:04:31.387722 16499 log.cc:1199] T 41cabc9d5f694971847d85f82e81df84 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/41cabc9d5f694971847d85f82e81df84
I20260709 13:04:31.394079 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet 41cabc9d5f694971847d85f82e81df84 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:31.398128 16501 ts_tablet_manager.cc:1929] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:31.397330 15512 raft_consensus.cc:2955] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:31.407930 16501 log.cc:1199] T 65c950883b754dd6bb39c54f8c8134aa P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/65c950883b754dd6bb39c54f8c8134aa
I20260709 13:04:31.411711 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet 65c950883b754dd6bb39c54f8c8134aa (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:32.366830 15584 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:04:32.379284 15556 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58702c00fb4641ec8337a916d4579ec9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:32.380807 15511 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:32.381135 15437 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:32.382332 16498 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.383315 16483 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.393854 16498 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.397372 15511 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.398294 15437 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.419579 15511 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:32.430428 15340 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.439417 15584 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:32.441814 16473 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.442222 15440 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:32.445251 15482 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66d8364b020b43deb510a118a19d076a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:32.446727 16473 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.455367 16503 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.466882 15584 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.483160 15590 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:32.489142 15440 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.497586 15511 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.499828 16498 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:32.504316 15437 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:32.510131 15556 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 952f15e68b0745e5a8ca26a3b527cab0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:32.511281 15340 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.512441 16483 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:32.558740 16498 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.560532 15512 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.563076 15437 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.577666 15512 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:32.597255 15337 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.604197 15590 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:32.604837 15482 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a42725e017f142629708ff226f2d53e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:32.607286 15437 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:32.612040 16473 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:32.615962 16473 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:32.649349 16473 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.687381 15590 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.763199 15440 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:04:32.790563 15340 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:33.725759 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 491565us
I20260709 13:04:33.746500 16523 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:33.747469 16523 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.750353 16523 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.826234 16524 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:33.828052 16524 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.831276 16524 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.869700 16535 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:33.870661 16535 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:33.879048 16533 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:33.881645 16533 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.903111 16533 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.904138 16524 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:33.904642 15340 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 195) took 1126 ms. Trace:
I20260709 13:04:33.904987 16533 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:33.904920 16524 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.905656 16533 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.906873 16531 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:33.907466 16524 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.907585 16531 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.908864 16538 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:33.910204 16531 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.893715 16529 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:33.897426 16523 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:33.898027 16515 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:33.911705 16529 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.911857 16523 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.911968 16515 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.913793 16536 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:33.914137 16529 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.914548 16515 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.900110 16535 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.883358 16534 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:33.915778 16534 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.910555 16538 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:33.918305 16534 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:33.914460 16536 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.916313 16523 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.910944 16528 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:33.921247 16539 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:33.921492 16528 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:33.905203 15340 rpcz_store.cc:276] 0709 13:04:32.778608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.778785 (+   177us) service_pool.cc:224] Handling call
0709 13:04:33.904547 (+1125762us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:32.794453 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:32.795034 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:32.795068 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:04:32.795088 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:32.795441 (+   353us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:32.795505 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:32.795535 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:32.795839 (+   304us) tablet.cc:701] Row locks acquired
0709 13:04:32.795863 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:04:32.796096 (+   233us) write_op.cc:270] Start()
0709 13:04:32.796270 (+   174us) write_op.cc:276] Timestamp: P: 1783602272796033 usec, L: 0
0709 13:04:32.796299 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:04:32.797218 (+   919us) log.cc:844] Serialized 598 byte log entry
0709 13:04:32.799371 (+  2153us) op_driver.cc:464] REPLICATION: finished
0709 13:04:32.799794 (+   423us) write_op.cc:301] APPLY: starting
0709 13:04:32.799887 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:32.800017 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:32.800154 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:32.800435 (+   281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:32.800606 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:32.800657 (+    51us) write_op.cc:312] APPLY: finished
0709 13:04:32.800868 (+   211us) log.cc:844] Serialized 22 byte log entry
0709 13:04:32.801066 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:32.801156 (+    90us) write_op.cc:454] Released schema lock
0709 13:04:32.801223 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:32.801557 (+   334us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:32.801587 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1863,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":186,"apply.run_cpu_time_us":1731,"apply.run_wall_time_us":1730,"num_ops":1,"prepare.queue_time_us":180,"prepare.run_cpu_time_us":3132,"prepare.run_wall_time_us":4823,"replication_time_us":2919}]]}
I20260709 13:04:33.923821 16536 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:33.921885 16539 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.924886 16538 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:33.926120 16541 ts_tablet_manager.cc:933] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:33.925981 16528 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.924921 16533 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.938644 16534 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:33.960978 16534 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:33.961979 16539 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:33.963929 16534 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:33.946727 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:33.965143 16544 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:33.965771 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:33.941180 16498 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:33.968034 16536 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:33.972232 16536 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.973387 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:33.975034 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:33.975373 16498 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.888149 16537 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:33.951197 15556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.033s	sys 0.019s
I20260709 13:04:33.970736 15512 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
W20260709 13:04:33.980602 15556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.196s	user 0.036s	sys 0.020s
W20260709 13:04:33.981050 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 1.19694e+06us
I20260709 13:04:33.989527 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:33.996145 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:33.975063 16536 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:33.988509 16498 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:33.995220 16528 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.002772 16528 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.977321 16537 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:33.984985 16533 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:33.965812 16544 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.030334 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:34.455591 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.456614 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.098948 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:34.198312 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.229475 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 970) took 1209 ms. Trace:
I20260709 13:04:34.235127 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:34.448772 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.465134 15509 rpcz_store.cc:276] 0709 13:04:33.020204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.934728 (+914524us) service_pool.cc:224] Handling call
0709 13:04:34.228240 (+293512us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:04:34.228598 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.228882 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.228921 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.228981 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:34.229026 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.229108 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.229294 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15938432}
I20260709 13:04:34.476910 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:34.481528 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.484486 16541 tablet_copy_client.cc:323] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:04:34.499815 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.444427 16528 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.198873 16529 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.055830 16498 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:34.074636 16538 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.097832 16532 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.006397 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:34.519734 16530 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.376545 16535 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:34.125958 16489 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.074751 16539 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.074420 16534 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:34.121477 16483 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.054394 16536 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.169289 16543 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:34.173950 16531 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.204546 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.467525 16523 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.037294 16540 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.537106 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.442770 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:34.124727 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:34.387354 15464 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4bc0 after lost signal to thread 14296
I20260709 13:04:34.155728 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.488430 16515 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.488780 16503 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.548143 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.515748 16467 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:34.548972 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 73602.8us
I20260709 13:04:34.553328 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.538475 16528 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.557796 16548 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:34.563869 16530 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:34.585150 15528 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet 66d8364b020b43deb510a118a19d076a from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:04:34.541397 16498 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:34.583873 15443 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:34.494720 16533 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.620361 16546 ts_tablet_manager.cc:933] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.549118 16538 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.549006 16529 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.629192 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.633037 15436 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:34.556718 16535 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:34.565316 16483 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.560797 16539 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:34.572314 16489 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:34.568994 16536 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.614044 15586 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:34.641964 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.569402 16534 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:34.643262 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.636554 16550 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:34.580094 16523 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.634930 15528 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet 66d8364b020b43deb510a118a19d076a from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-66d8364b020b43deb510a118a19d076a
I20260709 13:04:34.644357 16533 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.586655 16515 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.637008 16507 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:34.629104 16528 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.653785 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.581014 16531 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.640223 16537 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:34.650286 15464 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad660 after lost signal to thread 15375
I20260709 13:04:34.614880 16503 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:34.642014 16554 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.584033 16543 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.659757 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.632635 16467 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:34.682971 15464 debug-util.cc:398] Leaking SignalData structure 0x7b0800226d80 after lost signal to thread 15467
W20260709 13:04:34.684441 15464 debug-util.cc:398] Leaking SignalData structure 0x7b0800171e00 after lost signal to thread 15542
I20260709 13:04:34.664383 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.571758 16532 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.668057 16498 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:34.623826 16540 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.660431 16544 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.684697 16467 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.662325 16507 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:34.661610 16533 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.623353 16548 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.663451 16550 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.702232 16515 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.702850 16507 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.702453 16533 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.706262 15436 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:34.708411 16543 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.708904 16551 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:34.709064 16540 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.709457 16542 ts_tablet_manager.cc:933] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.705726 16531 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.702271 16467 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.744021 16467 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.715029 16528 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.695812 16554 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.755048 16534 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:34.756170 16535 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.756569 16550 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.773910 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.787778 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.773911 16533 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.790287 16530 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.775264 16538 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.799357 16539 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.799664 16536 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.755450 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 977) took 1547 ms. Trace:
I20260709 13:04:34.818689 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.820799 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.743569 16551 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.869736 16146 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:34.808588 15515 rpcz_store.cc:276] 0709 13:04:33.207976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.930764 (+722788us) service_pool.cc:224] Handling call
0709 13:04:34.745953 (+815189us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32eee 0000000000375939 00007fcf80ca61e0 00007fcf80d6f0c4 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:04:34.754440 (+  8487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.754738 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.754783 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.754856 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:34.754908 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.755007 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.755201 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11360512}
I20260709 13:04:34.871279 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.874441 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.805572 16523 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.882579 16467 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.882946 16554 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:34.884690 16548 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.885336 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:34.886976 16532 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:34.889127 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 343691us
I20260709 13:04:34.821923 16530 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.891810 16483 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.902657 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:34.892616 15556 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:34.876083 16535 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:34.910630 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 326289us
I20260709 13:04:34.880057 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:34.914688 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.917546 16544 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:34.918323 16467 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.898969 16503 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:34.920704 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:34.920487 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.902630 16530 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.933377 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:34.920980 16467 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:34.957132 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.938102 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.968147 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:34.969292 16489 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:34.969650 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.970293 16552 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:34.962158 16551 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:34.966588 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:34.972641 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.969666 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.956553 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:34.976823 16542 tablet_copy_client.cc:323] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.67:37005
I20260709 13:04:34.977370 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:34.951319 16546 tablet_copy_client.cc:323] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:04:34.962932 16540 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:34.994346 16540 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:34.994838 16540 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:34.980508 16551 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.002671 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.004400 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:34.981928 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:34.993067 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 987) took 1037 ms. Trace:
I20260709 13:04:35.005162 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.005824 15341 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 183) took 2203 ms. Trace:
I20260709 13:04:35.001325 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:35.006389 15464 debug-util.cc:398] Leaking SignalData structure 0x7b0800226ee0 after lost signal to thread 15616
I20260709 13:04:35.006646 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:34.999147 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.008536 15341 rpcz_store.cc:276] 0709 13:04:32.802668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.802845 (+   177us) service_pool.cc:224] Handling call
0709 13:04:35.005725 (+2202880us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 13:04:35.009042 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.018814 16549 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.020850 16569 ts_tablet_manager.cc:933] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.005622 15517 rpcz_store.cc:276] 0709 13:04:33.956024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.451378 (+495354us) service_pool.cc:224] Handling call
0709 13:04:34.553849 (+102471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.753319 (+199470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.757398 (+  4079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.773243 (+ 15845us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:34.773324 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.992639 (+219315us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400295754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:34.992698 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.992858 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437760896}
I20260709 13:04:35.021799 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.024195 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.025007 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.025271 16467 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.025835 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.018702 16533 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:35.026683 16533 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.027107 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.027737 16548 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.029053 16533 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:35.014305 15464 debug-util.cc:398] Leaking SignalData structure 0x7b0800319ca0 after lost signal to thread 15617
I20260709 13:04:35.033365 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.033967 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.034703 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.010303 16503 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:35.031912 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.035754 16503 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.035923 15528 tablet_copy_source_session.cc:215] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:35.020216 16483 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.029839 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.024083 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.034775 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.038700 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.072192 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.032209 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:35.073648 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.073994 16515 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:35.074496 16515 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:35.074915 16515 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.075795 16541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d8364b020b43deb510a118a19d076a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:35.069998 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 51585.1us
I20260709 13:04:35.017982 16507 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.073917 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:35.085845 15527 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet a42725e017f142629708ff226f2d53e1 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:04:35.086515 15527 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet a42725e017f142629708ff226f2d53e1 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-a42725e017f142629708ff226f2d53e1
I20260709 13:04:35.084477 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:35.077119 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.092051 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.093299 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.096133 16564 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:35.096622 16564 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:35.097028 16564 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.100543 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:35.106576 15464 debug-util.cc:398] Leaking SignalData structure 0x7b0800304a60 after lost signal to thread 16206
I20260709 13:04:35.107643 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.108358 15518 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:35.100700 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.114405 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.116272 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.118206 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.119892 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.094312 16503 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.098553 16539 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:35.102965 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.134685 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.129873 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.130908 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.131619 16539 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:35.175800 16569 tablet_copy_client.cc:323] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.67:37005
I20260709 13:04:35.180523 16529 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.174317 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.187086 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.190469 16515 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.191643 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 192) took 2369 ms. Trace:
I20260709 13:04:35.191928 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.161652 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.193694 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.192206 15337 rpcz_store.cc:276] 0709 13:04:32.822519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.822684 (+   165us) service_pool.cc:224] Handling call
0709 13:04:35.191570 (+2368886us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1937257,"reported_tablets":1}
I20260709 13:04:35.169528 16539 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.215195 15601 tablet_copy_service.cc:140] P d225833a2cbf4a5995fdbbb1292d1918: Received BeginTabletCopySession request for tablet 952f15e68b0745e5a8ca26a3b527cab0 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:51310)
I20260709 13:04:35.215906 15601 tablet_copy_service.cc:161] P d225833a2cbf4a5995fdbbb1292d1918: Beginning new tablet copy session on tablet 952f15e68b0745e5a8ca26a3b527cab0 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:51310: session id = 6ff41728dec842afad5b53c20446a5a0-952f15e68b0745e5a8ca26a3b527cab0
I20260709 13:04:35.208806 16540 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.213994 15602 tablet_copy_service.cc:140] P d225833a2cbf4a5995fdbbb1292d1918: Received BeginTabletCopySession request for tablet 58702c00fb4641ec8337a916d4579ec9 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:51310)
W20260709 13:04:35.221978 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 117795us
I20260709 13:04:35.221738 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:35.228494 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:35.226691 16564 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.231848 15602 tablet_copy_service.cc:161] P d225833a2cbf4a5995fdbbb1292d1918: Beginning new tablet copy session on tablet 58702c00fb4641ec8337a916d4579ec9 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:51310: session id = 6ff41728dec842afad5b53c20446a5a0-58702c00fb4641ec8337a916d4579ec9
I20260709 13:04:35.236757 16414 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:35.237273 16414 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:35.237651 16414 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.238735 16498 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.239667 16515 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.242384 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.245460 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:35.247412 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.249011 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.250321 15443 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:35.263934 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.272495 16530 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.277309 16540 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.286572 16564 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.294109 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.299013 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:35.301517 16564 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:35.302119 16564 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:35.302522 16564 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:35.302600 16539 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.304332 15601 tablet_copy_source_session.cc:215] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:35.306315 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.306454 16414 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.309468 16523 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.315933 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.316887 15511 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:35.318363 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:35.319144 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.320304 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.323825 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:35.324783 15511 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:35.324609 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.328115 16414 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.329789 16562 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.327628 16540 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:35.330235 15438 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:35.330508 16540 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:35.331009 16540 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.329854 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:35.333433 16558 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:35.331647 16554 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.335158 15512 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.325690 16559 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:04:35.337862 16559 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.338321 16559 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:35.340446 16539 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.342710 15512 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:35.340397 16559 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.345523 16559 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.338570 16557 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.347647 15527 tablet_copy_source_session.cc:215] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:35.351354 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.353526 16414 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.353865 15407 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.356314 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.357678 16546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42725e017f142629708ff226f2d53e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.358546 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.360826 16531 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.362457 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:35.369274 16538 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:35.360545 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.372763 16531 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.374581 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:35.375562 15441 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:35.375968 16538 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.376386 16538 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:35.377311 16538 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.378600 16538 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.380123 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.381127 16414 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.381868 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:35.396639 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:35.391041 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.399370 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.403713 16569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952f15e68b0745e5a8ca26a3b527cab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.407333 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.406486 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:35.395311 16564 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.411000 16539 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.414288 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.414565 16530 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.400687 16531 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.415098 16530 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:35.415894 15515 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:35.416267 16530 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.410696 16414 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.410620 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.413041 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.424221 16489 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.425189 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:35.426434 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.427881 16489 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.430027 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.430186 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.430713 15511 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:35.431507 16414 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.431216 16562 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:35.433023 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.433023 16562 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.436190 16562 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.427917 16531 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:35.437917 16531 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:35.441951 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.442452 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.442000 15509 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:35.447886 16528 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.449070 15602 tablet_copy_source_session.cc:215] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:35.438565 16531 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:35.458576 16531 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.460228 16531 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:35.441061 15407 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.463876 16414 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.464655 15407 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.466140 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.467999 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.470130 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.472698 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.477862 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.478380 16529 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.479511 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.480273 16489 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.481115 16533 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.474229 16558 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:35.508127 15511 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:35.508379 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.502566 16559 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:35.516026 16559 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:35.519045 16559 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:35.514015 16533 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.521739 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.511073 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52910 (request call id 151) took 1592 ms. Trace:
I20260709 13:04:35.533228 16564 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.534569 16542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58702c00fb4641ec8337a916d4579ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.536520 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.537881 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.538700 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:35.538834 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:35.544453 16540 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.555895 16535 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.556384 15439 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:35.559799 16543 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:35.561864 16543 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.562279 16543 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:35.569866 16540 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.572897 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:35.563293 16543 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.591758 16543 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.600819 15511 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:35.549584 16541 rpcz_store.cc:276] 0709 13:04:33.918402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.919632 (+  1230us) service_pool.cc:224] Handling call
0709 13:04:33.982538 (+ 62906us) ts_tablet_manager.cc:934] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
0709 13:04:35.068487 (+1085949us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:35.289331 (+220844us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:35.289478 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:35.438670 (+149192us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:35.439015 (+   345us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:35.510905 (+ 71890us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:35.510984 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":22552,"tablet-copy.queue_time_us":5803,"thread_start_us":217228,"threads_started":2}
I20260709 13:04:35.605321 15512 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:35.605511 16541 tablet_copy_client.cc:806] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:35.606377 16541 tablet_copy_client.cc:670] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:35.606487 15337 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.607925 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.609215 16538 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:35.610922 16533 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:35.609017 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.616583 16564 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.619953 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.609850 16538 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.631110 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.632458 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.636982 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:35.620633 16541 tablet_copy_client.cc:538] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:35.634784 16562 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:35.645454 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.646800 16467 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.634840 16554 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:35.634950 16539 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.644877 16533 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.669725 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:35.671151 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.675956 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.675944 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:35.678866 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.680644 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:35.680358 16551 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.683691 16551 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:35.684091 16551 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:35.684504 16551 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.680253 16566 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:35.687851 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.689518 16515 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.690320 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.692216 16515 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.693650 16551 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.696230 16551 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:35.697443 16533 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:35.699236 15583 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:35.666412 15588 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:35.705904 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.707435 16546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52910 (request call id 154) took 1778 ms. Trace:
I20260709 13:04:35.709095 16569 tablet_copy_client.cc:806] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:35.709794 16569 tablet_copy_client.cc:670] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:35.708838 16546 rpcz_store.cc:276] 0709 13:04:33.928588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.928730 (+   142us) service_pool.cc:224] Handling call
0709 13:04:34.620901 (+692171us) ts_tablet_manager.cc:934] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
0709 13:04:35.350210 (+729309us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:35.531075 (+180865us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:35.554389 (+ 23314us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:35.706534 (+152145us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:35.706911 (+   377us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:35.707304 (+   393us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:35.707369 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":49801,"tablet-copy.queue_time_us":613202,"thread_start_us":346341,"threads_started":2}
I20260709 13:04:35.711064 16546 tablet_copy_client.cc:806] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:35.707681 16538 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:35.721457 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:35.711818 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47778us
I20260709 13:04:35.715927 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:35.720292 16569 tablet_copy_client.cc:538] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:35.726385 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:35.727900 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:35.729471 16546 tablet_copy_client.cc:670] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:35.718526 16523 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.731841 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.733973 15587 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:35.718623 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:35.718747 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:35.711659 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49707.5us
W20260709 13:04:35.739707 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.740039 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.737159 16538 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.746114 15407 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.734807 16547 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.755437 16530 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.756165 16530 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:35.757139 15438 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:04:35.757151 16530 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.758308 16546 tablet_copy_client.cc:538] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:35.738576 16515 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.761844 16515 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:35.763334 16515 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.764164 16541 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:35.789541 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.791952 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.793737 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.796279 16566 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.795816 16498 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.799254 16538 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.800724 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52918 (request call id 81) took 1810 ms. Trace:
I20260709 13:04:35.796586 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:35.801854 16542 rpcz_store.cc:276] 0709 13:04:33.990017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.997591 (+  7574us) service_pool.cc:224] Handling call
0709 13:04:34.736175 (+738584us) ts_tablet_manager.cc:934] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
0709 13:04:35.531793 (+795618us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:35.711756 (+179963us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:35.711891 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:35.730559 (+ 18668us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:35.730936 (+   377us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:35.800572 (+ 69636us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:35.800657 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16612,"tablet-copy.queue_time_us":553498,"thread_start_us":643725,"threads_started":2}
W20260709 13:04:35.796788 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 43699.1us
I20260709 13:04:35.807056 16507 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:35.808460 16543 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.808866 16543 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:35.809768 16543 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.812791 15583 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:35.815949 16543 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.829262 16498 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:35.831270 16538 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.831928 16538 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:35.833055 16538 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.834061 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.834793 16538 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:35.836185 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 45237us
I20260709 13:04:35.843101 16557 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.845018 15555 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.852795 16547 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.847044 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:35.853976 16562 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:35.854527 16562 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:35.855506 16562 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:35.859688 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:35.862737 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:35.864606 16542 tablet_copy_client.cc:806] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:35.865371 16542 tablet_copy_client.cc:670] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:35.849722 16569 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:35.875859 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.877388 16543 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.878360 16542 tablet_copy_client.cc:538] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:35.879055 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:35.880738 16538 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:35.936767 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:35.939445 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 99867.7us
I20260709 13:04:35.960745 16583 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.966828 16583 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:35.986140 15517 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.051750 16530 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.052445 16530 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:36.054090 16530 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:36.092206 15589 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.093474 15341 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:36.101828 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.110858 16573 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:36.115053 16530 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.118468 16569 tablet_bootstrap.cc:700] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Time spent opening tablet: real 0.112s	user 0.003s	sys 0.000s
I20260709 13:04:36.160542 16546 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:36.173804 16542 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:04:36.176232 16541 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:36.178594 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 140449us
I20260709 13:04:36.177170 15341 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 4, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 4 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.191593 15515 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.192898 16556 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:04:36.213830 15341 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.223266 15515 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.211931 16541 tablet_bootstrap.cc:492] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:36.237195 16541 ts_tablet_manager.cc:1403] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.473s	user 0.031s	sys 0.008s
I20260709 13:04:36.255750 16573 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:36.307442 15592 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.311980 16583 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:04:36.370687 16541 raft_consensus.cc:359] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:36.371829 16541 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:36.372644 16541 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:36.459405 16569 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.460846 16569 tablet_bootstrap.cc:492] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:36.461900 16569 ts_tablet_manager.cc:1403] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.612s	user 0.054s	sys 0.009s
I20260709 13:04:36.505894 16569 raft_consensus.cc:359] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:36.507490 16569 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:36.557612 16569 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:36.564225 15439 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.599728 15592 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:36.675436 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 51947.6us
I20260709 13:04:36.669188 16569 ts_tablet_manager.cc:1434] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.190s	user 0.022s	sys 0.019s
I20260709 13:04:36.693252 16541 ts_tablet_manager.cc:1434] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.456s	user 0.037s	sys 0.005s
I20260709 13:04:36.694286 15602 tablet_copy_service.cc:342] P d225833a2cbf4a5995fdbbb1292d1918: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-952f15e68b0745e5a8ca26a3b527cab0 received from {username='slave'} at 127.0.0.1:51310
I20260709 13:04:36.695021 15602 tablet_copy_service.cc:434] P d225833a2cbf4a5995fdbbb1292d1918: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-952f15e68b0745e5a8ca26a3b527cab0 on tablet 952f15e68b0745e5a8ca26a3b527cab0 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:36.697908 15527 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-66d8364b020b43deb510a118a19d076a received from {username='slave'} at 127.0.0.1:34302
I20260709 13:04:36.698490 15527 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-66d8364b020b43deb510a118a19d076a on tablet 66d8364b020b43deb510a118a19d076a with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:36.698975 16542 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:36.702001 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 78228.8us
I20260709 13:04:36.708680 16542 tablet_bootstrap.cc:492] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:36.713114 16542 ts_tablet_manager.cc:1403] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.540s	user 0.005s	sys 0.037s
W20260709 13:04:36.716930 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 139214us
I20260709 13:04:36.754161 15592 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:36.762271 16546 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.764271 16542 raft_consensus.cc:359] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:36.765334 16542 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:36.763489 16546 tablet_bootstrap.cc:492] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:04:36.766201 16542 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:36.768006 16546 ts_tablet_manager.cc:1403] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.608s	user 0.043s	sys 0.059s
I20260709 13:04:36.775988 16542 ts_tablet_manager.cc:1434] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:04:36.784540 15602 tablet_copy_service.cc:342] P d225833a2cbf4a5995fdbbb1292d1918: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-58702c00fb4641ec8337a916d4579ec9 received from {username='slave'} at 127.0.0.1:51310
I20260709 13:04:36.785377 15602 tablet_copy_service.cc:434] P d225833a2cbf4a5995fdbbb1292d1918: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-58702c00fb4641ec8337a916d4579ec9 on tablet 58702c00fb4641ec8337a916d4579ec9 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:36.805971 16546 raft_consensus.cc:359] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:36.811659 16546 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:04:36.826162 16546 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:04:36.862068 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 140348us
I20260709 13:04:36.865415 16602 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:36.865396 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134048us
W20260709 13:04:36.868743 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 136615us
I20260709 13:04:36.876590 16546 ts_tablet_manager.cc:1434] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.107s	user 0.013s	sys 0.000s
I20260709 13:04:36.897766 15527 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-a42725e017f142629708ff226f2d53e1 received from {username='slave'} at 127.0.0.1:34302
I20260709 13:04:36.898336 15527 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-a42725e017f142629708ff226f2d53e1 on tablet a42725e017f142629708ff226f2d53e1 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:36.904778 16178 raft_consensus.cc:1217] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:04:36.923354 15439 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:36.923247 15592 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:37.007107 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:37.029373 16178 raft_consensus.cc:1217] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:37.085697 16539 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:37.114420 16602 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:37.152223 16177 raft_consensus.cc:1217] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:37.171012 16177 raft_consensus.cc:1217] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:37.191282 16609 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:37.233443 16530 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:37.234161 16530 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:37.256966 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:37.265512 15509 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:37.276973 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:37.277989 15586 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:37.280681 16573 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:37.284008 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:37.275147 16530 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:37.291162 16604 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:37.322826 16604 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:37.297689 16573 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:37.356199 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 60444.9us
I20260709 13:04:37.347441 16604 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.437934 16620 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:37.442282 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 51407.5us
W20260709 13:04:37.443935 16616 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 13:04:37.504105 16573 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:37.506834 16618 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
I20260709 13:04:37.438580 16620 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:37.509464 16624 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.509927 16620 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:37.510273 16624 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:37.512269 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54964.7us
I20260709 13:04:37.499913 16627 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:37.536485 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:37.537559 15443 raft_consensus.cc:606] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:37.544142 16624 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:37.542119 16627 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:37.550463 16627 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:37.550318 16604 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:37.566360 16604 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:37.567493 16543 raft_consensus.cc:1064] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
W20260709 13:04:37.593061 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79855.4us
I20260709 13:04:37.606799 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:37.607833 15518 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:37.610515 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:37.611310 15438 raft_consensus.cc:606] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:37.628126 16543 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:37.636693 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:37.637661 15441 raft_consensus.cc:606] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:37.642050 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:37.643354 15438 raft_consensus.cc:606] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:37.647949 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:37.648691 15442 raft_consensus.cc:606] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:37.650879 16610 raft_consensus.cc:993] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:37.651501 16610 raft_consensus.cc:1081] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:37.652824 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:37.654076 15438 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:37.656427 16178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c"
dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:52916
I20260709 13:04:37.657168 16178 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:37.657902 16178 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.664405 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:37.665337 15442 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
W20260709 13:04:37.680147 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 83051.6us
I20260709 13:04:37.697225 16608 raft_consensus.cc:1064] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:37.700016 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:37.701009 15514 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:37.703233 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:37.704195 15518 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:37.700493 16608 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:37.706815 16625 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.707438 16625 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:37.720593 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:37.721081 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:37.721516 15442 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:37.714179 16625 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:37.744112 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:37.746418 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:37.747212 15584 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:37.753693 16178 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:37.758033 15592 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
W20260709 13:04:37.760524 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 74219.9us
I20260709 13:04:37.764910 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:37.766170 16634 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:37.766630 16634 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.767450 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:37.766985 16634 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:37.741925 15586 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:37.778049 16624 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:37.778267 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 66980.5us
I20260709 13:04:37.778604 16624 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:37.779134 16624 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.785622 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:37.786353 15514 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.793587 16624 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:37.783104 16178 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:37.804011 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:37.805779 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:37.806731 16636 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:37.807242 16636 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:37.808267 16636 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:37.818298 16587 raft_consensus.cc:1064] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:37.818827 16602 raft_consensus.cc:1064] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:04:37.821573 16587 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:37.824542 16556 raft_consensus.cc:993] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:37.825469 16558 raft_consensus.cc:993] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:37.825989 16558 raft_consensus.cc:1081] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:37.826979 16558 raft_consensus.cc:1081] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:37.796097 16624 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:37.834064 15407 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:37.835170 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:37.853957 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:37.855990 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:37.856251 15584 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:37.822438 16602 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:37.856928 15514 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:37.857122 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:37.858379 15583 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:37.858836 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:37.853590 16610 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:37.838213 16530 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:37.881580 15509 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:37.865192 16610 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:37.872139 16530 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.907806 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:37.909754 16637 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:37.910439 16637 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.910861 16637 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:37.918078 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 59489.6us
I20260709 13:04:37.918931 16179 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:37.898129 16610 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.906232 16530 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:37.936589 16178 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEARNER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:37.937465 16625 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:37.910280 15442 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:37.947186 15442 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:37.930928 16634 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:37.963608 15442 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:37.964767 15442 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.965015 16634 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:37.967275 16543 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:37.978297 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106622us
I20260709 13:04:38.013125 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:38.014914 15443 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:38.015691 16644 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.026926 15443 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:04:38.034694 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 189650us
I20260709 13:04:38.051995 16639 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:38.016499 16610 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.042901 16608 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:04:38.076596 16530 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.078429 15438 raft_consensus.cc:2368] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3.
I20260709 13:04:38.080053 15514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a42725e017f142629708ff226f2d53e1"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:38406
I20260709 13:04:38.081259 15514 raft_consensus.cc:606] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:38.083515 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:38.085901 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:38.085973 15442 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:38.087703 16530 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:38.125213 16610 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:38.126855 16644 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:04:38.139315 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.140224 16644 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:38.153795 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 111535us
I20260709 13:04:38.159524 16556 raft_consensus.cc:993] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:38.160398 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:38.164404 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.172777 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:38.173581 15517 raft_consensus.cc:2368] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:38.175190 15514 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.172538 16637 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.179433 15586 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:38.182492 16584 raft_consensus.cc:1081] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:38.184599 16637 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:38.194924 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:38.196408 15443 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.236958 15406 leader_election.cc:400] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:38.237416 15406 leader_election.cc:403] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:38.243184 15592 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:38.256189 15592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:38.275214 15592 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.276324 15592 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.256250 16179 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:38.278471 15514 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:38.278892 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:38.279656 15585 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.284789 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:38.295984 15443 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:38.295971 15585 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:38.310866 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:38.311801 16648 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:38.312582 16620 raft_consensus.cc:993] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:38.313225 16620 raft_consensus.cc:1081] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:38.311894 15588 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:38.281265 15589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:38.324644 15589 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.325134 15589 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.329218 15585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:38.329720 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:38.329943 15585 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.340552 15585 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:38.336393 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 83474.3us
I20260709 13:04:38.332002 15592 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.369716 16637 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:38.367835 15340 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.371452 16498 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:38.363312 15585 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.379177 15590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:38.393007 15585 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:38.403936 15590 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.395457 15592 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:38.413841 15590 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.405287 15589 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.408401 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:38.415253 15584 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:38.415375 15437 raft_consensus.cc:3055] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.415925 15437 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:38.407622 15438 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:38.425103 15517 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:38.409258 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:38.429394 15442 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.429868 15442 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:38.430912 15442 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.432040 15442 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.410607 16650 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:38.434557 16650 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.437067 16650 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:38.396765 16657 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:04:38.416729 15437 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.419430 16630 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:38.439180 15437 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.412974 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:38.423436 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:38.441223 15509 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:38.441308 16655 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:38.426573 15518 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:38.442011 16655 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:38.374718 16637 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:38.453666 15589 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:38.454660 15437 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:38.457032 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:38.457808 15443 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.458099 15443 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:38.460707 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:38.443142 16655 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.461894 15443 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.474834 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:38.481767 15518 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:38.483989 16575 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.499894 16575 raft_consensus.cc:697] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:38.487684 15443 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.496188 16178 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:38.505690 15590 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.506439 15589 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:38.510345 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:38.520927 15590 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:38.522286 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:38.523171 15437 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:38.524539 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:38.525331 15437 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.525713 15437 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:38.526755 15437 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.533773 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:38.534235 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:38.534539 15518 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.534888 15509 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.537943 15583 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:38.540692 15437 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.543009 15441 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:38.544337 16566 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:38.546789 15441 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:38.500989 16575 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:38.549046 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.581281 15509 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:38.574384 15443 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:38.585680 15437 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:38.572687 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:38.516469 16637 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.589993 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:38.591506 15518 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:38.552332 16655 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:04:38.599120 15518 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:38.589452 15514 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.604763 16651 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.605455 16651 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:38.608294 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:38.609223 15518 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.609917 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:38.622330 15518 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:38.625919 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:38.633049 16177 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:38.634915 16639 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.635591 16639 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:38.636138 15442 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:38.636583 16639 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.606488 16651 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.637817 15514 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:38.648056 15556 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:38.658015 15443 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:38.656613 15406 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:38.668512 15511 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:38.668365 15516 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:38.660616 16608 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:04:38.634994 16609 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:04:38.683909 16498 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.685075 16180 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:38.662851 16628 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.688386 16628 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.689069 15585 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:38.690640 16628 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:38.684608 16498 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:38.699918 16655 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:38.702085 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 61545.2us
I20260709 13:04:38.704203 16498 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:38.717298 15482 leader_election.cc:400] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3.
I20260709 13:04:38.719949 15482 leader_election.cc:403] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:38.722543 16609 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3.
W20260709 13:04:38.484771 16646 consensus_queue.cc:1175] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d225833a2cbf4a5995fdbbb1292d1918" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:38.717557 16644 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 13:04:38.731881 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:38.739136 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 81419.4us
I20260709 13:04:38.745375 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:38.793882 16498 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:38.780164 16539 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:04:38.798971 15441 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:38.752571 16634 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:38.843959 16662 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:38.845152 16662 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:38.855029 16678 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:38.862587 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 102226us
I20260709 13:04:38.835228 16644 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:04:38.892781 16660 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:04:38.896368 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 147330us
I20260709 13:04:38.862433 16678 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:04:38.918656 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:38.921069 16662 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:38.932533 16678 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:38.897949 16669 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:04:38.940696 15586 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:04:38.963112 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 50925.7us
I20260709 13:04:38.959121 16662 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:04:38.973523 16669 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:04:38.974128 15341 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.003167 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:39.011608 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:39.029415 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:39.051121 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:39.078409 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:39.096289 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:39.074658 16628 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:04:39.112353 15340 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:39.176081 15439 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.183760 15443 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.190217 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:39.197144 15518 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:39.201014 16575 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:39.209918 16610 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:39.254246 15510 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.260497 15438 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:39.244383 16637 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:04:39.306252 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 233766us
I20260709 13:04:39.312574 15511 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:39.271116 16655 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:04:39.393118 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74808.5us
W20260709 13:04:39.403594 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 76400.1us
I20260709 13:04:39.323822 16648 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:04:39.276618 16682 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 13:04:39.454330 16644 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:39.465005 16691 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:04:39.465107 16644 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:39.555318 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 149442us
I20260709 13:04:39.293886 15514 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:39.624229 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:39.627743 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:39.694693 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 67884.6us
I20260709 13:04:39.690084 16679 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:39.704339 15513 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.725421 15441 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.724067 16539 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:39.730818 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:39.736511 16644 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:39.771704 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:39.803711 16146 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:39.805555 16644 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:39.880188 15434 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.889201 16700 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:39.894029 16715 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:39.854564 16678 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:39.814075 15439 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:04:39.916360 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86502.5us
I20260709 13:04:39.827059 16566 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
W20260709 13:04:39.928767 16717 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:04:39.946751 15584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.046s	sys 0.040s
I20260709 13:04:39.946945 16644 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:39.947744 16644 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:39.954124 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:39.947213 15584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.047s	sys 0.040s
I20260709 13:04:39.963685 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:39.961568 16644 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:40.028079 16720 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:04:40.039211 15513 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.044612 15511 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.992290 16145 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:40.038743 16498 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:40.092752 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52852.8us
W20260709 13:04:40.093885 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52675.5us
I20260709 13:04:40.099884 15509 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:40.101133 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 94929.3us
I20260709 13:04:40.091341 16498 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:40.106045 16644 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:40.110301 16181 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:40.115163 16179 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:40.118517 15338 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.139231 15338 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:04:40.144994 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 98932.9us
I20260709 13:04:40.146471 16498 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:40.145818 15338 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:40.156394 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:40.114058 16609 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:40.174484 15514 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:40.177296 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:40.180523 16498 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:40.181192 16498 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:40.191138 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 89182.3us
W20260709 13:04:40.147146 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 164438us
W20260709 13:04:40.200362 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 96164.3us
I20260709 13:04:40.204468 16639 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:40.205794 16719 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.205139 16639 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:40.205001 15435 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:40.227228 16498 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:40.243909 16714 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:04:40.246481 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:40.217522 16566 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 13:04:40.285967 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 89314.4us
I20260709 13:04:40.206339 16719 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:40.220070 16543 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:04:40.256283 16639 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:40.223086 16700 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:04:40.289171 16628 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.369663 15590 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:40.487340 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:40.490290 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:40.355556 16628 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:40.526811 16704 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:40.529426 16704 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:40.600951 16699 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:40.627774 16704 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:40.632366 16737 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:40.638764 16729 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.346s	user 0.001s	sys 0.001s
I20260709 13:04:40.596673 16644 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:40.674501 16628 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:40.675935 16737 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:40.724753 16628 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.725512 16628 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:40.731218 16628 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:40.742362 16741 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:04:40.745503 16732 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:04:40.713636 16730 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:40.752382 16730 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:40.705353 16644 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:40.767459 15407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.001s	sys 0.012s
W20260709 13:04:40.773813 15407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.002s	sys 0.012s
W20260709 13:04:40.774636 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 515735us
I20260709 13:04:40.797998 16730 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:40.765138 16719 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:40.812867 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:40.855409 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 498754us
I20260709 13:04:40.863840 16746 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:40.812975 16679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.013s	sys 0.009s
I20260709 13:04:40.864739 16746 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:40.865494 16609 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.000s
W20260709 13:04:40.907728 15406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.004s	sys 0.012s
W20260709 13:04:40.900403 16679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.014s	sys 0.009s
I20260709 13:04:40.912971 16750 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:40.913801 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 137610us
I20260709 13:04:40.914023 16750 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:40.917061 15406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.005s	sys 0.012s
I20260709 13:04:40.892707 16739 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:40.961934 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:40.962380 16179 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.845s	user 0.014s	sys 0.002s
I20260709 13:04:40.962863 16176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 131) took 1224 ms. Trace:
I20260709 13:04:40.967236 16176 rpcz_store.cc:276] 0709 13:04:39.729963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.734274 (+  4311us) service_pool.cc:224] Handling call
0709 13:04:40.900669 (+1166395us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b5800004598. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:04:40.910133 (+  9464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:40.949467 (+ 39334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.951638 (+  2171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:40.952374 (+   736us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:40.953773 (+  1399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.953850 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:40.954005 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10349824}
I20260709 13:04:40.991274 16739 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.010258 16739 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.064164 16737 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.069562 16746 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.259483 16575 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.260403 16575 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.322901 16753 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.323868 16753 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.419802 16737 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.420917 16737 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:41.469756 16679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.006s
W20260709 13:04:41.470353 16679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.006s
I20260709 13:04:41.389513 16575 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.430081 16753 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.473784 16179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52910 (request call id 209) took 1356 ms. Trace:
I20260709 13:04:41.492825 16737 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.490870 16179 rpcz_store.cc:276] 0709 13:04:40.114131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.114275 (+   144us) service_pool.cc:224] Handling call
0709 13:04:40.114658 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:40.114992 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:40.969464 (+854472us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.469992 (+500528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:41.470091 (+    99us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:41.470151 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.470247 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.470637 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"thread_start_us":480597,"threads_started":1,"wal-append.queue_time_us":524013}
I20260709 13:04:41.611327 16737 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.612160 16737 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.614822 16737 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.616137 16737 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.618453 16737 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.618778 16753 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.619879 16753 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.622361 16737 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:41.624271 16735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.011s	sys 0.016s
W20260709 13:04:41.624961 16735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.011s	sys 0.016s
I20260709 13:04:41.625766 16753 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.675192 16644 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:41.676651 15407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.000s	sys 0.012s
W20260709 13:04:41.677057 15407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.000s	sys 0.012s
I20260709 13:04:41.678337 16710 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.678996 16710 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.681569 16710 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.686277 16682 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.687034 16682 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.687765 16608 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.688301 16498 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.688367 16608 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.689059 16498 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.689463 16682 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:41.690915 16498 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.691082 16707 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.691835 16707 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.693674 16707 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.693780 16678 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.694244 16707 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.694446 16678 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.694764 16707 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.695669 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.697067 15589 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:41.690588 16608 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.697073 16707 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.700146 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.695734 16725 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.702839 16725 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.705420 16725 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.706116 16725 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.706346 16678 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.706751 16725 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.709545 16725 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:41.712320 16631 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.713055 16631 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.715953 16631 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.717806 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.727849 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.735792 16725 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.736280 16678 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.736580 16725 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.737013 16678 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.739099 16725 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.739697 16678 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:41.740051 15438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.006s	sys 0.013s
W20260709 13:04:41.740420 15438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.006s	sys 0.013s
I20260709 13:04:41.741287 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1039) took 1259 ms. Trace:
I20260709 13:04:41.741680 15438 rpcz_store.cc:276] 0709 13:04:40.481716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.484660 (+  2944us) service_pool.cc:224] Handling call
0709 13:04:40.517795 (+ 33135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:40.545777 (+ 27982us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:40.909563 (+363786us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.740791 (+831228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:41.740863 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:41.740917 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.741003 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.741186 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39941,"prepare.queue_time_us":213145,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":69168,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":901454,"threads_started":2}
I20260709 13:04:41.751408 16725 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.752199 16725 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.752843 16706 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.753227 16678 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.753544 16706 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.755451 16725 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.756101 16725 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.756299 16706 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:41.756848 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.019s	sys 0.021s
I20260709 13:04:41.754905 16678 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.756687 16725 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:41.757640 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.019s	sys 0.021s
W20260709 13:04:41.758937 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 818725us
I20260709 13:04:41.762319 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.762530 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.763659 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.765079 16725 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.768482 16644 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.768573 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.769335 16644 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.769976 16678 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.773167 16644 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.773923 16644 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.774477 16644 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.780179 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.780018 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.781265 15514 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:04:41.782904 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.783453 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.785283 15589 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:41.786630 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.788079 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.786717 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.788219 16678 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.794345 16678 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.796203 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.799851 16644 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.798425 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.803069 16678 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.792224 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.804675 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:41.805670 16644 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.808706 16724 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.809324 16724 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.811779 16724 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.813264 16706 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.813967 16705 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.813846 16706 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.814481 16705 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.816334 16706 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.816604 16705 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.816931 16706 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.817169 16705 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.817521 16706 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.817668 16705 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.819761 16705 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:41.812819 16724 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.821342 16724 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.825126 16724 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:41.825875 16706 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.826041 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.827940 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:41.830709 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.835945 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:41.837733 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:41.838363 16182 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:41.839207 16644 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.839803 16644 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.840858 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:41.842972 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.843761 15438 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:41.844234 16713 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.844372 16639 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.844864 16713 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.844959 16639 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.846915 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.847193 16713 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.847782 15514 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:41.849347 16145 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:41.849795 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:41.847254 16639 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.850677 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.851357 16608 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.851928 16753 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:41.852375 16753 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.852782 16753 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:41.855826 16697 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.856642 16679 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.856460 16697 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.857179 16679 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.858821 16697 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.859050 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.859238 16679 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.859476 16697 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.890251 16713 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.909060 16697 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.909580 16713 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.900051 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.912725 15442 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:41.913266 16713 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.896497 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.914067 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.914147 15441 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:04:41.915796 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.916007 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:41.916482 15441 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:41.916831 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.917338 16737 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:41.917410 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.917855 16737 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.918335 16737 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.918620 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.919240 15590 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:41.919786 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.920197 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.921147 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.921437 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.921859 15438 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:41.921994 16608 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.922580 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.922868 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.922525 16608 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.925441 16608 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.925776 16700 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.861724 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.926518 16700 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:41.918186 15441 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:41.927709 16498 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.876147 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.929150 16498 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:41.885726 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.930061 16682 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.930614 16682 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.930938 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.931872 15588 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:41.932966 16498 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.927214 16608 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.934391 16608 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:41.928264 15435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.010s	sys 0.015s
I20260709 13:04:41.860996 16634 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:41.935945 15435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.010s	sys 0.015s
I20260709 13:04:41.936990 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1198) took 1734 ms. Trace:
I20260709 13:04:41.937606 15435 rpcz_store.cc:276] 0709 13:04:40.202936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.203061 (+   125us) service_pool.cc:224] Handling call
0709 13:04:40.204545 (+  1484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:40.204750 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:40.486570 (+281820us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.936366 (+1449796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:41.936433 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:41.936477 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.936546 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.936880 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70421,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":1430889,"threads_started":2,"wal-append.queue_time_us":603955}
I20260709 13:04:41.938695 16730 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.939361 16730 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.942063 16730 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.944312 15439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
W20260709 13:04:41.931489 15406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.004s	sys 0.005s
I20260709 13:04:41.928188 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.929414 16714 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.892443 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:41.945091 15406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.006s	sys 0.005s
I20260709 13:04:41.915365 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.948333 15439 raft_consensus.cc:606] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:41.949023 16608 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.952754 16714 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:41.949425 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.859916 16727 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:41.860095 16742 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.874807 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:41.955796 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.880611 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.864305 16750 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.967058 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:41.881354 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.949756 15438 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:41.932982 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.859730 16609 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.993125 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.933012 16682 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:41.998209 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.852567 16644 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:41.860921 16760 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.997296 16654 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.966734 16727 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.003727 16609 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.001628 16584 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:41.862277 16719 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.996065 15585 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:04:41.958562 16697 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.013181 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.026147 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.006289 16654 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.043687 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.046936 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.048669 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.048933 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:41.998183 16730 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.050688 15591 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:42.048349 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.006964 16714 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:42.054152 15587 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
W20260709 13:04:42.060081 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 136233us
I20260709 13:04:42.055676 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.012125 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.011067 16682 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:41.935981 16634 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.054400 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.061992 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:41.990520 16742 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.075186 15591 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:04:42.053520 16713 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.061672 16639 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:42.071556 16650 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:42.103941 16639 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.104422 16775 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.104157 16650 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.106494 16639 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:42.097745 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.061945 16761 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.102486 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.089365 16698 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.111385 16713 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:42.117053 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48224.3us
I20260709 13:04:42.009336 16760 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.112102 16761 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.609928 16761 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.128361 15436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:42.072026 16679 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.630774 16679 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:42.631312 16679 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.631758 15341 catalog_manager.cc:5697] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.633936 15341 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.100871 16776 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.166301 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:42.636057 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 469846us
I20260709 13:04:42.635869 16776 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.174197 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.105315 16775 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.640621 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.178366 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.180155 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.180658 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.180881 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.184134 16778 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.183223 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.090194 16682 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.645707 15341 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.233691 15338 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 202) took 3054 ms. Trace:
W20260709 13:04:42.239109 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56231.3us
I20260709 13:04:42.656991 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.272384 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:42.290561 16700 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:42.107460 16650 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.267427 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.311269 16742 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.325179 16753 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.337257 16636 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:42.103245 16654 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:42.343780 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 230667us
W20260709 13:04:42.345046 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 180216us
I20260709 13:04:42.365978 15586 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:42.027810 16719 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.668018 16636 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.419183 16644 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:42.406445 16737 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.024206 16584 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.512802 16634 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:42.067615 16730 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:42.556164 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 96) took 3559 ms. Trace:
I20260709 13:04:42.682010 15337 rpcz_store.cc:276] 0709 13:04:38.996205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.996398 (+   193us) service_pool.cc:224] Handling call
0709 13:04:42.555881 (+3559483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519795,"reported_tablets":3,"spinlock_wait_cycles":1643776}
I20260709 13:04:42.559356 16713 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:42.686000 16584 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.585047 15340 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 206) took 2783 ms. Trace:
I20260709 13:04:42.586692 16655 raft_consensus.cc:993] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:42.696313 16655 raft_consensus.cc:1081] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:42.589483 16631 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.697862 16682 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:42.592140 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.595094 16784 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:42.595578 16727 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.598341 16146 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.603022 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.701608 15434 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:42.611233 15436 raft_consensus.cc:606] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:42.607417 16760 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.612900 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.690657 16679 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.614538 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.610551 16697 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:42.629472 16609 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.639922 15514 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:42.652626 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.705016 15590 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:42.660109 15341 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.653251 16778 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.648175 16556 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.664151 16776 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.660797 16573 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:42.665709 15556 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:42.712512 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 46881.5us
I20260709 13:04:42.708458 16556 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.713747 16682 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.714306 16682 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.714510 16753 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.714700 16682 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.676658 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.669956 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:42.678725 16644 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.683439 16730 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:42.584510 16783 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:42.716754 16713 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.656515 15338 rpcz_store.cc:276] 0709 13:04:39.172517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.172835 (+   318us) service_pool.cc:224] Handling call
0709 13:04:39.262335 (+ 89500us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:42.226727 (+2964392us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:40.586418 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:40.633452 (+ 47034us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:40.633501 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:04:40.633526 (+    25us) tablet.cc:662] Decoding operations
0709 13:04:40.636584 (+  3058us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:40.636670 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:40.636711 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:04:40.637105 (+   394us) tablet.cc:701] Row locks acquired
0709 13:04:40.637123 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:04:40.637295 (+   172us) write_op.cc:270] Start()
0709 13:04:40.637689 (+   394us) write_op.cc:276] Timestamp: P: 1783602280637249 usec, L: 0
0709 13:04:40.637717 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:04:40.725082 (+ 87365us) log.cc:844] Serialized 1432 byte log entry
0709 13:04:41.619284 (+894202us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf78c4d0ac 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b
0709 13:04:41.628074 (+  8790us) op_driver.cc:464] REPLICATION: finished
0709 13:04:41.629502 (+  1428us) write_op.cc:301] APPLY: starting
0709 13:04:41.629619 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:41.629781 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:41.629797 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:41.630351 (+   554us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:41.630521 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:04:41.630555 (+    34us) write_op.cc:312] APPLY: finished
0709 13:04:41.630814 (+   259us) log.cc:844] Serialized 34 byte log entry
0709 13:04:41.631050 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.631160 (+   110us) write_op.cc:454] Released schema lock
0709 13:04:41.631207 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:41.631660 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.631692 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":103429376,"child_traces":[["op",{"apply.queue_time_us":1126,"apply.run_cpu_time_us":2085,"apply.run_wall_time_us":2089,"num_ops":3,"prepare.queue_time_us":299387,"prepare.run_cpu_time_us":34014,"prepare.run_wall_time_us":1079967,"raft.queue_time_us":938,"raft.run_cpu_time_us":1647,"raft.run_wall_time_us":1647,"replication_time_us":989971,"spinlock_wait_cycles":2614016,"thread_start_us":1024393,"threads_started":4,"wal-append.queue_time_us":899357,"wal-append.run_cpu_time_us":3593,"wal-append.run_wall_time_us":1015018}]]}
I20260709 13:04:42.690385 16719 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.707316 16697 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.685658 16737 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:42.694511 15340 rpcz_store.cc:276] 0709 13:04:39.802057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.802521 (+   464us) service_pool.cc:224] Handling call
0709 13:04:42.584958 (+2782437us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4}
I20260709 13:04:42.698307 16631 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.721654 16783 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:42.603796 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 486859us
I20260709 13:04:42.614234 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.703217 15443 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:42.629575 16761 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.709643 15442 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
W20260709 13:04:42.715934 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46135us
I20260709 13:04:42.662597 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:42.699229 16784 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.713320 15556 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:42.700532 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 719932us
I20260709 13:04:42.713842 16556 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.715224 16753 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.740700 16714 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.740972 16179 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:42.741922 16775 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:42.719683 16636 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.738341 15556 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.736033 15337 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:42.755985 16715 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.756492 16715 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.758162 16715 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.746196 16644 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.758759 16784 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.759795 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:42.748941 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.740983 16631 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:42.762108 16787 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.751938 16778 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.743637 16714 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.764569 16714 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.764974 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.766569 16609 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.724676 16730 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.767141 16609 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:42.746418 16776 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:42.767716 16609 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.767477 16730 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.769924 16730 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:42.754750 15556 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:42.746186 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69588.2us
I20260709 13:04:42.771265 15406 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.771620 16697 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:42.759756 15337 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 2 to 3, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:42.762549 16655 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:42.763899 16787 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:42.760473 15440 raft_consensus.cc:606] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:42.775427 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.776795 16709 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.777321 16776 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.777953 16776 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.774447 16787 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.778213 16775 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.779270 16783 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.780695 16573 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.780294 16775 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.782793 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:42.783264 16775 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.778970 16655 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.787595 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:42.788327 15440 raft_consensus.cc:606] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.760099 16584 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.793680 16584 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.757297 16788 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.777798 16709 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:42.798480 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d40d294abeec453098d547799a79f7c5"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:42.799314 15440 raft_consensus.cc:606] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.798875 16679 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.801034 15406 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.772789 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.805606 15514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:38406
I20260709 13:04:42.806401 15514 raft_consensus.cc:606] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:42.802021 16713 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.808305 16713 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.809034 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:42.810217 15406 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.811448 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:42.815433 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.851028 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:42.894484 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 84429.5us
I20260709 13:04:42.808794 16713 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.826226 16679 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:42.885350 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 287100us
I20260709 13:04:42.819404 16730 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.858794 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:42.895789 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 44841.9us
I20260709 13:04:42.898947 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:42.903592 15590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:42.904323 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.921306 15590 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.921710 15556 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.911666 16146 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.932180 16146 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:42.921900 15590 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.925472 16761 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.901311 16575 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.926524 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.927285 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.943010 15585 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:42.884361 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.928414 16584 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.927219 15440 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:42.934203 16787 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.953399 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:42.858508 16655 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.924103 15518 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.935192 15556 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:42.938604 16788 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.941090 16709 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:42.965029 16608 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.942471 16575 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:42.945519 16764 raft_consensus.cc:993] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:42.946244 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:42.947396 16776 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.853518 16778 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.953946 16146 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:42.980082 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.932775 16556 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.904433 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:42.958365 16707 raft_consensus.cc:993] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:42.957957 15590 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.960246 16714 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:42.961287 16573 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.906348 16679 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:43.015980 16679 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.016928 16787 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:42.942483 16639 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.974090 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.966982 16575 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.955720 16783 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.965484 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:42.944564 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:42.993139 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.008786 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.978852 16778 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:42.965644 16608 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.019233 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.032902 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:42.990589 16788 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.069537 15437 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:43.061067 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.072780 15590 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.033624 15439 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.019812 16639 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.069805 15442 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:43.078895 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.086898 15517 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
W20260709 13:04:43.079648 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 125782us
W20260709 13:04:43.054785 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46183.3us
I20260709 13:04:43.088811 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.090158 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.091087 15518 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:04:43.092839 15509 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:43.073944 15516 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:04:43.073463 16608 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.007773 16573 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.094159 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.096372 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.032615 16783 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.098701 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:43.062216 16714 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.073544 16778 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.060375 16650 raft_consensus.cc:1081] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:43.100346 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:43.091051 16639 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.103781 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:43.101837 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.101926 16573 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.110373 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.114169 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.114336 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:43.095247 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.112893 15440 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.111229 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.032819 16764 raft_consensus.cc:1081] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:43.097862 16788 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.112957 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.020550 16145 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:43.119752 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:43.106595 15556 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:43.119690 15440 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:43.121285 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:43.125005 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.101644 16655 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:43.106067 16783 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.138494 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.267942 15513 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.134606 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.251804 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:43.126252 16760 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.288455 16655 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.192905 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.289716 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.290723 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.264638 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:43.249094 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.275411 15590 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:43.289217 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.288528 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:43.292742 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.169961 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.275839 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.144531 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:43.138098 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.298187 15437 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:43.170248 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:43.281108 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 161049us
I20260709 13:04:43.281703 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:43.253571 16793 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:04:43.299968 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 155605us
I20260709 13:04:43.291949 15440 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.302578 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.303187 15440 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.303433 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:43.304261 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.304486 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:43.300819 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 194268us
I20260709 13:04:43.306119 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.307447 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.263438 16556 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:43.242970 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.242966 16181 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:43.316387 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.298256 15586 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:43.258275 15613 debug-util.cc:398] Leaking SignalData structure 0x7b0800040800 after lost signal to thread 14296
I20260709 13:04:43.316788 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.244797 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.291426 16655 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:43.242687 16791 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:43.275025 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 284065us
I20260709 13:04:43.315302 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:43.329177 16182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed"
dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:52916
I20260709 13:04:43.340027 16182 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.340548 16182 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.306265 16788 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.340947 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.342247 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.167909 16609 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.344410 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.316576 16782 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:43.325953 16636 raft_consensus.cc:993] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:43.314014 16700 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:43.350136 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.316274 16779 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.274416 16679 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.359342 16609 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:43.362874 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:43.366568 16715 consensus_meta.cc:287] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.002s
I20260709 13:04:43.352847 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.370419 16180 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:43.370604 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:43.371680 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.367427 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.391563 15511 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:43.393563 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.372366 16700 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.408891 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.377921 16782 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.390755 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:43.410512 15613 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd880 after lost signal to thread 15375
I20260709 13:04:43.406131 16781 raft_consensus.cc:1081] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:43.448035 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.457767 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:43.384219 16713 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.451202 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.408572 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:43.395955 16779 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:43.470809 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:43.419307 16782 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.462724 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:43.403016 16715 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.416759 16700 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:43.532208 15512 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.016s	sys 0.051s
W20260709 13:04:43.533478 15512 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.017s	sys 0.051s
I20260709 13:04:43.533931 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:43.491788 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 175898us
I20260709 13:04:43.516163 16182 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:43.535558 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:04:43.467888 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 163590us
I20260709 13:04:43.492847 15407 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:43.430297 15585 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:43.540560 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 52014.7us
I20260709 13:04:43.540963 15587 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.541597 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.504825 16679 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:43.505412 15513 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:43.542778 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.505824 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.509337 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.519968 15586 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.523355 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.494112 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.527310 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:43.488607 16794 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.291s	user 0.000s	sys 0.002s
I20260709 13:04:43.530495 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.534322 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:43.503332 16775 consensus_meta.cc:287] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 13:04:43.534512 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.557585 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.492015 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:43.421800 16682 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.007s
I20260709 13:04:43.525822 16608 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:43.546427 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 51109.2us
I20260709 13:04:43.480990 16764 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:43.557376 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.582379 16764 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.583161 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.584319 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:43.584779 16764 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:43.585390 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:43.565496 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.586452 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.586632 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.587515 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.556953 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.589799 15518 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.590890 15518 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:43.558657 16182 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:43.542016 15613 debug-util.cc:398] Leaking SignalData structure 0x7b0800289b40 after lost signal to thread 15467
I20260709 13:04:43.472851 16145 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:04:43.598227 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 143046us
W20260709 13:04:43.598730 15613 debug-util.cc:398] Leaking SignalData structure 0x7b08003663a0 after lost signal to thread 15542
W20260709 13:04:43.600610 15613 debug-util.cc:398] Leaking SignalData structure 0x7b080035e480 after lost signal to thread 15616
I20260709 13:04:43.579739 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.580202 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:43.608624 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:43.581288 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:43.609927 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 139229us
I20260709 13:04:43.608669 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:43.610817 15511 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.606879 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.611155 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:43.531961 16177 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:43.545943 16761 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:43.625063 15509 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.631366 15590 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.560576 16801 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.636005 15585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d40d294abeec453098d547799a79f7c5"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:43.532894 16573 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:43.645318 16715 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.645823 16802 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.646658 16713 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.648725 16771 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:43.580041 16775 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.609470 16797 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.650624 15585 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.592552 16682 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.656973 15440 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:43.565389 15514 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:43.662928 16711 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.601679 16799 raft_consensus.cc:2804] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:43.664649 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.677062 16783 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:43.677795 16799 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:43.678251 16799 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.678782 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.662901 15511 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
W20260709 13:04:43.657570 15613 debug-util.cc:398] Leaking SignalData structure 0x7b080035ed60 after lost signal to thread 16206
W20260709 13:04:43.667923 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56890.1us
I20260709 13:04:43.630462 16761 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.669974 15585 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.681910 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:43.674212 15516 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.675021 16573 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:43.676471 16608 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.676690 15592 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.677374 15438 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:43.682181 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.686880 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:43.704022 16775 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.680370 16771 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.704713 15589 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.709110 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:43.711683 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.711967 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.717314 15585 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.719431 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:43.722770 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.661933 16801 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.725317 16655 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.726306 16608 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:43.726372 16650 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:43.697465 16779 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:43.728012 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:43.720973 16776 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.706429 16711 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.723001 16807 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.722860 16636 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.736622 16608 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:43.753353 16608 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:43.753576 16771 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.700580 16679 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.755414 16801 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.680217 16609 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 13:04:43.745105 16778 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.003s
I20260709 13:04:43.757097 16609 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.756858 16778 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.757503 16609 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:43.745378 16711 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.687819 16761 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.760811 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:43.761317 16575 consensus_meta.cc:287] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.694s	user 0.007s	sys 0.012s
I20260709 13:04:43.761636 15588 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:43.761883 16575 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:43.746098 16783 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:43.764587 15443 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:43.698926 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:04:43.766651 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 67855.7us
I20260709 13:04:43.770310 16783 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.771235 16783 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:43.685382 16715 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:43.760527 16639 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.632s	user 0.013s	sys 0.000s
I20260709 13:04:43.725134 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.700122 16803 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.755798 16682 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.734632 15585 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:43.780257 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 55197.6us
W20260709 13:04:43.782269 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 103560us
I20260709 13:04:43.783245 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:43.783614 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.781606 16631 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.758867 16609 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.792301 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.795809 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.780994 16778 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:43.797680 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.786021 16782 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.792711 16631 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.801749 16782 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:43.804481 15588 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.805963 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.781888 16639 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.792923 16803 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.814131 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.795382 16760 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.808995 16730 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:04:43.814397 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.822510 15406 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.822510 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.824827 15584 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.825167 16782 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.825376 16650 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.826035 16730 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.826427 16730 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:43.826579 16719 consensus_queue.cc:1059] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:43.822942 16679 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.830190 16558 raft_consensus.cc:993] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:43.830533 16808 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.830834 16558 raft_consensus.cc:1081] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:43.830248 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1017) took 1010 ms. Trace:
I20260709 13:04:43.814296 16609 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.838176 16655 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:43.846069 16655 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.846484 16655 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:43.847605 16655 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.839272 16761 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.839684 16730 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.844287 16575 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.797257 16783 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:43.850832 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:43.854677 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 312034us
I20260709 13:04:43.821815 16700 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.863088 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:43.879802 16700 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.814786 16814 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.881088 15591 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:43.864552 16639 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:43.868867 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.875759 16498 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:43.877017 16146 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.832077 15512 rpcz_store.cc:276] 0709 13:04:42.819980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.824071 (+  4091us) service_pool.cc:224] Handling call
0709 13:04:42.896322 (+ 72251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:42.896807 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:42.896835 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:42.902474 (+  5639us) log.cc:844] Serialized 26 byte log entry
0709 13:04:43.019679 (+117205us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b180036aae0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:04:43.533930 (+514251us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:43.661259 (+127329us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.665277 (+  4018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.665353 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.813274 (+147921us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b180036aae0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:04:43.829887 (+ 16613us) raft_consensus.cc:1685] finished
0709 13:04:43.829924 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.830152 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1866,"prepare.queue_time_us":131949,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":3589,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":23638,"spinlock_wait_cycles":11935744,"thread_start_us":609893,"threads_started":2,"wal-append.queue_time_us":738444}
I20260709 13:04:43.882277 15588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:43.896394 16808 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.903191 15588 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.870026 16655 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.903750 15588 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.887212 16730 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.870512 16803 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.890784 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.899912 16498 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:43.913851 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.917418 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.920061 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.867496 16608 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:43.909714 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.717s (SENT) [suppressed 3 similar messages]
W20260709 13:04:43.988204 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 63754.2us
I20260709 13:04:43.909070 16558 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:43.911568 16791 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.991321 15515 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.992868 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:43.993427 16558 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:43.994035 16558 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.925911 16814 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.996039 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:43.997786 16609 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.915650 16760 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.925421 16808 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.002486 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.003960 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.005622 15512 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.004539 16182 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.007875 16181 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.926021 16719 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.015205 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.058162 16498 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:44.017534 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 359721us
W20260709 13:04:44.064479 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 71692us
I20260709 13:04:44.065559 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.067333 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.001626 16697 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:44.066201 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:43.916060 16799 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.011234 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:44.068127 16793 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.445s	user 0.005s	sys 0.000s
I20260709 13:04:44.070714 16818 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:44.077764 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.068117 15592 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.090960 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.093940 16498 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:44.094566 16498 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:44.097360 15440 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:44.114737 16804 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:04:44.121068 15434 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.058713 16784 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.095417 16498 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.140516 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:44.099252 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:44.144548 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.068094 16573 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
W20260709 13:04:44.131793 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 222094us
I20260709 13:04:44.154835 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.144910 15592 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:44.058295 16789 consensus_queue.cc:1059] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:04:44.156526 16146 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.157272 16789 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.157447 16783 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:44.157747 16789 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:44.144569 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.145265 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.145870 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.145793 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.166815 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.133117 16823 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:04:44.148746 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.152251 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.181303 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.100348 16761 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:44.171023 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.172075 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.172771 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:44.173091 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.175268 15509 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:44.183825 15441 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:44.187960 16146 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.189121 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.192713 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:44.192994 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.194370 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.197674 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.201673 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.206465 15555 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.174825 16715 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.173767 16608 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:44.219724 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.221134 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.140763 16808 consensus_queue.cc:1059] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:04:44.134466 16784 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.223752 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:44.237926 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.239784 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:44.241458 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.242599 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.202389 16791 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:44.219398 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:44.247126 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.227859 16181 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.196226 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:44.231813 16713 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.245411 16719 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:44.256556 16823 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:44.259186 16799 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:44.261060 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.158882 16789 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.264724 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.266116 16784 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:44.269021 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.270380 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.263239 15437 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.222996 16179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95"
dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:52916
I20260709 13:04:44.223966 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.248522 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.219290 16575 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.191780 16783 raft_consensus.cc:697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:44.252621 16771 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.252723 15516 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.253700 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.299352 15441 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:44.245867 15512 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:44.300771 15513 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.302416 15406 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:04:44.276401 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.196303 16821 consensus_queue.cc:1059] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
W20260709 13:04:44.288996 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 65066.1us
I20260709 13:04:44.284498 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.311286 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.348412 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.288010 16823 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:44.308430 16636 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:44.350430 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52560.8us
I20260709 13:04:44.306124 16179 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.410531 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.409391 16829 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:44.416656 15438 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:44.431974 15441 raft_consensus.cc:3055] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.432427 15441 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:44.433249 15441 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:44.418637 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 120767us
I20260709 13:04:44.418821 16713 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:44.419605 15588 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.022s
I20260709 13:04:44.420677 16639 consensus_queue.cc:1059] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:44.281695 16826 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.424021 16783 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.424585 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:44.347258 16814 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.304705 16784 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.346921 16808 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.350291 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.417877 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.441102 15441 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.427875 16584 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.434459 16179 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.435186 16700 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:44.451229 15588 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.473816 16778 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.483835 16778 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.485276 15588 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:44.458310 16584 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.488741 16584 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:44.486105 16778 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:44.492257 16831 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:44.495302 16833 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.469791 16700 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.502288 16700 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:44.446192 16829 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.504741 16829 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:44.508407 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:44.509366 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.510730 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1278) took 1213 ms. Trace:
I20260709 13:04:44.511313 15591 rpcz_store.cc:276] 0709 13:04:43.296797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.319472 (+ 22675us) service_pool.cc:224] Handling call
0709 13:04:43.319880 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.881790 (+561910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.509551 (+627761us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540015efd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:44.509773 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289973632}
I20260709 13:04:44.513264 16650 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.513863 16650 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:44.518863 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1283) took 1207 ms. Trace:
W20260709 13:04:44.523772 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 106006us
I20260709 13:04:44.462759 16558 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.533723 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:44.533097 15441 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:44.535106 15440 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.525892 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.535604 15440 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:44.536535 15440 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.537782 15440 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.528733 16778 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.548523 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:44.575800 16778 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.536908 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:44.556596 16819 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.424s	user 0.003s	sys 0.000s
I20260709 13:04:44.556972 15440 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:44.561344 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:44.578296 16778 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:44.569792 16558 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:44.515053 16650 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:44.572837 16730 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.004s
I20260709 13:04:44.519609 15586 rpcz_store.cc:276] 0709 13:04:43.310870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.411002 (+100132us) service_pool.cc:224] Handling call
0709 13:04:43.472182 (+ 61180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.560266 (+ 88084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.518387 (+958121us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540028b4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:44.518749 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48870784}
I20260709 13:04:44.581538 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.583070 16650 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.583765 16558 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:44.573103 15437 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.539776 16655 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.533031 16700 consensus_queue.cc:1059] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:04:44.587625 16700 raft_consensus.cc:3055] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.588001 16700 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:44.588250 16498 raft_consensus.cc:3055] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:44.588676 16498 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:44.589105 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.588958 16700 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.589977 16776 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.589542 16498 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.590479 16700 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.568581 16822 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.529362 16636 raft_consensus.cc:697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:44.591797 16822 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:44.592482 16636 consensus_queue.cc:237] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.592756 16822 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.593957 16822 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.596836 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:44.597733 16180 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:44.598783 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:44.599742 16815 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.600163 16815 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:44.601845 15437 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:44.579303 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:44.579818 16707 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:44.591367 16498 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.503063 16179 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:44.600942 16778 consensus_queue.cc:1175] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d225833a2cbf4a5995fdbbb1292d1918" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
W20260709 13:04:44.608896 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 258688us
I20260709 13:04:44.613297 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.614710 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.615800 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.620253 15511 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.606086 16707 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.620025 16558 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.629194 16558 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.631888 16558 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:44.601167 16815 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.633229 16815 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:44.636006 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.636474 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.629196 16181 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:44.617704 16711 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:44.607916 16784 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:04:44.641585 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:44.656811 15515 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.658133 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.623775 16760 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.635037 16707 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.626979 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.665740 15588 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:44.664662 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:44.669531 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.669548 16711 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:44.618108 16575 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:04:44.679469 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.676157 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.680739 15588 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:44.672184 16711 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.677395 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.681170 15518 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:44.685902 16182 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.678081 16831 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.686168 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:44.687165 15591 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:44.690531 16839 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:04:44.693491 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.695518 16784 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.697772 15407 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.698582 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.699848 15442 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:44.664871 16837 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:04:44.708525 16838 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:04:44.710073 16655 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:44.711490 16831 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.711966 16831 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:44.712879 16831 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.714010 16787 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:04:44.714236 16831 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.716634 15407 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.715235 16787 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.725425 16787 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:44.726277 16783 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:44.726513 16787 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.731594 16821 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.733417 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.735064 15590 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.705024 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:04:44.750249 16820 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.597s	user 0.004s	sys 0.000s
I20260709 13:04:44.750422 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.751714 15584 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:04:44.753626 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 48756.4us
I20260709 13:04:44.760453 16182 raft_consensus.cc:1240] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.715410 16179 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:44.767776 16818 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.768303 16818 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:44.768803 16609 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.769686 16782 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.769224 16818 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.772102 15584 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.774246 15585 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.776830 16818 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.777837 16575 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.769227 16609 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:44.818586 16609 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.820703 16821 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:44.821192 16821 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:44.822108 16609 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.822257 16821 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.780373 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 97) took 2081 ms. Trace:
I20260709 13:04:44.781435 16787 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.782362 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.782485 16713 consensus_queue.cc:1059] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:44.829195 16821 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:44.830571 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.783612 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.831971 15513 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:44.788180 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:44.799841 16824 raft_consensus.cc:3055] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.798700 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.833139 16824 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:44.833824 16782 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.833876 16778 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.834190 16824 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.834532 16778 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.801463 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:44.836082 15592 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:44.802582 16655 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:44.838300 16655 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:44.287662 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:44.829349 16713 raft_consensus.cc:3055] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.839910 16713 raft_consensus.cc:740] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:44.834553 16782 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.835451 16824 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.840912 16713 consensus_queue.cc:260] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.804252 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:44.837721 16778 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:44.842315 15591 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:44.842351 16838 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.843122 16838 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.839509 16655 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.825165 15337 rpcz_store.cc:276] 0709 13:04:42.698819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.702994 (+  4175us) service_pool.cc:224] Handling call
0709 13:04:44.780250 (+2077256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:43.997988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:43.998547 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:43.998600 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:04:43.998613 (+    13us) tablet.cc:662] Decoding operations
0709 13:04:43.999116 (+   503us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:43.999167 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:43.999194 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:43.999471 (+   277us) tablet.cc:701] Row locks acquired
0709 13:04:43.999484 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:04:43.999657 (+   173us) write_op.cc:270] Start()
0709 13:04:43.999798 (+   141us) write_op.cc:276] Timestamp: P: 1783602283999611 usec, L: 0
0709 13:04:43.999820 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:04:44.000629 (+   809us) log.cc:844] Serialized 1044 byte log entry
0709 13:04:44.232503 (+231874us) op_driver.cc:464] REPLICATION: finished
0709 13:04:44.233082 (+   579us) write_op.cc:301] APPLY: starting
0709 13:04:44.233175 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:44.233312 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:44.233417 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:44.233809 (+   392us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:44.234018 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:04:44.234173 (+   155us) write_op.cc:312] APPLY: finished
0709 13:04:44.234415 (+   242us) log.cc:844] Serialized 28 byte log entry
0709 13:04:44.234580 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:44.234673 (+    93us) write_op.cc:454] Released schema lock
0709 13:04:44.234711 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:44.252141 (+ 17430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:44.252175 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":404213,"reported_tablets":3,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":348,"apply.run_cpu_time_us":2183,"apply.run_wall_time_us":18995,"num_ops":2,"prepare.queue_time_us":1167855,"prepare.run_cpu_time_us":3127,"prepare.run_wall_time_us":11952,"replication_time_us":232521}]]}
I20260709 13:04:44.873997 16639 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.874709 16639 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:44.897514 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 180938us
I20260709 13:04:44.898447 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.903383 16182 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:44.905156 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.906417 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:44.909550 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 211048us
I20260709 13:04:44.910478 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.912441 15555 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.915680 15341 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 198) took 2673 ms. Trace:
I20260709 13:04:44.919718 15406 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:44.925160 15590 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:44.927217 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:44.933400 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.896577 16713 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.920495 16789 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.951650 15515 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:44.953788 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:44.935021 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.956897 15590 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.957041 15436 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.916651 16714 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:44.959318 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59558.2us
I20260709 13:04:44.924065 16575 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.966301 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.934242 16655 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.931710 16631 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.920989 15341 rpcz_store.cc:276] 0709 13:04:42.242731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.242953 (+   222us) service_pool.cc:224] Handling call
0709 13:04:44.915499 (+2672546us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:42.995089 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:43.094940 (+ 99851us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:43.094983 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:04:43.097338 (+  2355us) tablet.cc:662] Decoding operations
0709 13:04:43.229753 (+132415us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:43.247879 (+ 18126us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:43.247949 (+    70us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:04:43.253493 (+  5544us) tablet.cc:701] Row locks acquired
0709 13:04:43.253522 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:04:43.253723 (+   201us) write_op.cc:270] Start()
0709 13:04:43.263294 (+  9571us) write_op.cc:276] Timestamp: P: 1783602283253668 usec, L: 0
0709 13:04:43.269180 (+  5886us) op_driver.cc:348] REPLICATION: starting
0709 13:04:43.385680 (+116500us) log.cc:844] Serialized 1705 byte log entry
0709 13:04:43.705386 (+319706us) op_driver.cc:464] REPLICATION: finished
0709 13:04:43.931432 (+226046us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd52e28 00007fcf7f78d581 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d 000000000038f354 000000000038f199
0709 13:04:44.008139 (+ 76707us) write_op.cc:301] APPLY: starting
0709 13:04:44.008241 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:44.008419 (+   178us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:44.008442 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:44.009177 (+   735us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:44.009393 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:04:44.009556 (+   163us) write_op.cc:312] APPLY: finished
0709 13:04:44.093636 (+ 84080us) log.cc:844] Serialized 40 byte log entry
0709 13:04:44.127768 (+ 34132us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:44.133606 (+  5838us) write_op.cc:454] Released schema lock
0709 13:04:44.141301 (+  7695us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:44.185246 (+ 43945us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:44.192194 (+  6948us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":208349,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":302428,"apply.run_cpu_time_us":3444,"apply.run_wall_time_us":166937,"num_ops":4,"prepare.queue_time_us":274920,"prepare.run_cpu_time_us":13034,"prepare.run_wall_time_us":993167,"raft.queue_time_us":214086,"raft.run_cpu_time_us":78560,"raft.run_wall_time_us":206394,"replication_time_us":436040,"spinlock_wait_cycles":43691392,"thread_start_us":618243,"threads_started":4,"wal-append.queue_time_us":72876}]]}
W20260709 13:04:44.968453 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.932088 16715 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.969020 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:44.944458 16730 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:44.980535 16730 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:44.981060 16730 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.969985 16711 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.984738 16179 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.947933 16558 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:44.989166 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.989745 16707 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:44.969553 16145 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.004431 16787 consensus_queue.cc:1059] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:45.005599 16822 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.977697 16584 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.006091 16822 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:45.005752 16730 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.007210 16822 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.008260 16730 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:44.994405 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.975346 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:44.995697 15590 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:45.010814 16783 raft_consensus.cc:2804] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.011502 16783 raft_consensus.cc:697] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:45.011703 16714 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:45.012637 16783 consensus_queue.cc:237] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:44.964550 16791 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.016799 16791 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:45.017836 16791 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.002766 16835 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:44.969790 15586 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.024150 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.031629 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:45.037211 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:45.038334 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.022892 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:04:45.039249 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 64069.1us
I20260709 13:04:45.042070 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.047714 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.048053 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.050688 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.050802 15590 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
W20260709 13:04:45.056334 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.071446 15513 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:45.070773 15337 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:45.073390 15406 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:45.073163 15337 catalog_manager.cc:5697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 2, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:45.029574 16573 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.008841 16822 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.058758 16837 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.060223 16715 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.063472 16714 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.028532 16784 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:04:45.069782 16639 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:45.086140 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:45.098881 16181 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:45.099845 16584 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.082301 16573 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:45.097829 16823 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:45.115577 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.083293 16782 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.085080 16761 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:45.100550 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 952f15e68b0745e5a8ca26a3b527cab0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:45.119470 16823 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.101603 16831 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:45.099900 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:45.120878 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.107946 16813 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:45.128753 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.114156 16573 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.132655 16707 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.135989 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:45.104733 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54143.4us
I20260709 13:04:45.138772 16838 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.137960 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.144724 16823 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:45.145138 16761 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:45.168030 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:45.168632 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 81278.8us
I20260709 13:04:45.168798 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.170840 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:45.172868 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.174419 16575 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.175240 16575 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.176254 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.177076 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.177381 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:45.177079 15591 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:45.180675 15515 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:45.186614 15588 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.188862 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:45.175361 16650 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:04:45.195825 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.197166 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.198469 16498 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.199753 16639 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:45.206493 16700 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.016s
I20260709 13:04:45.208988 16761 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.212714 16824 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.133754 16831 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:45.219858 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 49111.8us
I20260709 13:04:45.228185 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.257313 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:04:45.264619 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 67532.8us
I20260709 13:04:45.268215 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:45.269550 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.270627 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.265676 16848 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:45.282223 16831 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:45.284660 16815 consensus_meta.cc:287] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.651s	user 0.016s	sys 0.008s
I20260709 13:04:45.286720 15443 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.287139 15443 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:45.287955 15517 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:45.289270 15443 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.290120 16835 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:45.290603 15443 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.269611 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.245754 16822 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.291666 15512 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:45.292093 16822 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.294273 16822 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.296597 16650 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.297266 16650 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.298183 16783 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:45.298724 16783 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.300153 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.309784 15512 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:45.310668 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:45.309206 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.305416 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.311980 15513 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:45.312294 15517 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:45.311262 15512 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.307436 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.308028 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.314371 15518 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:45.311282 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.308889 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.282810 15340 catalog_manager.cc:5697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.303725 15589 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:45.323830 15587 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:45.325006 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:45.330327 15440 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.332921 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.332221 15443 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:45.335872 15435 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:45.341451 15440 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.343742 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:45.349334 15517 raft_consensus.cc:1240] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.350891 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:45.351382 15512 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:45.351819 15443 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:45.266357 16776 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.353849 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.356796 15515 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.243687 16837 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:45.299516 16650 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.306288 16802 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.365432 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.374233 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.301128 16783 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.369293 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.372524 15511 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:45.368266 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.385064 15585 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
W20260709 13:04:45.358443 16829 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:04:45.385084 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.352746 16584 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.267457 16826 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:04:45.386351 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.414439 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.360150 16636 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.359807 16730 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.416765 16498 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:45.358927 16776 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:45.359952 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.380730 16639 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:45.388581 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:45.389670 16771 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:45.439881 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.448567 15590 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:45.411199 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.401633 16584 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.432883 16655 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:45.412202 16824 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:45.442426 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68285.5us
I20260709 13:04:45.464268 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.425428 16782 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:45.435631 16609 consensus_meta.cc:287] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.613s	user 0.014s	sys 0.002s
I20260709 13:04:45.380549 16822 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:04:45.463318 15591 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.432844 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:45.436647 16776 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.380268 16847 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:04:45.468492 15442 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.412057 16818 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:04:45.446151 15510 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.415863 16573 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.485350 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.442510 15514 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:45.432327 16815 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:04:45.461784 16584 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.489118 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.446460 16639 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.477476 16655 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:45.482528 16700 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.505775 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:45.489702 16714 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.494575 16787 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.511708 16787 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.512364 16787 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.458354 16771 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.515444 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.518113 16573 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.490032 15516 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:45.528123 16812 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:45.532259 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:45.522614 16859 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.534067 16760 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:45.538833 16851 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:04:45.540239 16831 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:45.540606 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.541335 16831 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.541713 16831 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:45.543411 16639 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:45.543776 16824 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.523588 16575 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.543992 16822 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:45.488479 16837 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.547560 15518 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.551141 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:45.553725 15443 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:45.558182 16776 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.560707 16776 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.577234 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.580283 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.562005 16802 raft_consensus.cc:2764] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:04:45.535737 16558 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:04:45.581229 15509 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
W20260709 13:04:45.586016 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 145180us
I20260709 13:04:45.586532 16824 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.582266 16822 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:04:45.618753 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:45.629908 16776 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:45.631812 16776 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.608829 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:45.636068 16771 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:45.636245 16791 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:45.636866 16791 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.615864 16815 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.640414 16815 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:45.640879 16776 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.641744 16815 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.649226 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.651006 15518 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:45.652428 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.653745 16865 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.653898 16846 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:45.651494 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:45.586337 16831 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:45.663349 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 82806.5us
I20260709 13:04:45.654588 16846 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.664700 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:45.666567 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:45.668166 16771 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.668852 16771 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:45.669425 16771 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.612421 16655 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.673228 15435 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.674248 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.675639 15518 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:45.676237 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:45.677446 15436 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:45.684630 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:45.687652 16860 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:04:45.709882 16837 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:45.739303 15512 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.741333 16812 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.704530 16787 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:45.745999 16789 consensus_meta.cc:287] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.779s	user 0.009s	sys 0.006s
I20260709 13:04:45.738157 16865 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:45.714118 16700 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:04:45.788525 15443 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:45.714008 16650 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:04:45.748229 16837 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:04:45.804760 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 109861us
W20260709 13:04:45.797420 16869 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:04:45.807828 16859 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.792194 16573 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.815974 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.818790 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:45.821223 16846 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.824194 15591 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:45.801934 16837 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:45.826447 16848 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.833575 15586 raft_consensus.cc:2376] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2. Re-sending same reply.
I20260709 13:04:45.829039 16573 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.793193 16865 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.849388 16865 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:45.844760 16870 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:04:45.855307 16837 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.856578 16636 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.856881 16837 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.843212 16848 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:45.787062 16812 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:45.860526 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:45.865633 16575 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.861545 16771 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.865259 15517 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:45.868711 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:45.869588 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:45.870390 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.871752 15436 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:45.876327 15591 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:45.872370 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:45.873034 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:45.879449 15443 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.875864 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.882421 15517 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:45.885560 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.862578 16812 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:45.889972 16822 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:45.890278 16818 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.877600 16636 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.891412 16787 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.904307 16636 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.906978 16636 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.887996 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:45.908506 16178 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:45.888263 16714 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.910569 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.900856 16573 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:45.902637 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:45.912585 15514 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:45.910872 16714 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:45.913736 16714 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.918747 15517 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:45.884056 16848 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.927266 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.927769 15443 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:45.944068 15440 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:45.948298 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.963377 15406 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.965183 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:45.928622 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:45.967096 15589 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:45.947280 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:45.973081 15436 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:45.973901 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:45.977056 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 91586.4us
I20260709 13:04:45.978049 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:45.932045 16178 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:45.928699 16824 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:45.984359 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:45.993925 15589 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.986029 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:45.972443 16707 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:45.955222 16730 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.003641 16730 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.992797 16558 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:04:45.988240 16639 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:46.006356 16831 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.006877 16639 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.007274 16639 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:45.974642 16789 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.986908 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:45.997330 16879 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.959836 16771 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:46.002278 16880 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:46.009645 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:46.051878 15592 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:46.029191 16609 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:46.011967 16177 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:45.976286 16826 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:04:45.983407 16714 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.934140 16584 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:45.993552 16824 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:46.021625 16707 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:46.022374 15511 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:46.037149 15585 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.080634 15515 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:46.038807 15588 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.975522 16818 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:46.044091 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 43951.5us
I20260709 13:04:46.082243 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:46.047186 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60418.9us
I20260709 13:04:46.057093 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.054121 16609 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:46.060624 15587 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:46.034973 16730 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.049309 16650 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:46.068591 16852 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:46.069517 15592 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:46.075733 16714 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:46.089570 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.083740 16789 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:46.107849 16789 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.091511 16584 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.110922 16824 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.062047 16880 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:46.112311 16880 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.093030 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:46.056310 16879 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.121186 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:46.121954 15511 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.098969 15440 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.097034 16650 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.131313 16650 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.132472 16719 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:46.133064 16719 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.101264 16783 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:46.101910 16679 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:46.104274 15592 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.113710 15587 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.115527 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:46.104038 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:46.127784 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:46.152582 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 48638.5us
I20260709 13:04:46.152899 15512 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:46.094971 15586 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:46.097630 16711 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.129570 16791 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.140185 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:46.151659 15511 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:46.140708 16719 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.140357 16609 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:46.143924 15589 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:46.144076 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:46.146193 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:46.157022 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:46.160697 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:46.135082 16879 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.110960 16789 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:46.160032 16831 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.161381 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:46.171276 15592 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 4: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:46.165912 16711 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.180756 15587 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:46.190963 15514 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:46.160449 16818 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:04:46.160276 16847 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:04:46.182300 16821 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.192201 16177 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:46.190013 16831 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:46.215955 16831 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.199846 16584 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.167613 16865 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:04:46.191965 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 84962.6us
I20260709 13:04:46.194885 16839 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:04:46.265022 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:46.266390 16893 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.257949 16880 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.246189 16711 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:46.225219 16821 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:46.270613 16821 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.241916 16650 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.278247 16650 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.252352 16639 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.270550 16880 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.289747 16639 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:46.300074 16879 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.309783 16879 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:46.343297 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 196920us
W20260709 13:04:46.349730 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.355412 15443 raft_consensus.cc:2368] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:46.355626 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:46.357471 15583 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:46.366214 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:46.368585 15588 raft_consensus.cc:2368] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4.
I20260709 13:04:46.371716 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.376693 16145 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:46.388239 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:46.389392 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:46.389710 16177 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.390511 15435 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.392571 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:46.403213 16700 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.404955 16700 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.407575 15406 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:46.409255 16700 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:46.409566 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.423391 16893 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.441654 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:46.445021 16636 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.446537 16636 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:46.447469 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:46.448704 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:46.452100 15514 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.449927 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:46.449951 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:46.448938 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.445022 15592 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:46.461364 15440 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.424873 16893 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.474472 16558 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.475929 16558 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.476743 16636 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.483507 16899 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.448751 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:46.487239 15436 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:46.490674 16713 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.491948 16713 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.498756 16893 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:46.501554 16838 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:46.502259 16713 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:46.508214 15435 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:46.518460 16838 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.524369 16650 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.547359 15517 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.552843 15514 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:46.554137 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:46.555576 15592 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:46.558833 16730 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.560015 16730 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.561295 16715 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.562155 16715 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.565457 16715 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:46.544144 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:46.568277 15583 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.573726 16730 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.584239 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:46.586923 15436 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:46.590050 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:46.591167 15436 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:46.594367 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:46.595996 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 220169us
I20260709 13:04:46.596181 15435 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:04:46.602150 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:46.610667 15583 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:46.611893 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.615985 16730 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.616952 16730 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.620055 16730 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.620635 15340 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 203) took 1474 ms. Trace:
I20260709 13:04:46.623574 16730 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:46.624701 16730 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.600365 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:46.642268 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 952f15e68b0745e5a8ca26a3b527cab0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:46.644088 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:46.653390 16824 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.705212 16823 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:46.705958 16823 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:46.655382 16730 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.659713 15516 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:46.714108 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:46.715425 15588 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:46.718207 16848 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.707429 16823 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.660739 15512 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:46.665330 16584 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.650911 16609 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.599483 16631 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:46.698414 16802 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.627213 16558 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.736830 15517 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:46.794866 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.781961 16631 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.806167 16631 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.806311 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:46.802371 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:46.808091 16852 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.803023 16802 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:46.814689 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 63461.6us
I20260709 13:04:46.752848 16838 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:46.835639 16852 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:46.836469 16852 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.792362 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.848063 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:46.786811 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.853341 15442 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:46.858285 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:04:46.858649 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.860877 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.621428 15340 rpcz_store.cc:276] 0709 13:04:45.145670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.145848 (+   178us) service_pool.cc:224] Handling call
0709 13:04:46.620149 (+1474301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:45.608831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:45.637881 (+ 29050us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:45.637942 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:04:45.637965 (+    23us) tablet.cc:662] Decoding operations
0709 13:04:45.638368 (+   403us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:45.638418 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:45.638448 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:45.638681 (+   233us) tablet.cc:701] Row locks acquired
0709 13:04:45.638699 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:04:45.638847 (+   148us) write_op.cc:270] Start()
0709 13:04:45.638969 (+   122us) write_op.cc:276] Timestamp: P: 1783602285638805 usec, L: 0
0709 13:04:45.638997 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:04:45.639741 (+   744us) log.cc:844] Serialized 540 byte log entry
0709 13:04:45.853448 (+213707us) op_driver.cc:464] REPLICATION: finished
0709 13:04:45.912713 (+ 59265us) write_op.cc:301] APPLY: starting
0709 13:04:45.912795 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:45.912899 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:45.912994 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:45.913287 (+   293us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:45.913453 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:45.913503 (+    50us) write_op.cc:312] APPLY: finished
0709 13:04:45.913714 (+   211us) log.cc:844] Serialized 22 byte log entry
0709 13:04:45.913959 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:45.914042 (+    83us) write_op.cc:454] Released schema lock
0709 13:04:45.914099 (+    57us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":21408,"reported_tablets":11,"spinlock_wait_cycles":10624,"child_traces":[["op",{"apply.queue_time_us":53168,"apply.run_cpu_time_us":1724,"apply.run_wall_time_us":1722,"num_ops":1,"prepare.queue_time_us":251462,"prepare.run_cpu_time_us":2921,"prepare.run_wall_time_us":36804,"replication_time_us":210931,"thread_start_us":161885,"threads_started":1}]]}
I20260709 13:04:46.786682 16584 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.865765 15512 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:46.867667 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:46.872997 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:46.876341 16789 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.877350 16835 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.880412 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:46.881412 16823 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:46.868564 15511 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:46.873824 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:46.890029 16707 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.890887 16852 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:46.891997 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.889038 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.896927 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:46.903347 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 175449us
W20260709 13:04:46.894867 16177 consensus_meta.cc:287] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.503s	user 0.017s	sys 0.004s
I20260709 13:04:46.907024 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:46.891954 15516 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:46.912992 15517 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:46.894966 16838 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:04:46.923883 15512 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.908332 16177 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:46.929399 16893 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:46.930156 16893 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:46.931407 16802 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:46.903368 16835 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.932830 16835 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:46.933477 16895 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.656s	user 0.003s	sys 0.017s
I20260709 13:04:46.933719 16893 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:46.934114 16835 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:46.936297 15512 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:46.943224 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:46.900112 16707 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:46.948318 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68107.7us
I20260709 13:04:46.968261 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:46.970059 16655 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:46.970609 16655 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:46.977211 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.963567 15556 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:46.938434 15338 catalog_manager.cc:5697] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.991611 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:46.983457 16789 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:47.001055 16707 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.002835 16711 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:47.010248 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.011430 15587 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:47.011870 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.013350 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.014588 15584 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:47.003527 16711 raft_consensus.cc:697] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:47.016938 16789 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.019301 15588 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:46.971109 16655 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.043828 16815 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.018641 16711 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:47.058877 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.061055 16868 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.071256 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.081202 15510 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:47.082931 16823 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:47.083516 16584 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.083971 16823 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.108716 16823 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.109643 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.110747 15437 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:47.118062 15517 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:47.130129 16178 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:47.136510 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:47.138923 16860 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:47.238945 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 275503us
I20260709 13:04:47.239946 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1168) took 1156 ms. Trace:
I20260709 13:04:47.243729 15443 rpcz_store.cc:276] 0709 13:04:46.081834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.081986 (+   152us) service_pool.cc:224] Handling call
0709 13:04:47.232299 (+1150313us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400225bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:47.237980 (+  5681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623381248}
W20260709 13:04:47.253192 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.254232 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.255311 16824 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:47.256448 16868 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:47.257022 16868 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.263648 15512 raft_consensus.cc:1813] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Handling vote request from an unknown peer d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:47.264487 15512 raft_consensus.cc:2410] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:04:47.256197 16824 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.274336 16824 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.275508 16921 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:47.276274 16921 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.278806 16921 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.279281 16711 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:47.279839 16655 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.280066 16711 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.290354 16824 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.291410 16824 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.294054 16824 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.299307 16886 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:47.285946 16823 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.310549 16823 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:47.313146 16823 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:47.318256 16711 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.319247 16636 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.319924 16636 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.322667 16636 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.324407 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.325557 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.326267 15510 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:47.329133 16584 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:47.333712 15407 leader_election.cc:400] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4.
I20260709 13:04:47.336753 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:47.338191 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:47.338869 16584 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.339006 16636 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.339998 16636 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:47.340477 16636 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:47.341778 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 51909.4us
I20260709 13:04:47.339494 16584 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.342964 16584 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:47.343655 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.346316 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.347043 15591 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:47.347807 16711 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.348445 16714 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.348404 16711 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.349061 16714 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.351156 16921 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.352630 15585 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:47.352958 16655 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.343039 15556 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:47.354319 15588 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:47.356096 16608 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:47.371021 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.371861 16920 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.371424 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:47.380767 15556 leader_election.cc:400] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:47.381181 15556 leader_election.cc:403] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:47.351092 16711 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:47.385779 16922 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.059s	user 0.003s	sys 0.000s
I20260709 13:04:47.386046 15591 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:47.387939 16898 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:47.381748 16802 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.388943 16898 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:47.389201 16802 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.378696 16868 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:47.391908 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.380702 16902 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.374652 16730 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:47.392544 16902 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.391237 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.393033 16902 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.393342 15588 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:47.393909 16868 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:47.394407 15591 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:47.372165 16823 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:47.380885 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71606.5us
I20260709 13:04:47.304021 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.400044 15512 raft_consensus.cc:2410] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:04:47.365825 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:47.401463 16776 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:47.402010 16776 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.402412 16776 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:47.404914 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:47.351419 16714 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.377041 16608 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:47.367851 16921 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.364617 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:47.385013 16655 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:47.417088 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.418828 16655 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:47.377126 16920 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.403924 16898 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.398789 16802 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.433247 16787 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:47.422132 16573 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:04:47.434921 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:47.431694 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.436878 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.437521 15588 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
W20260709 13:04:47.431607 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52327.3us
I20260709 13:04:47.392874 16730 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:47.445432 15585 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:47.421701 16707 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.407948 16823 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.430226 16655 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.432483 16868 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.469797 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:47.471381 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.474421 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.474726 16826 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:04:47.475770 15440 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:47.476186 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.471882 16787 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:04:47.451498 16707 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.483827 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.488912 15435 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:04:47.494351 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 111398us
I20260709 13:04:47.501995 16818 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:47.580699 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 141486us
I20260709 13:04:47.484100 16838 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.579327 16707 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.499820 16730 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:47.501617 16921 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.596369 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:47.496855 16715 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.505064 16920 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.586266 16838 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.625455 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:47.485728 16609 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 13:04:47.589069 16815 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.646885 15443 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:47.649062 16852 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.575126 16145 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:47.632943 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.601804 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:47.658331 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:47.593568 16608 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:47.631531 16848 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:47.587903 16818 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.636289 16838 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.668061 16848 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:47.657752 16715 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:47.632357 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:47.682967 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 86736.9us
I20260709 13:04:47.652694 16852 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:47.689697 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.692317 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.688126 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:47.695633 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 92149.6us
I20260709 13:04:47.659255 16787 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:47.688515 16848 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:47.665756 15341 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 2 to 3, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.700627 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:47.681785 16609 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.688953 16826 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.689437 16899 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:47.710569 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.696647 16852 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.678119 16789 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:47.735838 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.734253 15341 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.701561 16787 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:47.740418 16181 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:47.740787 16787 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.742260 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.743084 15443 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:04:47.701284 16940 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:47.733332 16609 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:47.744185 16940 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.744823 15555 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:47.737550 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.706782 16608 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:47.656375 16815 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:47.753068 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 150512us
W20260709 13:04:47.707278 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 221938us
I20260709 13:04:47.756314 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.751739 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.746361 16609 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
W20260709 13:04:47.729308 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 952f15e68b0745e5a8ca26a3b527cab0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:47.735306 16899 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:47.788194 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.773916 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:47.780495 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.772751 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.790802 15511 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:47.732404 16818 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.777979 15589 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:47.786581 15514 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:47.772547 16823 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.800791 15435 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:47.800371 15509 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:47.747861 16584 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.816812 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.828594 15442 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:47.821537 16940 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.799134 16802 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:47.796566 16943 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.829499 16573 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.837601 16940 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:47.793605 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 82472.6us
I20260709 13:04:47.848567 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.848883 16813 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.849674 15439 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.729856 16177 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:47.853018 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.856251 16584 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:47.857816 16655 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.858708 16573 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.798971 16608 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.848018 16943 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.861403 16838 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.862571 16776 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:47.863694 16886 consensus_meta.cc:287] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.003s
I20260709 13:04:47.867929 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.847095 15513 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.784271 16921 consensus_queue.cc:1059] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:04:47.847096 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.882202 16909 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.873972 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.874344 16899 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:47.875474 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.876462 15514 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:47.877059 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:47.877275 15510 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:47.878078 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:47.947638 15518 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.880091 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:47.951368 15517 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:47.880177 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 87424.3us
I20260709 13:04:47.859411 16902 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.793457 16789 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:47.920429 15442 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:47.882503 16813 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.960382 16813 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.961517 16902 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.922947 15515 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:47.873353 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.924316 15441 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:47.847718 16636 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:47.964265 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.927603 15436 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:04:47.927074 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 91049.6us
I20260709 13:04:47.966617 15440 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:47.966936 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:47.970119 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.970184 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:47.971529 15591 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:47.972093 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.972734 15436 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:47.983516 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:47.984334 15439 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:47.937001 16715 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.986438 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:48.008970 15518 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:48.012209 15517 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:48.013816 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.014657 15590 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:47.997577 16813 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.018194 16813 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:47.928273 15435 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:47.862571 16787 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.024410 15584 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
W20260709 13:04:48.033545 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 60178.6us
I20260709 13:04:47.893965 16940 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.043895 15437 raft_consensus.cc:2955] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:48.067148 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:48.033926 16909 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.068259 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:48.048282 16787 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.070968 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:48.045233 16714 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:48.048234 16609 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:04:48.083153 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 155790us
I20260709 13:04:48.064723 16711 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:48.100971 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 132460us
I20260709 13:04:48.084421 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:48.101008 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 134137us
I20260709 13:04:48.078006 16787 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.069964 16707 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.077639 16714 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:48.079449 16946 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.109961 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.109879 15556 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:48.086177 16824 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:48.111533 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:48.116741 15556 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:48.101718 16815 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.115260 16918 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.110951 16787 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.113148 16818 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.117281 16824 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.113130 16946 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.122908 16813 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:48.158311 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:48.131702 16902 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:48.107338 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:48.113227 16711 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.128245 16848 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:48.129518 16952 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:48.155089 16787 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.198379 16949 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 13:04:48.204326 16713 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:48.183338 16886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40658 (request call id 71) took 2794 ms. Trace:
I20260709 13:04:48.165751 16946 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.163344 16815 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.187158 16902 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:48.212548 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:48.233628 15434 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.212610 16655 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.213626 16857 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.213935 16573 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.214668 16608 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.161681 16824 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.252353 16852 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.254894 16852 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:48.220867 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 107426us
I20260709 13:04:48.232005 16952 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.262982 16952 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.226843 16898 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:48.265810 16826 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.517s	user 0.002s	sys 0.009s
I20260709 13:04:48.266333 16826 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.267073 16182 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:48.268548 16707 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:48.270047 16868 consensus_meta.cc:287] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.789s	user 0.013s	sys 0.000s
I20260709 13:04:48.270563 16868 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:48.239113 16857 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.271862 16857 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:48.237455 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 154436us
I20260709 13:04:48.277029 16776 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.279850 16573 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.280524 16573 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.282851 16573 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.285151 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:48.285913 15587 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.286110 15590 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:48.287420 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.289846 15591 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:48.295090 15587 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:48.166066 16813 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.206684 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:48.186561 16838 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.161886 16920 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:04:48.218441 16714 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.238411 16713 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.333220 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:48.240634 16859 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:48.230302 16886 rpcz_store.cc:276] 0709 13:04:45.361023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.361176 (+   153us) service_pool.cc:224] Handling call
0709 13:04:45.465446 (+104270us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d311c0 00007fcf80d1d9d9 00007fcf80d1d442 00007fcf7a299c54
0709 13:04:45.718504 (+253058us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b540029d9a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd4520 00007fcf7bd5db42 00007fcf7bd5c800 00007fcf7bd559fa 00007fcf80d1d4c9 00007fcf7a299c54 00007fcf7a299be2 00007fcf7a299b11 00007fcf7a299a8c 00007fcf7a298d42
0709 13:04:45.745602 (+ 27098us) log.cc:844] Serialized 501 byte log entry
0709 13:04:45.942880 (+197278us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b18003c3280. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:04:48.125910 (+2183030us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1877,"raft.queue_time_us":65544,"raft.run_cpu_time_us":1518,"raft.run_wall_time_us":1521,"spinlock_wait_cycles":41522176,"thread_start_us":42210,"threads_started":1,"wal-append.queue_time_us":63362,"wal-append.run_cpu_time_us":3255,"wal-append.run_wall_time_us":1018660}
I20260709 13:04:48.330909 16730 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.242477 16711 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.342494 16730 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.243479 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:48.343888 15437 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:48.247685 16815 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.345475 16899 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.346227 16815 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.342537 16948 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:48.347071 16948 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:48.236698 16902 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.308504 15434 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:48.311188 16946 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:04:48.226034 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 116141us
I20260709 13:04:48.313192 16857 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:48.314869 16931 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.662s	user 0.006s	sys 0.000s
I20260709 13:04:48.320443 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:48.363909 15588 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.322813 15438 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:48.242244 16940 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.331751 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.250455 16636 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.335058 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:48.336027 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:48.366417 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 45179.6us
I20260709 13:04:48.337363 16942 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:04:48.338327 16181 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:48.334795 16776 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:48.313192 16824 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.324261 16813 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:48.341225 16713 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:48.345587 16730 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:48.352593 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 162993us
I20260709 13:04:48.383782 15587 raft_consensus.cc:2368] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:48.298280 16787 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.349233 16714 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:48.359673 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 234213us
I20260709 13:04:48.361099 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:48.378413 16838 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.368297 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:48.381920 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:48.385742 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.388875 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:48.303009 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.392449 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:48.395498 16636 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.395613 16962 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.396251 16962 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.396693 16962 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.397936 16787 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:48.398835 16964 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.399310 16964 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.399706 16964 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.393414 16182 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:48.403818 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.405827 15514 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:48.407765 15586 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:48.407972 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.411929 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.412866 15590 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:48.416378 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:48.417284 15584 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:48.417577 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.418531 15512 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:04:48.423523 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.424211 15509 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.394750 15406 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:48.422984 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.430466 15515 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.348469 16948 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.433533 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.434626 15514 raft_consensus.cc:2368] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:04:48.436831 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.438800 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:48.408703 16838 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:48.410991 16609 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:48.442209 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47319.3us
I20260709 13:04:48.428054 16919 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:48.434402 16966 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.456177 16919 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.478853 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.481176 15509 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:48.451393 16650 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.508420 16946 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:48.488452 15515 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:48.453819 16824 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.512362 16776 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.513899 16919 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.449517 16730 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:04:48.489319 16857 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.451912 16609 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.527616 16636 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:48.536096 16636 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:48.537597 16609 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.527288 16838 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.528654 16789 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.528753 16776 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.537266 16636 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.538568 15516 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:48.541778 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.522827 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:48.551753 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.552857 15513 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:48.556231 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.557716 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.565002 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.565317 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.546669 16776 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.565481 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.548172 16636 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.566499 15509 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:48.567436 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.568668 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.569381 15509 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:48.569857 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.570693 15511 raft_consensus.cc:2368] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:48.570631 16824 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.571441 16824 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.572300 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.520823 16650 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:48.573771 16824 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.574405 16824 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.574703 16650 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.577337 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.581336 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.582497 15515 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:48.513934 16964 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.583428 15588 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:48.582113 15511 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:48.585702 15592 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.587052 16898 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:48.587682 16898 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.574878 16824 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.590327 16909 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.592590 15510 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:48.592715 15513 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:04:48.592607 16939 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:48.593962 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.594446 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:48.595081 15583 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:48.591337 16942 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.599793 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.601145 16942 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.602375 15406 leader_election.cc:400] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:48.602859 15406 leader_election.cc:403] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:48.610448 15517 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:48.619423 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.621417 15517 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:48.603754 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:48.623575 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.628484 16898 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.579520 16947 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:04:48.660311 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.654932 16964 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.650203 16813 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.642266 16636 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.656849 16730 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.641987 16789 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.654217 16824 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.675256 16573 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:48.604740 16962 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.652686 16902 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.686237 15512 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:48.681650 16813 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.683422 16789 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.687247 16962 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.687453 16789 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.691124 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.692162 15590 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:48.678936 16776 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:04:48.693222 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a42725e017f142629708ff226f2d53e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:48.693794 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:48.694989 16711 raft_consensus.cc:2764] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:04:48.696909 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:48.697657 16177 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.691413 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:48.692067 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:48.701675 15588 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:48.712786 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:48.712661 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.664846 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:48.716059 16573 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.676067 16952 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:48.714921 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 50165.2us
I20260709 13:04:48.731806 16573 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:48.732586 16902 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.733450 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "562c25b8842b442a928630e10d13e618"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:48.733165 16573 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.734320 15438 raft_consensus.cc:606] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.723378 16711 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:48.736147 16711 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:48.736637 16711 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.743036 15407 leader_election.cc:400] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:48.743405 15407 leader_election.cc:403] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:48.740643 16962 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.758347 16962 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:48.759387 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.759601 16909 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.761132 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:48.765652 15555 leader_election.cc:400] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:04:48.766098 15555 leader_election.cc:403] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:48.737821 15583 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:04:48.770126 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:48.772328 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:48.776935 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:48.787636 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:48.771027 16956 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.742442 16952 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.792191 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:48.777170 16939 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.779575 16714 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.778524 16902 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.774518 16898 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.798286 16771 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.788404 15442 raft_consensus.cc:606] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.798483 16880 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:04:48.786827 16609 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.803529 16956 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.809202 16865 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.805763 16714 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:48.813417 16865 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.805540 16783 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.827065 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dc152f2e639487986baac02b0324f06"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:48.827966 15442 raft_consensus.cc:606] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:48.807168 16902 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:48.810633 16956 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.811784 16650 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.806444 16898 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:48.803761 16939 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.811376 16789 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.839018 16962 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:48.835435 16636 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:48.852201 16942 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:48.847695 16714 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.848563 16952 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:48.836062 16650 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.851302 16902 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:48.862907 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 242907us
I20260709 13:04:48.864218 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:48.867379 16880 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:48.868059 16880 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:48.869158 16880 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.871662 15514 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.866884 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:48.874159 16898 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.877857 16730 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.878094 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:48.879109 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.879761 15509 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:48.859004 16962 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:48.865461 16177 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
W20260709 13:04:48.892249 16973 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:04:48.900341 16711 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.883612 16962 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:48.902420 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.902849 16711 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:48.906180 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:48.913589 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.913096 16964 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.915431 16964 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.915977 16964 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.916186 16943 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.917716 16650 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.920948 16939 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.922091 16789 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.924003 16909 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3.
I20260709 13:04:48.928335 16962 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:48.940599 16771 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:04:48.941706 16948 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.948114 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.954242 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:48.954797 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.955019 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.955840 15517 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:48.956245 15515 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.967419 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.970939 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:48.970939 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.972772 15513 raft_consensus.cc:2368] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:48.975039 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:48.975726 15442 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:04:48.977737 15436 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:48.982985 15515 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:48.990243 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:48.990597 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:48.969730 16943 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:48.995888 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:48.976824 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:49.016764 15555 leader_election.cc:400] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.017726 15555 leader_election.cc:403] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:48.994957 16573 raft_consensus.cc:993] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:49.019852 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:49.021327 16182 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:04:49.019922 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.022789 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.023031 15436 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.026087 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:49.015377 15516 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:49.000974 16943 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.031659 16943 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.011927 16715 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.012041 16909 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.035862 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.036854 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.033521 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.024961 16962 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.040277 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:49.040573 16962 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.042280 16909 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.033811 16715 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.043777 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.044343 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.035300 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.048251 15439 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:49.049214 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.025130 16838 raft_consensus.cc:1081] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:49.053795 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.054626 15434 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:04:49.056107 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:49.056833 15509 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:49.057438 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.058221 15440 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.032684 16920 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.059202 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.061633 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:49.063714 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.065012 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:49.050351 16715 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.024948 16952 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:04:49.043356 16962 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.051358 16609 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:49.078501 15406 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.088096 15437 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:49.067783 16899 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.090719 16939 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:49.071729 16824 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:49.082571 16771 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:04:49.079133 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 952f15e68b0745e5a8ca26a3b527cab0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:49.081779 16573 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.126785 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.115509 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.117376 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:49.131719 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.133193 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.133993 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:49.134337 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:49.135720 16982 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:04:49.136555 16175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dc152f2e639487986baac02b0324f06"
dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:52916
I20260709 13:04:49.137286 16175 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.137741 16175 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.140739 16943 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.141484 16943 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.146093 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.092844 16609 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:49.147517 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.151032 15440 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:49.151667 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.151430 16865 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.168949 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.160367 16909 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.170712 16943 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:49.148352 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 75024.6us
I20260709 13:04:49.098645 16942 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:04:49.172791 16609 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.164213 16573 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.177341 16964 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.178383 16573 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:49.180465 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:49.181859 16714 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.182291 16714 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.183087 16714 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.116291 16966 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:49.183997 16966 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.164149 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:49.186091 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.186470 16966 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:49.178596 15515 raft_consensus.cc:2368] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.186964 15439 raft_consensus.cc:2368] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.188236 16899 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.188475 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.188856 15436 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:49.189502 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:49.189774 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.190963 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.194352 15555 leader_election.cc:400] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.194221 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:49.194864 15555 leader_election.cc:403] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:49.195124 15587 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.196699 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:49.166548 15338 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 208) took 2363 ms. Trace:
I20260709 13:04:49.198000 15434 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:49.198982 15436 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:49.182947 15556 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:49.201591 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.204162 15442 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
W20260709 13:04:49.204423 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 73756.6us
I20260709 13:04:49.205240 15406 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:49.212934 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.214604 15434 raft_consensus.cc:2368] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.100152 16880 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.106981 16939 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.238472 16802 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:49.239169 16802 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.239802 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:49.241279 15341 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 199) took 3243 ms. Trace:
I20260709 13:04:49.243372 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:49.245657 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:49.252638 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.257362 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:49.241648 16802 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:49.196205 16964 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.212728 16813 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.224361 16573 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.290470 15436 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:04:49.295390 15518 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:49.241729 15341 rpcz_store.cc:276] 0709 13:04:45.997908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.998324 (+   416us) service_pool.cc:224] Handling call
0709 13:04:47.071247 (+1072923us) spinlock_profiling.cc:243] Waited 73.5 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:49.241208 (+2169961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:47.847584 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:47.864390 (+ 16806us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:47.864427 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:04:47.864446 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:47.864904 (+   458us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:47.864954 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:47.864989 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:47.865376 (+   387us) tablet.cc:701] Row locks acquired
0709 13:04:47.865393 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:04:47.865561 (+   168us) write_op.cc:270] Start()
0709 13:04:47.865698 (+   137us) write_op.cc:276] Timestamp: P: 1783602287865507 usec, L: 0
0709 13:04:47.865721 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:47.866477 (+   756us) log.cc:844] Serialized 928 byte log entry
0709 13:04:48.802184 (+935707us) op_driver.cc:464] REPLICATION: finished
0709 13:04:48.871671 (+ 69487us) write_op.cc:301] APPLY: starting
0709 13:04:48.871779 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:48.871911 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:48.873737 (+  1826us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:48.874226 (+   489us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:48.874392 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:04:48.874433 (+    41us) write_op.cc:312] APPLY: finished
0709 13:04:48.874669 (+   236us) log.cc:844] Serialized 28 byte log entry
0709 13:04:48.874848 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:48.874941 (+    93us) write_op.cc:454] Released schema lock
0709 13:04:48.875001 (+    60us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":291110,"reported_tablets":14,"spinlock_wait_cycles":169100544,"child_traces":[["op",{"apply.queue_time_us":58988,"apply.run_cpu_time_us":2389,"apply.run_wall_time_us":13009,"mutex_wait_us":1809,"num_ops":2,"prepare.queue_time_us":6759,"prepare.run_cpu_time_us":3137,"prepare.run_wall_time_us":27380,"replication_time_us":926924,"thread_start_us":121022,"threads_started":1}]]}
I20260709 13:04:49.251271 16939 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:49.197518 15338 rpcz_store.cc:276] 0709 13:04:46.803692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.804055 (+   363us) service_pool.cc:224] Handling call
0709 13:04:49.166445 (+2362390us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:47.361545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:47.362384 (+   839us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:47.362445 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:04:47.362479 (+    34us) tablet.cc:662] Decoding operations
0709 13:04:47.363101 (+   622us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:47.363216 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:47.363249 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:47.377601 (+ 14352us) tablet.cc:701] Row locks acquired
0709 13:04:47.385701 (+  8100us) write_op.cc:260] PREPARE: finished
0709 13:04:47.385892 (+   191us) write_op.cc:270] Start()
0709 13:04:47.386066 (+   174us) write_op.cc:276] Timestamp: P: 1783602287385826 usec, L: 0
0709 13:04:47.386110 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:04:47.386941 (+   831us) log.cc:844] Serialized 540 byte log entry
0709 13:04:48.313767 (+926826us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:04:48.671921 (+358154us) op_driver.cc:464] REPLICATION: finished
0709 13:04:48.824906 (+152985us) write_op.cc:301] APPLY: starting
0709 13:04:48.825051 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:48.834968 (+  9917us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:48.836214 (+  1246us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:48.839954 (+  3740us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:48.840352 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:48.840458 (+   106us) write_op.cc:312] APPLY: finished
0709 13:04:48.840891 (+   433us) log.cc:844] Serialized 22 byte log entry
0709 13:04:48.854789 (+ 13898us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:48.856103 (+  1314us) write_op.cc:454] Released schema lock
0709 13:04:48.857596 (+  1493us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:48.858167 (+   571us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:48.858208 (+    41us) write_op.cc:454] Released schema lock
0709 13:04:48.953360 (+ 95152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:48.968030 (+ 14670us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":134936,"apply.run_cpu_time_us":3172,"apply.run_wall_time_us":35182,"num_ops":1,"prepare.queue_time_us":206667,"prepare.run_cpu_time_us":26928,"prepare.run_wall_time_us":216714,"raft.queue_time_us":337255,"raft.run_cpu_time_us":67785,"raft.run_wall_time_us":294871,"replication_time_us":1285641,"spinlock_wait_cycles":53646080,"thread_start_us":463720,"threads_started":4,"wal-append.queue_time_us":208831}]]}
I20260709 13:04:49.241729 15516 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:04:49.307917 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:49.234478 16943 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:49.309742 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.262663 16921 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:49.314074 16813 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.320387 16787 raft_consensus.cc:2764] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:04:49.323853 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:49.331823 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 88544.6us
I20260709 13:04:49.340751 15407 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.298244 16573 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.350955 15511 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:49.351866 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.277980 16880 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.348780 15556 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:49.360266 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:49.361070 16865 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.361878 16865 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.357779 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.297783 16714 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:49.373353 15513 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:49.325901 16898 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.369201 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:49.233700 15587 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:49.390033 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.342304 16979 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.354984 16573 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.403247 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.354205 16789 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.373121 16920 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.404340 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.354130 16910 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:49.413442 15592 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:49.404186 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.417636 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.419747 15442 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:49.406042 16952 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.397085 16898 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.578152 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 1288) took 1231 ms. Trace:
I20260709 13:04:49.579079 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.579742 15518 rpcz_store.cc:276] 0709 13:04:48.335476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.335681 (+   205us) service_pool.cc:224] Handling call
0709 13:04:49.462108 (+1126427us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54001e46d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:49.564932 (+102824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022759680}
I20260709 13:04:49.339936 16943 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.341957 16921 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.420781 16771 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:49.388722 16835 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:49.564292 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 215592us
W20260709 13:04:49.570851 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 148786us
I20260709 13:04:49.594226 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:49.620973 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.565163 16995 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:49.641829 16715 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.008s
I20260709 13:04:49.641295 16995 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.581544 15583 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:49.593467 16175 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.644968 16714 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:49.640475 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.635228 15587 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:49.653861 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.663133 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:04:49.664518 16994 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:49.664767 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.665234 16898 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.665966 15337 catalog_manager.cc:5697] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.667244 16921 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:49.667888 15337 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.668959 16802 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.671913 16865 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.672724 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:49.672760 15590 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:49.673627 15584 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:49.642318 16715 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.630159 16956 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:49.693471 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.704937 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.710346 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.711645 15436 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.712062 15436 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:49.715123 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 120782us
I20260709 13:04:49.718726 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.718596 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:49.690795 16771 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.725178 15588 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:04:49.722523 15556 leader_election.cc:400] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.727007 16146 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.726801 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:49.731477 15584 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:49.720856 15436 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.734133 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.735193 15584 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:49.735533 16175 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:49.740392 16992 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:49.743223 16995 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:49.740566 15436 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.744359 16943 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:49.709254 16956 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.748979 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:49.749679 15587 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.751097 16949 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.735417 16865 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.725569 16609 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.752385 16609 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.755060 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.757268 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:49.760469 15591 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:04:49.747329 16956 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.758646 16650 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:49.764143 16650 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:49.764389 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.764878 16715 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:49.765125 16650 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.765614 16865 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.766587 15586 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.768922 16880 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.769269 16609 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.769752 17009 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.770300 17009 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.772459 17009 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.774153 15587 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
W20260709 13:04:49.778630 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 51925us
I20260709 13:04:49.776098 16949 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.780710 16956 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.786271 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.780247 16902 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.777102 15583 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:04:49.794523 15436 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:49.820814 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:49.821305 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:49.829640 16898 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.829890 16996 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.830271 16898 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:49.831563 15556 leader_election.cc:400] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:49.831255 16898 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:49.835992 15556 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:49.837792 16999 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:49.848703 15556 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:49.851341 17005 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:49.852144 17005 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:49.853488 17005 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:49.861511 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 72356.9us
W20260709 13:04:49.861624 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 81069.7us
I20260709 13:04:49.865981 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:49.806048 17001 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:04:49.869400 17010 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.872561 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.873488 15436 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:49.870754 16880 raft_consensus.cc:993] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:49.871063 16730 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:49.871433 16949 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:49.890463 15437 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:49.894853 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:49.895777 15436 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:49.900085 15437 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:49.905295 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.906092 15435 raft_consensus.cc:1813] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Handling vote request from an unknown peer d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.906685 15435 raft_consensus.cc:2410] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:04:49.916499 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:04:49.940863 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48856.8us
I20260709 13:04:49.895031 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:49.942606 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47677us
I20260709 13:04:49.889663 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:49.947501 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:49.805771 16573 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:49.962767 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 73166.6us
W20260709 13:04:49.964620 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 101839us
W20260709 13:04:49.972581 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54194.3us
I20260709 13:04:49.974406 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:49.859458 16956 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:49.981833 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.978026 15406 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.940984 17014 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.004664 16838 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:49.996292 16946 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:49.955413 16940 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:04:50.005741 16946 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:49.997783 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54857.4us
I20260709 13:04:50.007669 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:50.007835 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:50.009203 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:49.998144 15441 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:49.956893 16898 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:49.999236 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:50.012456 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:50.019821 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 45355.9us
I20260709 13:04:50.001138 16835 raft_consensus.cc:1081] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:50.003762 16707 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.980547 16964 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:50.013155 16948 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:49.966306 17010 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:50.040158 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:50.032207 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:50.007961 16815 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.008109 16609 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:50.042621 16909 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.011148 16776 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:04:50.038668 16979 raft_consensus.cc:2764] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:04:50.045542 17010 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.079172 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:50.015146 16962 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.014415 16898 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.081386 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:50.083662 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:50.091444 16956 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:50.086763 16815 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.095106 16946 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:50.035802 16948 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:50.106009 15513 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:04:50.100230 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 63404.1us
I20260709 13:04:50.071828 16838 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.110893 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:50.112298 17020 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:50.112800 15510 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:50.046876 16902 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:04:50.096890 16898 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:50.116509 15556 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:50.033897 17015 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.124078 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:50.143962 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 111883us
I20260709 13:04:50.144770 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:50.096720 16996 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.143204 15513 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:50.151834 16921 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.124109 16948 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:50.123713 16815 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:50.155637 16182 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.134742 16999 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.158334 16838 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:50.141575 16952 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:50.134099 16964 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:50.177897 15584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "562c25b8842b442a928630e10d13e618"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:50.180446 15443 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:50.182133 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.156404 17010 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:50.165382 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:50.151409 17016 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:04:50.169384 15585 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:50.085713 17017 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:04:50.153596 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:50.099403 16609 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.146895 17014 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:50.189036 17014 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.190011 16949 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:50.190517 16949 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:50.197399 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.159646 16824 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.192829 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:50.200554 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45232.4us
I20260709 13:04:50.192101 17014 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:50.215916 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:50.228070 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.196924 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:50.229561 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:50.229945 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:50.230708 15441 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:50.190539 16609 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:50.201790 16949 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.167178 16942 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:04:50.236794 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.245983 16964 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.247889 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:50.251823 15442 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:50.215956 17010 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.259255 15512 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:50.257370 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:50.274812 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.276773 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.227834 16824 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:50.201223 16952 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:50.280445 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47301.7us
I20260709 13:04:50.233502 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.282240 15514 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.283339 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.160516 16996 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.296535 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:50.297025 15514 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:50.305325 15584 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:50.305887 15584 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:50.262421 16573 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:50.309379 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.315245 15407 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:50.319234 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:50.307862 16939 consensus_meta.cc:287] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.982s	user 0.011s	sys 0.005s
I20260709 13:04:50.353108 15591 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:04:50.384256 15591 pending_rounds.cc:85] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 1
I20260709 13:04:50.265394 17014 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:04:50.311632 16789 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:50.375317 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 53750.4us
I20260709 13:04:50.280229 16815 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:04:50.379698 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60638.7us
I20260709 13:04:50.358786 16956 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.409673 16949 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.411382 15510 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:50.389729 16789 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:50.413296 16789 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:50.359490 17000 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:04:50.392035 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:50.435853 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43913.6us
I20260709 13:04:50.396790 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:50.440357 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 43744.6us
I20260709 13:04:50.442112 17014 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.395160 16939 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.442556 17003 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.443305 15440 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:50.239609 17017 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:04:50.310869 16942 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 13:04:50.402168 17027 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:50.404783 16179 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:50.407086 16940 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:50.454635 16940 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:50.456029 16771 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.455907 16940 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.373051 16824 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.321633 16838 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.418344 16835 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:04:50.384071 16921 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.439574 15587 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.448148 15584 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.453975 17010 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.388960 16707 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.395471 15591 pending_rounds.cc:107] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:04:50.698164 15591 raft_consensus.cc:2889] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.698372 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:50.651925 16999 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.664089 17026 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:50.656050 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62706us
I20260709 13:04:50.674526 16996 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:50.650312 16783 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:50.656677 15588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:37000
I20260709 13:04:50.652750 17014 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:50.654668 16939 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:50.589969 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 146775us
W20260709 13:04:50.502696 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 212906us
W20260709 13:04:50.696009 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.691280 16909 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:50.712916 15482 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.549s (SENT) [suppressed 8 similar messages]
I20260709 13:04:50.740051 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1226) took 1619 ms. Trace:
I20260709 13:04:50.740530 15440 rpcz_store.cc:276] 0709 13:04:49.113966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.152246 (+ 38280us) service_pool.cc:224] Handling call
0709 13:04:49.152675 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.443744 (+1291069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.733137 (+289393us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003020d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:50.733339 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2967669632}
I20260709 13:04:50.694409 16787 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:50.694181 16942 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:50.749567 15442 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:50.711848 16573 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:50.720311 16815 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:50.742683 16898 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.005s
W20260709 13:04:50.767799 16948 consensus_meta.cc:287] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.003s
W20260709 13:04:50.803845 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.807479 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:50.807786 16815 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.814141 16998 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:50.814788 16998 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.746405 16999 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:04:50.762562 16824 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:50.816257 16824 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.746904 16902 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:04:50.699492 17010 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.718977 16707 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.819367 16707 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:50.822911 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:50.817382 16998 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:50.829352 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:50.829787 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:50.832149 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:50.837026 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:50.733726 17014 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.839785 15438 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:50.732761 16783 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.843123 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:50.751006 16909 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:50.849076 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 136478us
I20260709 13:04:50.852077 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:50.748725 16787 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.854645 16787 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:50.855682 15588 raft_consensus.cc:606] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:50.733668 17026 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.801025 16573 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.811594 16898 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.868777 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:50.872025 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:50.812178 16942 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.876453 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:50.851430 16949 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:50.831761 16948 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.899801 15587 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:04:50.868782 16787 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:50.910607 15509 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:50.901616 16979 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.908234 16899 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:50.915464 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:50.924078 16175 raft_consensus.cc:2368] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4.
I20260709 13:04:50.917397 16865 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:50.921126 16998 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:50.942858 17037 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:04:50.961995 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 79638.5us
I20260709 13:04:50.925297 17045 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:50.969499 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:50.915110 16787 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:50.977080 17046 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.935869 16815 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:50.952553 17025 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.936981 16899 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.008554 15512 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:50.944653 16948 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:51.009723 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:51.013793 17044 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.055s	user 0.000s	sys 0.002s
I20260709 13:04:50.964268 16865 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.029419 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.034794 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:51.021189 16789 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.001s
I20260709 13:04:50.970796 16998 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:50.993357 17046 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:51.041498 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 128874us
I20260709 13:04:51.045730 17059 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:51.046703 17059 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.025558 17014 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.033094 17052 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:04:51.033082 16948 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:51.008661 17045 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:51.042325 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 312296us
I20260709 13:04:51.065850 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:51.069128 16899 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.071718 17026 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:51.038201 16909 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.051334 16898 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.017135 17025 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.051213 16573 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:51.073740 16815 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.056003 16949 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:51.073951 16999 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.054271 16942 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:51.077025 17025 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.085230 17061 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:51.057731 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:51.055495 16783 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.042243 16789 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.091784 17046 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.092516 16865 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.095330 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:51.106565 15590 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:51.095921 17043 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 13:04:51.097716 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.090265 16815 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.077064 17045 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.102706 15583 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:51.103155 16179 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:51.101646 16176 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:51.065186 17041 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:04:51.126895 16865 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:51.135677 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 101013us
I20260709 13:04:51.142982 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:51.144812 17036 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 13:04:51.147889 16789 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.152288 16815 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.165598 16952 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:51.168084 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.170208 16179 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:04:51.163046 16824 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.134157 16787 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.175781 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.178990 16787 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.173334 16609 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.181896 16998 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.173492 17064 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:04:51.194495 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.195864 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:51.198207 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.203068 16609 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:51.203820 16609 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.204896 15590 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:04:51.206115 16609 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:51.206274 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:51.206359 17045 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:51.137030 16899 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:04:51.128611 16865 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.209976 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.210377 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.211055 15589 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:51.211613 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:51.212249 15512 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:51.213400 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.216303 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.216960 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:51.223039 17040 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:04:51.222849 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:51.224628 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1258) took 1001 ms. Trace:
I20260709 13:04:51.207139 16998 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:51.217880 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.226568 15517 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.244347 15592 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.238106 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:51.222260 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:51.258258 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.226575 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.225178 15439 rpcz_store.cc:276] 0709 13:04:50.223053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.224322 (+  1269us) service_pool.cc:224] Handling call
0709 13:04:50.224656 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.312028 (+ 87372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.312063 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.326864 (+ 14801us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.587913 (+261049us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:50.587976 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.588095 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.217439 (+629344us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:04:51.224159 (+  6720us) raft_consensus.cc:1685] finished
0709 13:04:51.224195 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.224513 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99468,"raft.queue_time_us":86468,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":37233,"spinlock_wait_cycles":29025664,"thread_start_us":146236,"threads_started":1,"wal-append.queue_time_us":437547}
I20260709 13:04:51.209422 17041 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.260030 16899 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:51.282783 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.272423 17064 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:51.281774 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.275278 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:51.284047 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.274719 16815 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:51.290488 16940 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:51.290802 17064 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.295814 17064 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.276038 16998 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:51.297335 17041 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.299187 16999 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.302040 15517 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:51.280544 17010 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.303903 16176 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:04:51.302659 16999 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.315850 17069 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:04:51.323334 16998 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.308842 16771 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:04:51.290592 16899 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.345450 15587 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.348377 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:51.351512 16821 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:51.351785 16776 raft_consensus.cc:993] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:51.352092 16821 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:51.352398 16910 raft_consensus.cc:1081] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:04:51.351943 17064 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.327505 17041 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:51.354949 17067 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.355592 16899 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.357244 17067 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.354147 16821 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.366865 16999 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.377038 16821 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:51.377468 16176 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:51.377529 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:51.379529 16182 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:04:51.382416 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.382961 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.384408 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.385134 15589 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:51.387279 16952 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.390695 16815 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.391348 16815 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.394059 16815 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.396688 15584 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.397040 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.387975 16952 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.421428 16952 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.421546 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:51.422325 16182 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:51.422988 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:51.423751 16999 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:51.424043 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:51.424229 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.424909 15592 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:51.426020 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.418442 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55298 (request call id 1426) took 1223 ms. Trace:
I20260709 13:04:51.428157 15584 rpcz_store.cc:276] 0709 13:04:50.177218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.177713 (+   495us) service_pool.cc:224] Handling call
0709 13:04:51.395154 (+1217441us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540028aad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd4ea3d 00007fcf80d1ecd0 00007fcf7a2a3254 00007fcf7a2a31e2 00007fcf7a2a3111 00007fcf7a2a308c 00007fcf7a2a2342 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:51.400994 (+  5840us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291311872}
I20260709 13:04:51.432535 15592 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:51.434015 15592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:04:51.435891 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:51.436436 15592 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:51.437012 15592 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:51.435578 16899 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:04:51.440317 16999 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:51.423401 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:51.447712 16178 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:51.450424 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:51.452116 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.454169 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.455251 15435 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:51.460017 15434 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:04:51.460224 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.459709 17067 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.465777 17064 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.471092 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37000 (request call id 0) took 1033 ms. Trace:
I20260709 13:04:51.475729 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.476469 15436 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.476732 15439 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:51.479249 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:51.480059 15435 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:51.480123 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.487372 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.474690 15588 rpcz_store.cc:276] 0709 13:04:50.437358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.656398 (+219040us) service_pool.cc:224] Handling call
0709 13:04:51.470850 (+814452us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001c1454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd51853 00007fcf80d1f60a 00007fcf7a2a57d4 00007fcf7a2a5762 00007fcf7a2a5691 00007fcf7a2a560c 00007fcf7a2a48c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:51.470978 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326705408}
I20260709 13:04:51.492311 15592 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.496798 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:04:51.503652 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.505355 15592 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.493955 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:51.507603 15583 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.501262 16939 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:51.508745 16939 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.509130 16939 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.495226 16838 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:51.511354 16175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 302) took 1343 ms (client timeout 1521 ms). Trace:
I20260709 13:04:51.511778 16838 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.483773 17045 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:51.513280 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:51.511896 16175 rpcz_store.cc:269] 0709 13:04:50.167574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.169514 (+  1940us) service_pool.cc:224] Handling call
0709 13:04:51.511014 (+1341500us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54005f0fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:51.511208 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554812800}
I20260709 13:04:51.514385 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.522322 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.523396 15436 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:51.517467 15435 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:51.542448 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.550510 15514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:38406
I20260709 13:04:51.551484 15514 raft_consensus.cc:606] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:51.544715 16940 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:51.568517 15407 leader_election.cc:400] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4.
I20260709 13:04:51.569154 15407 leader_election.cc:403] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:51.584940 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.588413 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.588529 15436 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.591073 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.594038 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.594920 15434 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:51.578456 17061 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.597750 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:51.562734 16940 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.596805 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.598260 15514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:38406
I20260709 13:04:51.585808 16776 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.604902 15514 raft_consensus.cc:606] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:51.606727 15514 raft_consensus.cc:614] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:51.605396 16573 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.646165 16573 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.600680 17025 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.609081 16910 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:51.606206 16838 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.642899 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:51.645615 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.653033 15434 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
W20260709 13:04:51.652069 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 344827us
I20260709 13:04:51.655673 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:51.655732 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:51.651680 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:51.605906 17061 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.629072 15583 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:04:51.666541 15518 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:51.664752 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.670060 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.669562 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:51.663424 16838 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:51.667655 17010 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.674855 16838 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.675107 17010 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.672320 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:51.710063 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.708578 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.675462 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:51.746632 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 76698.1us
I20260709 13:04:51.747561 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:51.747891 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.748281 15592 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:51.749744 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.750851 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:51.691642 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:04:51.745042 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 56929.8us
I20260709 13:04:51.663054 16942 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:51.698388 17045 raft_consensus.cc:993] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: : Instructing follower 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:04:51.675913 16714 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:04:51.804937 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.686703 16940 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.771994 16966 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.798166 17068 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.663481 17025 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.681941 16865 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.690173 17061 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.688336 16609 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:51.793154 17067 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.855173 17067 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.857545 17067 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.804288 16714 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:51.860272 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1334) took 1015 ms. Trace:
I20260709 13:04:51.861128 17025 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.857559 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1256) took 1638 ms. Trace:
I20260709 13:04:51.834889 16966 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:51.864442 17039 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.014s	user 0.001s	sys 0.005s
I20260709 13:04:51.865703 16966 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.867223 15437 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:51.771751 17064 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.704432 16956 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:51.771489 16964 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:51.874850 16956 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.875823 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:51.876467 15437 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:51.876777 15437 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:51.877427 16956 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.877547 15437 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.771492 16998 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:51.802762 16838 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.680593 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:51.878489 16998 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.671813 16815 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 13:04:51.699496 16910 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:51.845410 17068 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.880110 16910 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.881686 17068 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.696691 16821 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.150s
I20260709 13:04:51.882433 16910 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.804236 16942 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.883749 17010 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.884440 16942 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.851119 16940 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.885150 16940 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.886191 15556 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:51.878116 16956 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:51.888708 16990 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:51.888538 16956 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.888374 16966 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:51.891355 16956 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:51.680464 16939 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:51.814090 17070 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:04:51.852756 17072 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:04:51.853034 17061 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:51.854532 16609 raft_consensus.cc:1081] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Signalling peer 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:04:51.860831 15438 rpcz_store.cc:276] 0709 13:04:50.845325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.845487 (+   162us) service_pool.cc:224] Handling call
0709 13:04:50.864447 (+ 18960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.894538 (+ 30091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.894598 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:50.894668 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:50.894715 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.859942 (+965227us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54002d0854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:51.860006 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.860191 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68486016}
I20260709 13:04:51.862995 15443 rpcz_store.cc:276] 0709 13:04:50.219502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.222556 (+  3054us) service_pool.cc:224] Handling call
0709 13:04:50.222927 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.281034 (+ 58107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.281064 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.306774 (+ 25710us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.463566 (+156792us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:50.463612 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.463683 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.850485 (+1386802us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b2400139d78. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78af09c4 00007fcf78aeeacb 00007fcf78ca9dc9 00007fcf78ca9a55 00007fcf78ca8fb0 00007fcf7b91f488 00007fcf7b91fbe8 00007fcf7b8f7398 00007fcf7b8f276a 00007fcf7b8f1bb6
0709 13:04:51.857172 (+  6687us) raft_consensus.cc:1685] finished
0709 13:04:51.857204 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.857482 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57693,"raft.queue_time_us":65504,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":13512,"spinlock_wait_cycles":53891840,"thread_start_us":77890,"threads_started":1,"wal-append.queue_time_us":579386}
I20260709 13:04:51.878970 16998 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.914186 15439 raft_consensus.cc:2368] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:04:51.687461 16573 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.887305 16940 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:51.919018 16180 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:51.926359 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.925992 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:51.927495 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 317406us
W20260709 13:04:51.928534 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 178901us
I20260709 13:04:51.929869 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.896842 17041 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.944751 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:51.945648 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.933504 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.945701 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.946565 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:51.947770 15443 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:51.947954 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.948115 15443 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:51.873539 17003 consensus_queue.cc:1059] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:04:51.951038 15407 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.954337 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.928081 16920 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.959952 16920 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.962594 16920 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:51.952606 17010 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:51.964861 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1327) took 1145 ms. Trace:
I20260709 13:04:51.965327 15440 rpcz_store.cc:276] 0709 13:04:50.820005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.820554 (+   549us) service_pool.cc:224] Handling call
0709 13:04:50.820904 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.860810 (+ 39906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.860859 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:50.860930 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:50.860976 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.964583 (+1103607us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54002251d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:51.964637 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.964793 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91161472}
I20260709 13:04:51.925968 16824 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:51.969687 15556 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:51.950778 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.949973 16940 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:04:51.958397 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.925573 16821 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:04:51.974502 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.977415 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:51.952831 15443 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:51.976094 16880 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:51.977841 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.967061 17069 raft_consensus.cc:3055] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:51.981499 15443 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:51.954636 16815 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:51.934722 17061 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:04:51.979883 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.983950 15438 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:51.987746 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.989512 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:51.976321 17003 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.976970 17010 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.994390 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:51.953081 17041 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:51.983397 16609 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.985327 17069 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:51.995000 17064 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.006847 17064 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:52.007614 17064 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.008725 17061 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.009445 17061 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.012033 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.012995 15590 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:52.014132 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.016157 16942 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:52.016644 16942 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:52.017104 16942 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.017263 17064 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.019742 16956 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.020318 16956 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:52.022495 16956 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:52.023236 17083 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:52.024093 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.024896 15587 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 4: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:52.026290 16146 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.027140 16865 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:52.029141 17083 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:52.003003 17003 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:04:52.031620 17003 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:52.032051 17003 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:52.033070 17003 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.034438 17003 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.035920 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.041406 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.044548 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:52.045120 15590 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.971333 16824 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.054446 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.048460 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.051491 17088 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:52.083479 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.065471 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.004076 17025 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.037505 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.039037 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:52.096575 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.092242 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 1355) took 1241 ms. Trace:
I20260709 13:04:52.036478 17064 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:52.100726 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.103561 15587 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:52.037263 17041 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:52.101557 15509 rpcz_store.cc:276] 0709 13:04:50.851091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.851765 (+   674us) service_pool.cc:224] Handling call
0709 13:04:52.091961 (+1240196us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b54003f66d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:52.092153 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132641024}
I20260709 13:04:52.103833 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.054869 16964 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.059809 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:52.063862 17073 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.197s	user 0.003s	sys 0.000s
I20260709 13:04:52.084306 16776 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4.
I20260709 13:04:52.086076 17025 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.144944 15587 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:52.052052 16787 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:04:52.007268 17069 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.110612 17088 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:04:52.148689 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 121590us
I20260709 13:04:52.149245 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.143060 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:52.154906 15584 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.087459 17010 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:52.134280 16939 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:52.143869 15510 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:52.161087 15406 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.147353 17025 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.163111 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:04:52.163455 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 113470us
I20260709 13:04:52.166640 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.162278 17010 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.172643 17088 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.194211 15443 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:52.195305 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.192227 17008 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.192303 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.196794 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:52.208808 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1353) took 1350 ms. Trace:
I20260709 13:04:52.211159 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.213852 15442 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
W20260709 13:04:52.214360 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 53374.9us
I20260709 13:04:52.215584 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.209241 15511 rpcz_store.cc:276] 0709 13:04:50.843999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.844159 (+   160us) service_pool.cc:224] Handling call
0709 13:04:50.858097 (+ 13938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:51.677962 (+819865us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b18003153a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd4fbfb 00007fcf7bd5a64b
0709 13:04:51.678101 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.678127 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:51.678689 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.923894 (+245205us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:51.923956 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.924067 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:52.179694 (+255627us) raft_consensus.cc:1685] finished
0709 13:04:52.179716 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.194331 (+ 14615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19555,"raft.queue_time_us":58995,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":5375,"spinlock_wait_cycles":4115712,"thread_start_us":285088,"threads_started":2,"wal-append.queue_time_us":367879}
I20260709 13:04:52.227941 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:52.239730 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.241007 15515 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:52.156052 16998 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.208264 16899 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.198980 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:52.289675 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61811.2us
I20260709 13:04:52.290941 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.291314 15443 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:04:52.272253 17079 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.426s	user 0.002s	sys 0.000s
I20260709 13:04:52.277966 16824 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:52.283066 17010 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:52.283993 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.297585 16966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55290 (request call id 74) took 2571 ms. Trace:
I20260709 13:04:52.299822 16714 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.284399 17059 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:52.178411 17050 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:04:52.287014 17090 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.221053 17009 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.220628 16902 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:52.302510 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:52.310389 15512 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.303292 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.310853 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:52.306574 15584 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:52.317366 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.319280 16940 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.320320 17097 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.321286 17069 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:52.322114 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.327282 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:52.328235 15513 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:52.327042 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 123029us
I20260709 13:04:52.301353 16714 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.297669 17061 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:52.340483 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.342391 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.354373 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.308065 16939 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.319365 15516 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:52.363130 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.337541 16940 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.293308 16899 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.366282 15512 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:52.370123 16999 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:52.350800 16920 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.338689 16902 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:52.324339 17090 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.309770 17083 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:04:52.383337 15513 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:52.389086 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.389107 16942 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.364034 17061 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.394210 16942 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:52.393873 15516 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:52.395824 17061 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:52.398927 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 99) took 6429 ms. Trace:
I20260709 13:04:52.398981 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1363) took 1203 ms. Trace:
I20260709 13:04:52.400880 16902 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.362648 16715 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.362401 17008 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:52.401697 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.404081 15340 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 2, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.425467 15340 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 3, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.415904 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:52.434430 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.407346 15591 rpcz_store.cc:276] 0709 13:04:51.195670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.197429 (+  1759us) service_pool.cc:224] Handling call
0709 13:04:51.214598 (+ 17169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:51.272181 (+ 57583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.272217 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:51.278538 (+  6321us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.651193 (+372655us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:51.651265 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.658000 (+  6735us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:52.271502 (+613502us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:04:52.398600 (+127098us) raft_consensus.cc:1685] finished
0709 13:04:52.398624 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.398889 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6721,"raft.queue_time_us":62630,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":1925,"spinlock_wait_cycles":47398144,"thread_start_us":338093,"threads_started":1,"wal-append.queue_time_us":500809}
I20260709 13:04:52.406164 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:52.448256 15515 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
W20260709 13:04:52.451531 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 162529us
I20260709 13:04:52.433177 15340 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.384469 16920 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.424921 17050 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.385571 16999 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.558499 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.539183 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:52.531785 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:52.438413 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 239525us
I20260709 13:04:52.546202 15437 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.557777 15586 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:04:52.513809 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.513741 15511 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:52.459057 15340 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.298288 16966 rpcz_store.cc:276] 0709 13:04:49.725947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.726094 (+   147us) service_pool.cc:224] Handling call
0709 13:04:49.773297 (+ 47203us) log.cc:844] Serialized 501 byte log entry
0709 13:04:50.109752 (+336455us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b1800235fc0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:04:50.184725 (+ 74973us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4c00240840. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a023a20 00007fcf7a034a29 00007fcf7a03513f 00007fcf79ff92ab 00007fcf7a026f3c 00007fcf7a0273fe 00007fcf7a2b450b 00007fcf7bcb3381 00007fcf7bcb126b 00007fcf7bcb7d53 00007fcf7bcb7cd9
0709 13:04:52.297457 (+2112732us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78180,"raft.queue_time_us":84028,"raft.run_cpu_time_us":4113,"raft.run_wall_time_us":146046,"spinlock_wait_cycles":44300032,"thread_start_us":180083,"threads_started":1,"wal-append.queue_time_us":233299,"wal-append.run_cpu_time_us":2146,"wal-append.run_wall_time_us":1059952}
I20260709 13:04:52.609442 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.609933 15592 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:52.644943 15340 catalog_manager.cc:5697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 2, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.516425 15512 raft_consensus.cc:2955] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:52.513846 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.608058 15589 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:52.618781 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.621870 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.627450 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.682490 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:52.618060 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 104355us
I20260709 13:04:52.688067 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:52.513597 17100 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:04:52.691969 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:52.523715 17089 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:52.701748 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.437552 16715 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.705503 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.705526 15590 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:52.707283 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:52.709209 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.465744 16920 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:52.712736 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.715798 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.535593 16964 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:52.722607 15434 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:52.600137 16787 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:52.700445 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:52.600304 17005 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:52.740176 15516 raft_consensus.cc:2393] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:52.739979 17005 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.741564 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:52.742357 17005 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:52.530189 16998 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:52.520038 16899 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:52.407207 15337 rpcz_store.cc:276] 0709 13:04:45.982913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.995627 (+ 12714us) service_pool.cc:224] Handling call
0709 13:04:46.937530 (+941903us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:47.296334 (+358804us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b5400002490. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c33640 00007fcf81b0ab76 00007fcf81c14c3e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:52.398794 (+5102460us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:49.965587 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:50.065864 (+100277us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:50.065906 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:04:50.065925 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:50.066398 (+   473us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:50.066462 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:50.066489 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:50.066831 (+   342us) tablet.cc:701] Row locks acquired
0709 13:04:50.066850 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:50.067012 (+   162us) write_op.cc:270] Start()
0709 13:04:50.067153 (+   141us) write_op.cc:276] Timestamp: P: 1783602290066959 usec, L: 0
0709 13:04:50.067177 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:04:50.153867 (+ 86690us) log.cc:844] Serialized 919 byte log entry
0709 13:04:50.912494 (+758627us) op_driver.cc:464] REPLICATION: finished
0709 13:04:51.126163 (+213669us) write_op.cc:301] APPLY: starting
0709 13:04:51.126272 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:51.126397 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:51.126518 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:51.126972 (+   454us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:51.127167 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:04:51.127212 (+    45us) write_op.cc:312] APPLY: finished
0709 13:04:51.127440 (+   228us) log.cc:844] Serialized 29 byte log entry
0709 13:04:51.127655 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:51.127767 (+   112us) write_op.cc:454] Released schema lock
0709 13:04:51.127810 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:51.128215 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:51.128242 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27547,"reported_tablets":3,"spinlock_wait_cycles":182790144,"child_traces":[["op",{"apply.queue_time_us":208963,"apply.run_cpu_time_us":2029,"apply.run_wall_time_us":2034,"num_ops":2,"prepare.queue_time_us":220833,"prepare.run_cpu_time_us":46938,"prepare.run_wall_time_us":475670,"raft.queue_time_us":456988,"raft.run_cpu_time_us":56784,"raft.run_wall_time_us":222442,"replication_time_us":832579,"thread_start_us":613586,"threads_started":4,"wal-append.queue_time_us":250936,"wal-append.run_cpu_time_us":46199,"wal-append.run_wall_time_us":1718092}]]}
I20260709 13:04:52.534948 17088 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.744597 17088 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.747190 17088 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:52.444675 17008 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.637858 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.676254 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:52.759927 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 122231us
I20260709 13:04:52.516727 17090 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:52.643816 16824 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.535200 16609 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.518832 17056 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.729396 16176 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 4: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:52.730847 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:52.693324 17041 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:52.644586 16898 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:04:52.732026 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:52.731971 16787 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.733830 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:52.737615 15437 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:52.789894 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.738541 15436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:46600
I20260709 13:04:52.791008 15436 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.791505 15436 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.460801 16711 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.748796 17045 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.749707 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.751325 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:52.534471 17061 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.757303 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.615195 17080 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:52.692378 16990 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:52.760763 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:52.761739 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.762652 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.763202 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:52.764585 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:52.680387 16943 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:04:52.719372 17089 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:52.771365 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:52.797600 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65634.6us
I20260709 13:04:52.764842 16789 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:52.801823 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.806576 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.779294 15510 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:52.753827 16964 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.836148 15517 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:52.830601 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:52.874702 15589 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:52.839499 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:52.831907 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71213us
W20260709 13:04:52.840569 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 90959.6us
I20260709 13:04:52.878633 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.879354 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.879936 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.787425 16609 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.882838 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.810792 17068 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.898881 15436 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:52.902040 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74909.3us
I20260709 13:04:52.903086 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:52.904968 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:52.880887 17083 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.916945 15436 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:52.894052 17070 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:04:52.883103 16939 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.789599 17056 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:52.882277 17088 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:52.870760 16910 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:52.933897 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 108779us
W20260709 13:04:52.930313 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46189.9us
I20260709 13:04:52.825830 17045 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.899976 17097 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.925266 17083 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.826006 17041 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:52.902843 16789 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.809934 17061 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.834367 16711 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:52.950141 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47185.4us
I20260709 13:04:52.962226 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:52.809242 16145 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.825474 17080 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.895181 17009 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.931532 17010 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.942068 16998 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:52.983202 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 100422us
I20260709 13:04:52.833952 16990 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:52.962472 17088 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:52.991516 15585 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:52.966562 17068 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:52.965978 17025 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.004s
I20260709 13:04:52.991966 15407 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:52.982524 16715 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:52.980149 17083 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:52.996616 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 116718us
I20260709 13:04:52.997684 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:52.987916 16999 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:53.013535 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:53.014472 15589 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.994980 16789 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.018782 15406 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.020906 17056 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:53.022168 17116 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:04:53.026010 16787 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:53.015766 17008 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:53.028458 17080 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:53.028728 16711 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:53.030587 16990 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:53.034103 17045 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.034483 17127 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:53.035490 16609 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.035215 17127 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:53.036463 16789 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:53.037549 16789 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:53.037760 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 249300us
I20260709 13:04:53.038921 16145 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.040380 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:53.041914 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:53.042804 17059 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.043736 17113 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.043813 17059 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.005050 17050 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:53.045423 17123 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:04:53.004614 16998 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:53.015717 17126 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:53.050698 17126 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:53.051126 17126 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.996219 16956 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:04:53.048388 16964 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:53.048763 17041 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:53.005896 17088 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:53.050151 17061 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.064359 16940 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:53.056186 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 58604.7us
I20260709 13:04:53.079221 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.037668 17127 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:53.067903 17087 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:53.068511 16942 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:53.072393 17118 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:53.059227 15589 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:53.105151 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.057017 16998 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.009542 17025 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.122937 15512 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:04:53.100292 17083 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.118844 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:53.114518 17010 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.126825 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.101159 17061 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.100821 17087 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:53.113322 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:53.089465 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46234.3us
I20260709 13:04:53.147248 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:53.150902 15509 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:04:53.151984 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:53.149654 15406 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:53.154196 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.147886 17129 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:53.143592 17087 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.106482 16942 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:53.156153 16776 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:04:53.165666 17009 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:53.173982 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.175299 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.179656 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.180533 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.234975 17009 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:53.236140 17009 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.236786 16942 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:53.239368 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.244805 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:53.245546 16180 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:53.242153 16179 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:04:53.233451 17141 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:04:53.231142 17138 log.cc:927] Time spent T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:04:53.257515 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:53.181736 16609 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:53.275892 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:53.285358 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:53.242710 16776 consensus_queue.cc:1243] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:53.290320 16178 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:53.250008 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:53.296046 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 63281.3us
I20260709 13:04:53.299584 17050 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.300632 16787 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:53.274505 16609 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:53.291929 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:53.312604 16787 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.313922 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:53.314363 17126 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.320828 17025 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.322350 16940 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:53.322837 16940 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:53.323311 16940 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:53.323665 17136 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:04:53.323828 15514 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.324383 15514 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:53.325294 15514 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.310631 16609 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.348394 17083 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.349552 16787 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.346123 16824 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:53.345548 17087 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.380900 17087 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.382045 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.368075 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:53.385756 15517 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:53.390569 17121 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.404s	user 0.000s	sys 0.003s
W20260709 13:04:53.392633 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 430963us
I20260709 13:04:53.393034 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:53.396524 16787 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.396620 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.398023 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:04:53.403374 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 414058us
I20260709 13:04:53.398150 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:53.404563 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:53.423583 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:53.424892 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.411702 17145 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:53.438676 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:53.440126 15585 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.427495 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:53.410642 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:53.449129 16609 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.453661 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:53.455572 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1207) took 1244 ms. Trace:
I20260709 13:04:53.456050 15509 rpcz_store.cc:276] 0709 13:04:52.210909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.211074 (+   165us) service_pool.cc:224] Handling call
0709 13:04:52.211487 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.151434 (+939947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.455255 (+303821us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54002a2e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:53.455475 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159661952}
I20260709 13:04:53.409425 17010 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.461763 15592 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:53.465268 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:53.438875 17145 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:53.438397 17041 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:04:53.471822 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 73734.3us
W20260709 13:04:53.472175 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 67704us
I20260709 13:04:53.472489 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:53.469116 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 58608.7us
I20260709 13:04:53.470571 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.480166 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:53.481246 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:53.482080 16609 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.487447 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.489562 15513 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:04:53.489660 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:53.490880 15441 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.491096 15518 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:53.492205 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:53.494676 15509 raft_consensus.cc:2393] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:53.495955 15517 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:53.496318 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.466284 16789 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:53.463124 17144 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.498329 15434 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:53.476902 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58702c00fb4641ec8337a916d4579ec9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:04:53.583046 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71150.5us
I20260709 13:04:53.502238 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:53.583670 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:53.542393 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.504060 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.574915 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:53.478749 16715 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.581880 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.470851 17083 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.603662 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:53.603987 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 128252us
I20260709 13:04:53.494007 17041 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:53.591456 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:53.477157 16714 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.597415 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.472263 17126 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.476023 17145 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.605535 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:53.610497 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 120272us
I20260709 13:04:53.503399 16789 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:53.500780 17050 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.618681 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:53.617281 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:53.582396 16899 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.629484 15591 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:53.627166 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:53.640538 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:53.646962 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.604705 17144 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:53.607532 16998 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:53.602654 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 125527us
I20260709 13:04:53.655633 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:53.654479 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 49089.6us
I20260709 13:04:53.656823 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.658589 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.641230 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.625298 16789 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.630354 17025 consensus_queue.cc:1059] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:04:53.668917 17088 consensus_meta.cc:287] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.009s
I20260709 13:04:53.681967 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:53.687340 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:53.653858 16715 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:53.659633 16990 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.659472 17146 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.689872 17130 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.662966 17010 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.659950 16998 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:53.691480 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:53.695824 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:53.698932 15436 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4.
I20260709 13:04:53.705936 16998 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.707230 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:53.709406 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.713562 17097 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:53.672664 16714 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.671968 17087 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.713469 15436 raft_consensus.cc:2955] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:53.651830 17128 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:04:53.716928 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.733309 15441 raft_consensus.cc:2410] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:53.750972 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:53.755419 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:53.758796 15592 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:53.693511 17083 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:04:53.774855 17139 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.434s	user 0.000s	sys 0.002s
I20260709 13:04:53.763001 16902 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:53.776328 16902 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:53.777016 15585 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:53.725307 16966 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:53.767601 16921 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.788916 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.791741 17145 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:53.794449 17145 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:53.794224 16714 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:53.795207 17145 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:53.784150 16902 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.795521 16714 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.796344 16714 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:53.796036 17145 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.798735 17145 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.802281 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:53.694411 16715 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.802960 17010 raft_consensus.cc:3055] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.695912 17088 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.809175 17088 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.809612 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:53.787213 16966 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:53.811164 16966 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.693331 16920 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:04:53.815759 16920 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.816185 16920 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:53.817255 16920 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.759999 16776 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.819506 16776 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.726637 17147 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.820987 15441 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:53.730067 17045 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.821933 17045 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.825006 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:53.825246 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:53.829882 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:53.833402 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.829896 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.837586 15510 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:53.839653 17147 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:53.840292 17147 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:53.840806 17147 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.845688 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1383) took 1089 ms. Trace:
I20260709 13:04:53.846168 15511 rpcz_store.cc:276] 0709 13:04:52.756850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.757948 (+  1098us) service_pool.cc:224] Handling call
0709 13:04:52.812861 (+ 54913us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:04:52.813098 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.987570 (+174472us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:53.081841 (+ 94271us) log.cc:844] Serialized 14 byte log entry
0709 13:04:53.171523 (+ 89682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:53.171631 (+   108us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:53.171703 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.398528 (+226825us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18001d35c0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c382a6 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419
0709 13:04:53.845425 (+446897us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54001e4bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:53.845476 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.845623 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24582,"prepare.queue_time_us":55849,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":31,"raft.queue_time_us":18485,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":50284,"spinlock_wait_cycles":445865856,"thread_start_us":151791,"threads_started":2,"wal-append.queue_time_us":83249}
I20260709 13:04:53.854295 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.803429 17010 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:53.856235 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.858700 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.824590 17083 consensus_queue.cc:1243] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:53.858857 15517 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:53.880991 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.863507 17145 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:53.869472 16609 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:53.885896 15509 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:53.870771 17061 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:53.827119 16921 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.843361 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:53.884128 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.807301 16940 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:53.870590 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1462) took 1314 ms. Trace:
I20260709 13:04:53.885754 16609 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.703418 17130 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.901134 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:53.903695 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 207009us
W20260709 13:04:53.887187 17009 consensus_meta.cc:287] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.005s
I20260709 13:04:53.909457 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:53.898607 16787 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:53.802073 16714 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.859506 17128 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:53.859804 17088 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:53.915234 17010 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.919418 17127 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.908785 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:53.906121 16711 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.926333 15434 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:53.913542 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:53.899827 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.928192 15482 leader_election.cc:400] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4.
I20260709 13:04:53.943562 15482 leader_election.cc:403] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:04:53.917977 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.897702 17145 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.932085 16609 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.902081 16920 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.910395 17122 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.934108 17127 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:53.927574 17088 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.777851 17144 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.919459 17146 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.956808 15515 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:53.921276 17009 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:53.930585 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:53.901842 16921 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.928084 17061 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.960494 16714 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.967392 16609 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4.
I20260709 13:04:53.942538 16996 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:54.000077 15586 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:04:53.927925 16787 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:54.006381 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 75847.9us
I20260709 13:04:54.012605 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:54.014678 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:53.930634 17128 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.028543 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:54.022203 17068 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:54.029316 16178 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:04:54.029651 17068 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:54.030155 17068 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.030424 16789 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:54.031872 17130 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:54.032281 15440 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:54.032936 16789 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:54.034343 16787 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.978192 17166 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.036002 17166 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:53.943948 16711 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.019331 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:53.999478 17155 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:04:54.028707 17126 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:54.008919 17156 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.305s	user 0.001s	sys 0.004s
I20260709 13:04:54.042016 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:53.994189 17010 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.044186 15442 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:54.028617 16921 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:54.047513 16789 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:54.050761 16776 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.050582 17127 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.053043 17145 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:53.985826 16939 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:54.017421 16824 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.644s	user 0.014s	sys 0.000s
I20260709 13:04:54.060379 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:54.077987 15509 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:54.060734 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:54.080050 15515 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:54.036535 17128 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.065500 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:53.998770 16996 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:54.007957 17056 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:54.017643 17008 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.019810 17041 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.024510 17091 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:54.082922 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:54.044203 17122 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.055230 17166 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:54.110875 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 182851us
I20260709 13:04:54.021435 16730 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:54.091241 15439 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:54.114512 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:54.067764 17130 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:04:54.094399 16996 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.093135 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:54.055246 17009 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.062124 16838 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.119853 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:54.119701 16838 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.121914 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:54.056440 17162 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.009262 17146 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.076591 16990 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:54.091667 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:54.089351 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:54.116567 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:54.123170 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:54.103485 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.124310 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1474) took 1111 ms. Trace:
W20260709 13:04:54.125383 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.129523 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:54.132563 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:54.085175 16939 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.152048 15588 rpcz_store.cc:276] 0709 13:04:53.012785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.024846 (+ 12061us) service_pool.cc:224] Handling call
0709 13:04:53.025203 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.419059 (+393856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.419108 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.419869 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 13:04:53.474656 (+ 54787us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:53.474727 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.474833 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.856656 (+381823us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:04:54.123944 (+267288us) raft_consensus.cc:1685] finished
0709 13:04:54.123978 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.124215 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":393372,"raft.queue_time_us":395771,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"spinlock_wait_cycles":26647424,"thread_start_us":54225,"threads_started":1,"wal-append.queue_time_us":233829}
I20260709 13:04:54.157088 16939 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.065340 17126 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.157876 16966 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.160192 17126 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.160979 15443 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:54.113740 16730 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:54.151476 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 53374.4us
I20260709 13:04:54.169255 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:54.151499 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:54.154745 17008 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.118324 17090 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:54.154615 16609 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:54.110467 17128 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:54.165961 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74453us
I20260709 13:04:54.174239 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:54.172534 16609 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.152227 15509 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:54.134435 17041 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:54.184094 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:54.145183 16940 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.213302 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:53.897400 15583 rpcz_store.cc:276] 0709 13:04:52.556361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.556523 (+   162us) service_pool.cc:224] Handling call
0709 13:04:52.556925 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.766745 (+209820us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:52.835900 (+ 69155us) log.cc:844] Serialized 14 byte log entry
0709 13:04:53.462907 (+627007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:53.466065 (+  3158us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:53.471252 (+  5187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.869142 (+397890us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b18003090a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c382a6 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419
0709 13:04:53.870206 (+  1064us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400055ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:53.870274 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.870491 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":432755,"prepare.queue_time_us":48889,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":6281,"raft.queue_time_us":298438,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4643,"spinlock_wait_cycles":490904192,"thread_start_us":273830,"threads_started":1,"wal-append.queue_time_us":295317}
I20260709 13:04:54.253829 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:54.255074 15509 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:04:54.252358 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 81650.3us
I20260709 13:04:54.172276 17157 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:54.169291 16910 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:54.263128 16609 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.176131 17166 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:54.171404 16776 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:54.112874 17091 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.271202 15407 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:54.272464 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 149161us
I20260709 13:04:54.190285 16838 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.213577 17162 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.266614 17041 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:04:54.269802 17166 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.263406 17134 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:54.185683 17128 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.283906 17162 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.276366 17088 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.192130 17090 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.267869 17176 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:54.271587 17157 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.288769 16824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40658 (request call id 72) took 8925 ms. Trace:
W20260709 13:04:54.318939 17171 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:04:54.327647 16650 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:54.308282 16838 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:54.272364 16910 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.303795 17166 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:54.302167 16966 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:54.341593 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:54.346346 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:54.278316 16776 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.347487 15515 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:54.309369 17061 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:54.343907 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 169719us
I20260709 13:04:54.342198 17126 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.303445 17041 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.358661 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:54.346268 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:54.291824 16730 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.347136 16711 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.350056 15516 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:04:54.347983 16939 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.362092 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:54.361431 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:54.334898 17147 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.365083 17061 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:54.365468 17128 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.369532 16179 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:04:54.369722 17167 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:04:54.352330 16838 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:54.376658 17172 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:04:54.372123 17061 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.381004 15517 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:54.381657 17173 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:04:54.382419 17176 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.383787 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:54.384147 17177 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:04:54.313886 17134 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.364078 17126 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.383106 17061 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.396916 17091 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.397316 17041 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.399118 17147 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.388803 17088 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:54.401417 17157 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.404193 17126 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.404384 17146 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.371865 16939 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:54.401548 16902 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.001s
W20260709 13:04:54.409581 17178 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.141s	user 0.000s	sys 0.002s
I20260709 13:04:54.394948 17175 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:04:54.410624 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.411113 17090 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.412453 16902 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.426996 16939 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.444343 17134 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.450522 17166 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.452858 16910 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.337389 16824 rpcz_store.cc:276] 0709 13:04:45.363790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.364819 (+  1029us) service_pool.cc:224] Handling call
0709 13:04:45.461536 (+ 96717us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d311c0 00007fcf80d1d9d9 00007fcf80d1d442 00007fcf7a299c54
0709 13:04:45.544774 (+ 83238us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b540029caa0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd4520 00007fcf7bd5db42 00007fcf7bd5c800 00007fcf7bd559fa 00007fcf80d1d4c9 00007fcf7a299c54 00007fcf7a299be2 00007fcf7a299b11 00007fcf7a299a8c 00007fcf7a298d42
0709 13:04:45.562498 (+ 17724us) log.cc:844] Serialized 501 byte log entry
0709 13:04:46.658553 (+1096055us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b540029caa0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd7b26 00007fcf7bcd149a 00007fcf7bcd0714 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354
0709 13:04:46.712713 (+ 54160us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b18003b4e20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:04:47.108295 (+395582us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b540029caa0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcccdbe 00007fcf7bcd7930 00007fcf7bcd78d8 00007fcf7bcd7858 00007fcf7bcd7813 00007fcf7bcd6a9c 00007fcf81bc2626 00007fcf81bbcdd8 00007fcf7bd137cb 00007fcf7bd162c0
0709 13:04:54.288658 (+7180363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25662,"raft.queue_time_us":38834,"raft.run_cpu_time_us":5975,"raft.run_wall_time_us":1031828,"spinlock_wait_cycles":927775488,"thread_start_us":47405,"threads_started":1,"wal-append.queue_time_us":82967,"wal-append.run_cpu_time_us":13644,"wal-append.run_wall_time_us":2468139}
I20260709 13:04:54.455120 17166 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.456128 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66d8364b020b43deb510a118a19d076a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:54.409639 16838 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.472610 17162 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.426993 17089 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.474095 17089 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:54.475183 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.477888 17056 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:54.478415 17056 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:54.478541 17068 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.481045 17068 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:54.481828 16902 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:54.484730 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:54.486776 15513 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:04:54.497607 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1387) took 1766 ms. Trace:
I20260709 13:04:54.479413 17056 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.499876 15514 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:54.498150 15590 rpcz_store.cc:276] 0709 13:04:52.731104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.830689 (+ 99585us) service_pool.cc:224] Handling call
0709 13:04:53.121936 (+291247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.503724 (+381788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.503757 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.600418 (+ 96661us) log.cc:844] Serialized 26 byte log entry
0709 13:04:53.862862 (+262444us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:53.862929 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.866934 (+  4005us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:54.036389 (+169455us) raft_consensus.cc:1685] finished
0709 13:04:54.036415 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.497316 (+460901us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540015e5d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:54.497531 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":418911,"raft.queue_time_us":459504,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":12103,"spinlock_wait_cycles":668985600,"thread_start_us":203077,"threads_started":1,"wal-append.queue_time_us":393060}
I20260709 13:04:54.509714 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.510718 15592 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:04:54.510550 16146 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:54.511696 15514 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
W20260709 13:04:54.512678 15514 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 1389) took 1394 ms (client timeout 1840 ms). Trace:
I20260709 13:04:54.516505 17183 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.519963 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:54.522969 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:54.524106 16179 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:04:54.536353 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.537045 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:54.539094 15436 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:04:54.541122 17045 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.537184 16996 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.545501 16996 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:54.546069 15340 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 204) took 6151 ms. Trace:
I20260709 13:04:54.548574 15341 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65), VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66), VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 3 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:54.552907 15435 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:04:54.553346 15435 pending_rounds.cc:85] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 2
I20260709 13:04:54.553578 15435 pending_rounds.cc:107] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:04:54.553828 15435 raft_consensus.cc:2889] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:54.554148 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 631397us
I20260709 13:04:54.556892 17061 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.559883 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.560297 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.560573 16943 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.560796 15592 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:54.560297 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:54.548982 16146 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:54.562637 15441 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.563421 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1372) took 1382 ms. Trace:
I20260709 13:04:54.564137 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:54.551033 15341 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.562268 15436 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:54.565073 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.567835 15341 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.569444 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.570252 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:54.570165 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:54.571059 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.572079 15592 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:54.573431 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.563854 15435 rpcz_store.cc:276] 0709 13:04:53.172938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.173160 (+   222us) service_pool.cc:224] Handling call
0709 13:04:53.181885 (+  8725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.554279 (+1372394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.555295 (+  1016us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003ed854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:54.555488 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3042819328}
I20260709 13:04:54.564776 15441 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:54.576200 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.577382 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:54.578346 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:54.579864 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:54.513167 15514 rpcz_store.cc:269] 0709 13:04:53.118403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.118540 (+   137us) service_pool.cc:224] Handling call
0709 13:04:53.323677 (+205137us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54000d4920. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd5ae18 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:54.499367 (+1175690us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5800146fd0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd4dfe7 00007fcf7bd4f7de 00007fcf7bd5b27c 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c
0709 13:04:54.512583 (+ 13216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579591424}
I20260709 13:04:54.561177 16943 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.583684 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:54.585527 15590 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:54.586771 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:54.590633 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.575572 15341 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 1 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:54.591419 15592 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:54.593127 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.546505 15340 rpcz_store.cc:276] 0709 13:04:48.395254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.395633 (+   379us) service_pool.cc:224] Handling call
0709 13:04:54.545990 (+6150357us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:52.985769 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:53.116382 (+130613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:53.116439 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:04:53.116466 (+    27us) tablet.cc:662] Decoding operations
0709 13:04:53.117218 (+   752us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:53.117282 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:53.117309 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:53.117861 (+   552us) tablet.cc:701] Row locks acquired
0709 13:04:53.117881 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:04:53.118051 (+   170us) write_op.cc:270] Start()
0709 13:04:53.118184 (+   133us) write_op.cc:276] Timestamp: P: 1783602293118001 usec, L: 0
0709 13:04:53.118210 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:04:53.269507 (+151297us) log.cc:844] Serialized 2089 byte log entry
0709 13:04:53.454489 (+184982us) op_driver.cc:464] REPLICATION: finished
0709 13:04:53.751030 (+296541us) write_op.cc:301] APPLY: starting
0709 13:04:53.774335 (+ 23305us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:53.852689 (+ 78354us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:53.876026 (+ 23337us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:53.877071 (+  1045us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:53.877324 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:04:53.877398 (+    74us) write_op.cc:312] APPLY: finished
0709 13:04:53.877743 (+   345us) log.cc:844] Serialized 47 byte log entry
0709 13:04:53.890469 (+ 12726us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:53.902848 (+ 12379us) write_op.cc:454] Released schema lock
0709 13:04:53.905606 (+  2758us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:53.914504 (+  8898us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:53.914535 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":593418,"reported_tablets":10,"spinlock_wait_cycles":12160,"child_traces":[["op",{"apply.queue_time_us":254343,"apply.run_cpu_time_us":3779,"apply.run_wall_time_us":187087,"num_ops":5,"prepare.queue_time_us":267958,"prepare.run_cpu_time_us":10781,"prepare.run_wall_time_us":359770,"raft.queue_time_us":63465,"raft.run_cpu_time_us":11710,"raft.run_wall_time_us":175432,"replication_time_us":336101,"thread_start_us":387378,"threads_started":4,"wal-append.queue_time_us":107222}]]}
W20260709 13:04:54.605994 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.550271 17165 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:04:54.674345 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.682664 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:54.685513 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:54.686926 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.559450 17061 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.581499 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.587214 17162 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:54.684725 15341 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 1 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:54.705966 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:54.702790 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 107212us
W20260709 13:04:54.711750 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.711943 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.706750 17010 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.721555 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.722357 15589 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:54.672821 16902 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:54.726670 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:54.730623 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:54.727263 15590 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:04:54.731750 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.717573 15592 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:54.716341 15583 raft_consensus.cc:1813] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Handling vote request from an unknown peer 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:54.716653 17162 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.753759 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.745220 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.749467 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.717725 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:54.746907 17068 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:54.766625 17068 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.767179 17068 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:54.769203 15583 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:04:54.771008 17191 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:04:54.771157 17097 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:54.771697 17097 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:54.772312 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 69525.7us
I20260709 13:04:54.744786 17122 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:54.718375 17010 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.753379 17162 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:54.735086 16998 consensus_queue.cc:1059] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:04:54.778342 17097 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.776980 17122 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.741824 16966 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:04:54.738982 16902 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.780900 17097 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.764372 17089 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:54.783941 17122 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.788182 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.789361 16902 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:54.796018 17010 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:54.795881 17089 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:54.801792 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.803844 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:04:54.810072 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.817974 17089 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:54.832320 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 82576.3us
I20260709 13:04:54.833568 15556 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:54.836068 15442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1374) took 1660 ms (client timeout 1512 ms). Trace:
I20260709 13:04:54.836196 15437 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:54.837798 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 95) took 1526 ms. Trace:
W20260709 13:04:54.838275 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:54.836639 15442 rpcz_store.cc:269] 0709 13:04:53.176135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.176292 (+   157us) service_pool.cc:224] Handling call
0709 13:04:54.835858 (+1659566us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b5400059954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:54.836003 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831933824}
I20260709 13:04:54.838186 15437 rpcz_store.cc:276] 0709 13:04:53.311338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.311612 (+   274us) service_pool.cc:224] Handling call
0709 13:04:54.835987 (+1524375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.836775 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.837616 (+   841us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400059950. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:54.837736 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3504682240}
I20260709 13:04:54.847935 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.848959 15586 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:04:54.852205 17161 consensus_queue.cc:1059] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:04:54.864743 17161 raft_consensus.cc:3055] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:54.865247 17161 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:54.866555 17161 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:54.869825 17161 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.873160 15584 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:04:54.851275 16966 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.879760 15556 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:54.902153 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1379) took 1418 ms. Trace:
I20260709 13:04:54.902832 15440 rpcz_store.cc:276] 0709 13:04:53.483729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.483871 (+   142us) service_pool.cc:224] Handling call
0709 13:04:53.484195 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.032730 (+548535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.901694 (+868964us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b5400120cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:54.902045 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260008704}
I20260709 13:04:54.877053 17145 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:55.028064 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 135706us
I20260709 13:04:55.029496 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:55.033077 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:54.892592 16966 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.043802 17089 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.043812 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.060491 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:55.061003 17066 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.061494 15592 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.061787 17066 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.047978 16996 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:55.065367 17090 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.066341 17090 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.038985 16711 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.071112 16711 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.073608 16711 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:55.075632 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.079418 17166 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.080068 17166 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.080816 17089 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.082414 17166 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.092167 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:55.035518 16920 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.082381 17090 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.030369 17145 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.111390 15592 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:55.122645 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.094863 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:55.085644 16776 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:55.083516 17089 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:55.125012 17127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.037s	sys 0.111s
I20260709 13:04:55.125842 17090 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.110296 16920 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:55.141538 17127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.038s	sys 0.112s
W20260709 13:04:55.225204 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.227823 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.149916 17182 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:55.169003 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 1414) took 1126 ms. Trace:
I20260709 13:04:55.281904 17127 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:55.157358 17090 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.261523 17066 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:55.274973 17148 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.335083 16711 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.338148 17196 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:55.338442 16711 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.339000 17196 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.344456 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.345453 15587 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:04:55.326313 16824 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:55.353597 17122 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.557s	user 0.014s	sys 0.000s
I20260709 13:04:55.332113 16966 raft_consensus.cc:476] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:04:55.293381 17182 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:55.341404 16902 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.325675 17127 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:55.410933 17162 consensus_meta.cc:287] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.005s
I20260709 13:04:55.384923 17010 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:04:55.420981 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 377478us
I20260709 13:04:55.435758 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.352767 17148 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.442898 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.307188 15510 rpcz_store.cc:276] 0709 13:04:54.040903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.044714 (+  3811us) service_pool.cc:224] Handling call
0709 13:04:55.075262 (+1030548us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:04:55.166770 (+ 91508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17782144}
I20260709 13:04:55.466269 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.413090 17127 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:55.448817 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1422) took 1268 ms. Trace:
I20260709 13:04:55.467473 15442 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:55.390244 16824 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.484061 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.483850 15509 rpcz_store.cc:276] 0709 13:04:54.180658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.447462 (+1266804us) service_pool.cc:224] Handling call
0709 13:04:55.448196 (+   734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.448440 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.448468 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.448518 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:55.448545 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.448607 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.448749 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.487316 15587 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:55.489696 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.399734 17122 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.415356 16902 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.461714 17146 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.462177 17045 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.449659 17010 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:55.516490 15591 raft_consensus.cc:2368] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3.
I20260709 13:04:55.450639 17162 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:55.518736 15586 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:55.521768 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.522727 15589 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:55.528955 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 98) took 1472 ms. Trace:
I20260709 13:04:55.529695 15439 rpcz_store.cc:276] 0709 13:04:54.056550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.527604 (+1471054us) service_pool.cc:224] Handling call
0709 13:04:55.528131 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.528428 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.528469 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.528534 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:55.528583 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.528667 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.528859 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.510426 17196 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:55.510612 16920 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:55.532707 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65336.3us
W20260709 13:04:55.535578 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 78345.7us
I20260709 13:04:55.540213 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.540118 16177 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:55.517251 17045 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.549921 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1245) took 1644 ms. Trace:
W20260709 13:04:55.551874 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.514297 17146 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.552597 15512 rpcz_store.cc:276] 0709 13:04:53.905230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.905371 (+   141us) service_pool.cc:224] Handling call
0709 13:04:53.905732 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.046444 (+140712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.046491 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:54.046559 (+    68us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:54.046637 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.549599 (+1502962us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003778d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:55.549653 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.549848 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322939264}
I20260709 13:04:55.575227 17146 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:55.576012 17202 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:04:55.576522 17146 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.577245 17146 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:55.577816 17199 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:04:55.578612 17203 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:55.581084 17146 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.581871 17146 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.582538 17146 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.557300 17090 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.594695 17182 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.599457 16943 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.600777 17045 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.601382 16824 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:55.601591 17068 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.007s
I20260709 13:04:55.607786 17122 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:55.589298 17205 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.599458 16902 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:55.608314 17068 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.609738 16730 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.609362 17205 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.621865 17146 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.622217 17010 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:55.622937 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1485) took 1640 ms. Trace:
I20260709 13:04:55.623394 15584 rpcz_store.cc:276] 0709 13:04:53.982913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.991522 (+  8609us) service_pool.cc:224] Handling call
0709 13:04:54.872881 (+881359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.873707 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.622702 (+748995us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400247cd0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:55.622866 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025260928}
I20260709 13:04:55.635089 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.636474 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.640609 17162 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.641173 16899 raft_consensus.cc:3055] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:55.641688 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.626436 17148 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.641101 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:55.644218 15439 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.641693 16899 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:55.647245 17205 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.647056 16899 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:55.658723 17068 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:55.671636 15439 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:55.673580 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:55.676293 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:55.676992 15439 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.691187 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52918 (request call id 205) took 1112 ms. Trace:
I20260709 13:04:55.691855 16177 rpcz_store.cc:276] 0709 13:04:54.578288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.592445 (+ 14157us) service_pool.cc:224] Handling call
0709 13:04:55.690865 (+1098420us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400730354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:55.691099 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784793856}
I20260709 13:04:55.694041 15442 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:55.687009 15439 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:55.685794 17209 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:04:55.699311 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.707446 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.707561 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.709113 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.709393 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.709687 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:55.710475 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.712235 15438 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:55.713485 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.710547 15512 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:55.719486 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.721122 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.722592 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.723253 15443 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:04:55.732604 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.732720 15512 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:04:55.735038 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.741080 17069 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.742026 17069 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:55.749212 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:55.750710 17056 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:55.727661 17209 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:55.753527 17209 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.760775 15583 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:55.761314 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.763236 16899 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.732560 17204 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:04:55.766981 15441 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:55.769588 15587 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:55.772992 16711 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:55.771299 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:55.724352 17122 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.776721 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:55.777182 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.780100 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.781381 15588 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:04:55.784583 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.785876 15442 raft_consensus.cc:2368] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3.
I20260709 13:04:55.790154 17069 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:55.779170 16730 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:55.791060 16787 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.797564 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.798182 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.798686 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.801590 15588 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:04:55.801894 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:55.802579 15438 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:55.799633 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:55.806028 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.805871 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.806770 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.807160 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.807428 15586 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:55.808915 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.807472 15587 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:55.812139 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.812739 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.812960 15442 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:55.807829 16787 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.803278 15439 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:04:55.818692 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:55.820853 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.821578 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:55.823086 15407 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:55.816063 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:55.849397 17165 raft_consensus.cc:2764] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:04:55.808473 16730 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.852227 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.852803 16730 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.854167 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.855131 15442 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:04:55.856416 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.814118 15586 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:04:55.825606 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:55.823691 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.827042 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.828171 16181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 207) took 1249 ms. Trace:
I20260709 13:04:55.826835 17144 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.821653 17127 raft_consensus.cc:2764] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:04:55.833190 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.833921 17145 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.836165 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:55.836823 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.837462 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:55.838784 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.877648 16821 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:55.878227 16821 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:55.879133 16821 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.809847 15434 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:04:55.837462 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:55.881592 15591 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:55.881646 15438 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:04:55.848023 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:55.869395 17148 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:55.885953 15407 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:55.866526 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.855275 16787 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:55.856511 17210 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:04:55.867478 16964 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.884649 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.884871 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:55.889948 16964 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.866604 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1326) took 1297 ms. Trace:
I20260709 13:04:55.888840 17144 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.891414 17127 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:55.894863 17127 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:55.895239 17127 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.896235 15406 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:55.898262 15406 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:55.899250 17144 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.900048 17144 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.900760 17144 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:55.868330 17205 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:55.901952 17205 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.898998 17148 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.799439 17122 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.892850 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:55.892941 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:55.905804 17148 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.907971 17122 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:55.910626 16964 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.917306 17127 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.918027 17204 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.920675 17097 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:55.921304 17097 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:55.922319 17097 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.931860 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:55.933290 17165 consensus_queue.cc:1059] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:55.934530 16730 raft_consensus.cc:3055] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:55.934937 16730 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:55.935823 16730 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.903908 15406 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:55.938230 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:55.940871 15439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:04:55.938937 17205 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.941658 15439 raft_consensus.cc:606] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:55.942312 16943 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:55.942849 16943 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.943078 15406 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:55.943492 16943 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.945391 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:55.941769 17180 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:55.947281 16730 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.947523 16964 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.947794 17144 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:55.948994 17144 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:55.949383 17144 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:55.950248 17144 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:55.948102 17180 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.940057 17127 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:55.970872 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:55.980018 15512 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:55.891978 15441 rpcz_store.cc:276] 0709 13:04:54.569414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.577154 (+  7740us) service_pool.cc:224] Handling call
0709 13:04:55.866403 (+1289249us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400224cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:04:55.866515 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2670606720}
I20260709 13:04:55.955837 15338 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.954360 15591 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:04:55.868007 16181 rpcz_store.cc:276] 0709 13:04:54.578897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.582520 (+  3623us) service_pool.cc:224] Handling call
0709 13:04:55.304457 (+721937us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5800004598. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:04:55.304706 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.458855 (+154149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.468435 (+  9580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.487222 (+ 18787us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:55.489502 (+  2280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.827877 (+338375us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54004b8cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:55.827940 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.828084 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311816832}
I20260709 13:04:55.978708 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:55.983875 15509 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:55.956866 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:55.985109 15338 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:04:55.988678 15509 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:55.969841 17144 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.992036 15518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:38406
I20260709 13:04:55.992671 15518 raft_consensus.cc:606] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:55.993209 15518 raft_consensus.cc:614] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:55.988756 15338 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.999991 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.001188 15510 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:56.001576 16899 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.003959 15556 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:55.988037 17145 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:56.007306 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.009384 15514 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:56.010969 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.010103 15341 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 100) took 2855 ms. Trace:
I20260709 13:04:55.989902 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:56.006384 16821 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:56.020136 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet 58702c00fb4641ec8337a916d4579ec9 with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46586
I20260709 13:04:56.022358 15338 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:04:56.023732 15482 leader_election.cc:400] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3.
I20260709 13:04:56.024820 15482 leader_election.cc:403] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:56.029132 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.026015 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:56.031960 17146 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:56.032411 17146 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.032850 17146 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:56.026396 16821 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:56.037292 16821 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.040632 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet a42725e017f142629708ff226f2d53e1 with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55290
I20260709 13:04:55.990972 17127 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:04:56.025467 15338 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.012012 15341 rpcz_store.cc:276] 0709 13:04:53.155032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.155234 (+   202us) service_pool.cc:224] Handling call
0709 13:04:53.423963 (+268729us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:56.010014 (+2586051us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:54.891148 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:54.894851 (+  3703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:54.894911 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:04:54.894942 (+    31us) tablet.cc:662] Decoding operations
0709 13:04:54.896083 (+  1141us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:54.896217 (+   134us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:54.896269 (+    52us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:54.897088 (+   819us) tablet.cc:701] Row locks acquired
0709 13:04:54.897118 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:04:54.897352 (+   234us) write_op.cc:270] Start()
0709 13:04:54.897536 (+   184us) write_op.cc:276] Timestamp: P: 1783602294897279 usec, L: 0
0709 13:04:54.897572 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:04:54.898607 (+  1035us) log.cc:844] Serialized 2320 byte log entry
0709 13:04:55.700718 (+802111us) op_driver.cc:464] REPLICATION: finished
0709 13:04:55.845216 (+144498us) write_op.cc:301] APPLY: starting
0709 13:04:55.845608 (+   392us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:55.846456 (+   848us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:55.885229 (+ 38773us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:55.904419 (+ 19190us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:55.904641 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:04:55.904691 (+    50us) write_op.cc:312] APPLY: finished
0709 13:04:55.904988 (+   297us) log.cc:844] Serialized 47 byte log entry
0709 13:04:55.905222 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:55.905352 (+   130us) write_op.cc:454] Released schema lock
0709 13:04:55.905404 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:55.905814 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:55.905845 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101946,"reported_tablets":9,"spinlock_wait_cycles":141740800,"child_traces":[["op",{"apply.queue_time_us":143700,"apply.run_cpu_time_us":3696,"apply.run_wall_time_us":60938,"num_ops":5,"prepare.queue_time_us":121844,"prepare.run_cpu_time_us":16529,"prepare.run_wall_time_us":247860,"raft.queue_time_us":119117,"raft.run_cpu_time_us":38811,"raft.run_wall_time_us":84193,"replication_time_us":802921,"spinlock_wait_cycles":3840,"thread_start_us":386394,"threads_started":4,"wal-append.queue_time_us":499134}]]}
I20260709 13:04:56.049738 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:56.053128 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:56.029363 17212 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.025290 16964 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:56.055696 17180 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:56.024264 17145 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:56.002604 16899 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.047632 15338 catalog_manager.cc:5697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.063417 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.075019 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.078462 16899 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.064433 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.058943 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.065394 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.067467 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.095960 15509 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:56.056424 17148 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:56.056604 17010 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.069482 17145 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.070088 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.056217 17180 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:56.071695 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.057122 16964 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.073338 15517 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:56.108482 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.109192 15517 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:56.110165 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.030076 15512 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:56.096817 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 113853us
I20260709 13:04:56.096817 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.111377 15509 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.099186 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.099900 15515 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:56.116317 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.118306 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.120842 15518 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:56.123437 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.113720 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.126725 15512 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:04:56.125619 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.147243 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.147069 15517 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:56.148169 15512 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:56.098927 17097 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:56.095173 17144 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:56.100400 17148 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.163782 17148 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.114915 16964 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:56.167389 15441 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:56.171578 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.173512 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:56.174779 15482 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.505s (SENT) [suppressed 2 similar messages]
I20260709 13:04:56.174827 15587 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:56.178515 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.179191 15516 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.151234 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.152571 15513 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:56.154968 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.155902 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.182816 15511 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:56.102869 17010 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.162794 16943 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.178192 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:56.185420 15512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:38406
I20260709 13:04:56.156431 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.189764 15512 raft_consensus.cc:606] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:56.190207 15512 raft_consensus.cc:614] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:56.191886 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.143860 17212 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3.
I20260709 13:04:56.161257 17146 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.209520 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:56.207305 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.210382 15509 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:56.220855 15511 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:56.195164 17010 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.176661 17122 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:04:56.229349 15516 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:56.235150 16943 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.193480 17180 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.176998 17144 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.237195 17146 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.240065 15591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:37000
I20260709 13:04:56.273772 15591 raft_consensus.cc:606] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:56.240758 15510 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:56.242632 15515 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:56.246747 17225 tablet_replica.cc:333] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:04:56.257362 17003 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.168596 17097 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.221828 17211 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.209424 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.228194 16996 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.230015 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:56.291373 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61415.9us
I20260709 13:04:56.292405 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:56.266929 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.221462 17069 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:04:56.284562 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 109825us
I20260709 13:04:56.195715 16711 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.223500 16821 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.281354 17204 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:56.334604 15516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66d8364b020b43deb510a118a19d076a"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:38406
I20260709 13:04:56.338546 15516 raft_consensus.cc:606] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:56.320279 17208 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.320536 17056 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.320801 17180 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.283768 17003 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.285609 17148 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.337997 17204 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:56.384399 17162 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.385129 17162 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:56.387599 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 268157us
W20260709 13:04:56.395125 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 101169us
I20260709 13:04:56.331534 16711 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.334604 16821 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:56.416968 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 72605us
I20260709 13:04:56.351866 17087 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:04:56.349247 16996 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:04:56.354710 16964 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.403076 17226 tablet_replica.cc:333] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:04:56.352849 17069 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.324942 17146 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:04:56.435129 15514 raft_consensus.cc:2368] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:56.428561 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:56.428810 15516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:38406
I20260709 13:04:56.430163 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.435930 15516 raft_consensus.cc:606] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:56.436359 15516 raft_consensus.cc:614] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:56.436645 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:56.437992 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:56.411684 17144 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.441391 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.443755 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.444363 15516 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:56.380221 17211 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.448761 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:56.429533 16899 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.450459 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.412461 16787 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:04:56.437820 17056 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:56.468343 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.452888 16711 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:56.453827 17146 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.440332 17069 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.470805 17146 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.472882 17069 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:56.429143 17162 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.457738 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:56.440713 16943 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:56.460913 16902 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.452948 16821 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.466378 17233 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:04:56.456658 17205 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.476760 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:56.489719 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.504406 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:56.491315 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 102402us
I20260709 13:04:56.512161 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.512504 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.515273 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:56.515427 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.517554 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:56.518438 17113 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.518867 15510 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:56.519570 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.521744 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.517719 16146 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.523831 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.524129 17162 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:56.477241 17211 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.464562 17148 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.480427 17003 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.487622 17056 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:56.465524 16899 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.475461 16964 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.487498 17097 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.557826 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.542518 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.543315 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.543838 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.559985 15441 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:56.560767 15439 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:04:56.544653 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.486863 17235 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:56.493141 17145 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.563136 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.562166 15436 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:04:56.563987 17239 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.567448 17239 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.569507 16899 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.570834 17087 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.571166 17244 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.571578 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.540459 17056 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.572655 17056 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.477257 16943 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.578014 16943 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.577771 17204 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.550210 17211 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.579258 17211 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.580650 15439 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:56.582345 17211 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.584914 17236 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:56.564355 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.588024 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.588493 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.497670 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:04:56.601712 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 58497.8us
I20260709 13:04:56.575412 17239 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:56.603410 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61017.5us
I20260709 13:04:56.608440 15482 leader_election.cc:400] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3.
I20260709 13:04:56.563342 17148 raft_consensus.cc:2764] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:04:56.616789 17225 raft_consensus.cc:2243] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.589210 16964 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.616640 16996 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.617914 16996 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.619021 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.620637 16996 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:56.621201 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 132752us
I20260709 13:04:56.622207 17146 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:56.622632 17146 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:56.621562 17113 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:56.623983 17113 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:56.624155 17234 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:04:56.624078 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:56.624902 15584 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.610802 17097 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:56.626353 17097 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:56.579203 17204 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.583395 17162 raft_consensus.cc:697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:56.621575 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:56.617923 17225 raft_consensus.cc:2272] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.628355 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:56.634188 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.641960 15590 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:56.638278 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.642630 15586 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.630339 17113 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.645246 17226 raft_consensus.cc:2243] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.646149 17226 raft_consensus.cc:2272] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.647830 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:56.648715 16177 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:56.649753 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:56.650647 15588 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:04:56.587503 17236 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:04:56.658196 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.666814 15584 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:56.626735 17097 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.590231 17087 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.680752 15591 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:56.639438 16899 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.671404 16787 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.688997 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:56.689859 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:56.693207 17226 ts_tablet_manager.cc:1916] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:04:56.707696 17202 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:04:56.709527 17087 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:56.693886 17225 ts_tablet_manager.cc:1916] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:56.628506 17146 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:56.710198 17162 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.713289 17113 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.718119 17146 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.712142 16899 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.723009 17113 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.723821 16899 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.724895 17056 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:56.778949 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 120542us
W20260709 13:04:56.782981 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.837460 17056 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.839996 17122 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:56.725782 17097 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.841192 17122 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.631942 15406 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.846153 17087 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:56.846844 17087 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.848335 17144 consensus_queue.cc:1059] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:56.849953 17097 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.851691 17097 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:56.852052 17127 raft_consensus.cc:3055] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.852262 17097 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:56.852588 17127 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:56.853044 17097 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.854252 17122 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:56.854521 17127 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.696287 17212 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.688150 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:04:56.819780 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 171041us
I20260709 13:04:56.877368 17102 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:56.835358 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.826113 16711 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.878166 17102 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:56.839035 16943 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:04:56.878798 17102 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:56.879195 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 44115.2us
I20260709 13:04:56.878696 16711 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.881718 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.881989 16711 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.727686 17010 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.860800 17212 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:04:56.884559 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:56.846135 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 231054us
I20260709 13:04:56.819626 16177 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:56.885229 17212 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:56.886757 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.847314 17087 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:56.800630 15587 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:04:56.877388 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 189353us
I20260709 13:04:56.806630 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:56.890700 17237 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.894286 17241 raft_consensus.cc:476] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:04:56.894155 16711 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:56.895430 16711 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:04:56.897078 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 90814.1us
I20260709 13:04:56.898593 17239 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:56.899190 17239 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:56.901522 17127 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.902117 16964 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.899638 17239 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:56.905427 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.906337 17010 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:56.899401 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:56.903201 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.889950 17212 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.916550 17238 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:56.924762 16964 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.930815 15439 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:56.933674 17233 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:56.934700 17233 raft_consensus.cc:697] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:56.936100 17232 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:56.946327 17241 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.946033 17233 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.947162 17241 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.948254 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:56.949620 16787 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.956389 15510 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.950592 17241 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.952597 17224 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:56.959172 17224 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:56.960604 17224 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:56.961473 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:56.966104 15341 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 3 to 4, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted, no longer has a pending config: VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65), VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66), VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 3 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:56.969029 15341 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:56.953600 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:04:56.955284 16711 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:56.986332 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.988330 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:56.985958 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:56.989493 15438 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:56.990233 17165 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.990732 17165 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:56.991142 17165 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:57.000162 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 73119.1us
I20260709 13:04:56.991343 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.003427 15442 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:57.004055 16711 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:57.004956 16711 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.007881 17097 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.010634 17097 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.013473 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.014663 16787 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.969697 17102 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.015491 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.017328 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:57.032612 15442 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:57.027173 17102 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.029503 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:57.017198 17225 ts_tablet_manager.cc:1929] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:04:57.035809 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 82432.6us
I20260709 13:04:57.036373 15514 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:57.036458 17225 log.cc:1199] T 58702c00fb4641ec8337a916d4579ec9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/58702c00fb4641ec8337a916d4579ec9
I20260709 13:04:57.029348 15556 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:57.038514 17225 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46586 (request call id 71) took 1021 ms. Trace:
W20260709 13:04:57.040017 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.042347 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.033537 17146 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:57.045236 17232 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.048213 17232 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.048768 17232 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.027932 17226 ts_tablet_manager.cc:1929] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:57.050091 17226 log.cc:1199] T a42725e017f142629708ff226f2d53e1 P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/a42725e017f142629708ff226f2d53e1
I20260709 13:04:57.046243 17241 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.030190 16711 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.057528 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:57.061192 15340 catalog_manager.cc:5697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 3, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.039019 17225 rpcz_store.cc:276] 0709 13:04:56.016744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.019705 (+  2961us) service_pool.cc:224] Handling call
0709 13:04:56.246259 (+226554us) ts_tablet_manager.cc:1151] Deleting tablet 58702c00fb4641ec8337a916d4579ec9
0709 13:04:56.246411 (+   152us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:04:56.737190 (+490779us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:57.016493 (+279303us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:57.038408 (+ 21915us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":327046,"tablet-delete.queue_time_us":183311,"thread_start_us":135447,"threads_started":1}
I20260709 13:04:57.065711 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet 66d8364b020b43deb510a118a19d076a with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55290
I20260709 13:04:57.067679 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.082144 17180 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.084198 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:57.085165 15438 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.088053 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:57.089733 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:57.090727 15441 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:57.092141 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet 58702c00fb4641ec8337a916d4579ec9 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:57.095839 15441 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:57.108199 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 117308us
I20260709 13:04:57.109639 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.110735 17233 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:57.111265 17233 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:57.111812 17233 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.112000 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.113198 17102 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.116297 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:57.124078 17241 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.124964 17241 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.131487 17241 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.112582 15341 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 6, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.138310 15514 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:57.140012 17226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55290 (request call id 76) took 1118 ms. Trace:
I20260709 13:04:57.140640 17226 rpcz_store.cc:276] 0709 13:04:56.024065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.040230 (+ 16165us) service_pool.cc:224] Handling call
0709 13:04:56.348910 (+308680us) ts_tablet_manager.cc:1151] Deleting tablet a42725e017f142629708ff226f2d53e1
0709 13:04:56.349062 (+   152us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:04:56.734539 (+385477us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:57.027531 (+292992us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:57.139878 (+112347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217635,"spinlock_wait_cycles":3968,"tablet-delete.queue_time_us":290031,"thread_start_us":137366,"threads_started":1}
I20260709 13:04:57.140235 15591 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:57.141415 16899 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:57.134385 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 62472.7us
I20260709 13:04:57.133074 17239 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.158605 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:57.130671 17087 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.151819 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet a42725e017f142629708ff226f2d53e1 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:04:57.078508 15510 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:04:57.157025 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.152822 17226 tablet_replica.cc:333] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:04:57.180838 15438 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:04:57.164885 16943 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:04:57.190030 17233 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.192906 17233 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.066423 15340 catalog_manager.cc:5697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.194430 17237 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.204144 17238 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.212118 17144 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:57.214924 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:57.205600 17146 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.237756 17144 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:57.242750 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 69175us
I20260709 13:04:57.243700 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.246510 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:04:57.248194 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 110815us
I20260709 13:04:57.242290 17087 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:57.262413 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 114175us
I20260709 13:04:57.250576 17165 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.276809 17165 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.278422 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.284063 17248 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.290376 17235 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:57.294577 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.239322 17144 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.305295 15584 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:04:57.305902 17204 raft_consensus.cc:993] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: : Instructing follower 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
W20260709 13:04:57.313944 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 202475us
I20260709 13:04:57.313907 15584 pending_rounds.cc:85] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 4
I20260709 13:04:57.318836 15584 pending_rounds.cc:107] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:04:57.327067 17003 raft_consensus.cc:1081] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Signalling peer 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:04:57.327183 15584 raft_consensus.cc:2917] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:04:57.329325 15584 raft_consensus.cc:2889] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:57.329396 15438 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:57.330078 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55290 (request call id 75) took 7031 ms. Trace:
I20260709 13:04:57.331601 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.333283 17232 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.336113 15439 raft_consensus.cc:2368] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 3. Current term is 4.
I20260709 13:04:57.336800 17249 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:57.337623 17249 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:57.336122 16899 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.338755 16899 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.340559 17212 raft_consensus.cc:993] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: : Instructing follower 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:57.341291 17212 raft_consensus.cc:1081] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Signalling peer 6ff41728dec842afad5b53c20446a5a0 to start an election
I20260709 13:04:57.342090 16899 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.350752 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.330549 15584 rpcz_store.cc:276] 0709 13:04:50.298618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.304243 (+  5625us) service_pool.cc:224] Handling call
0709 13:04:50.438431 (+134188us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b5400183420. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcceec4 00007fcf7bd528d7 00007fcf7bd5e03c 00007fcf7bd5d6b3 00007fcf7bd559fa 00007fcf80d1d4c9 00007fcf7a299c54 00007fcf7a299be2 00007fcf7a299b11 00007fcf7a299a8c
0709 13:04:50.654584 (+216153us) log.cc:844] Serialized 501 byte log entry
0709 13:04:51.356576 (+701992us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b2c00033248. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a65fa0a 00007fcf7a65f693 00007fcf7a65f631 00007fcf7bd93b52 00007fcf7bd93cf5 00007fcf7bcd0691 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69
0709 13:04:51.683600 (+327024us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b18001fe5e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:04:52.534411 (+850811us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b58001d5dd0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bcb143c 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354 000000000038f199 00007fcf78c6a475 00007fcf78c6c7c1
0709 13:04:57.329960 (+4795549us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8114,"raft.queue_time_us":8673,"raft.run_cpu_time_us":8293,"raft.run_wall_time_us":1343956,"spinlock_wait_cycles":1585321856,"thread_start_us":198080,"threads_started":1,"wal-append.queue_time_us":283827,"wal-append.run_cpu_time_us":5142,"wal-append.run_wall_time_us":1131389}
I20260709 13:04:57.347399 15338 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 200) took 7304 ms. Trace:
I20260709 13:04:57.357363 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:57.376060 15556 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:57.352558 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:57.366670 17056 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:04:57.348163 17239 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.347859 15340 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:04:57.350004 17232 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:57.380211 16177 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.382251 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:57.355711 17144 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:57.353021 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106686us
I20260709 13:04:57.382272 15340 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 6, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 6 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:04:57.324642 17224 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.388999 17003 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.373370 16899 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:04:57.404891 17003 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:57.339098 17249 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.424018 17224 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:57.428107 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 63293.7us
I20260709 13:04:57.428669 17236 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:57.402870 17204 consensus_queue.cc:1059] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:04:57.408488 17102 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.453819 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:57.438030 15340 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 4, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.437402 17003 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.459630 16146 leader_election.cc:400] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 3. Current term is 4.
I20260709 13:04:57.462128 16146 leader_election.cc:403] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:04:57.445225 17236 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.458017 15340 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 5, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.471711 15584 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:57.477576 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:57.484423 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.485891 15592 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:57.365540 15338 rpcz_store.cc:276] 0709 13:04:50.043184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.055057 (+ 11873us) service_pool.cc:224] Handling call
0709 13:04:57.347079 (+7292022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:56.422257 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:56.586138 (+163881us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b5c0002990c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81f49331 00007fcf81f49221 00007fcf81f43f6c 00007fcf7f7a1d69 00007fcf7f78d0a6 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d
0709 13:04:56.586220 (+    82us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:56.586256 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:04:56.586270 (+    14us) tablet.cc:662] Decoding operations
0709 13:04:56.587171 (+   901us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:56.587242 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:56.587271 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:04:56.624723 (+ 37452us) tablet.cc:701] Row locks acquired
0709 13:04:56.624744 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:04:56.624939 (+   195us) write_op.cc:270] Start()
0709 13:04:56.625237 (+   298us) write_op.cc:276] Timestamp: P: 1783602296624885 usec, L: 0
0709 13:04:56.625278 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:04:56.626271 (+   993us) log.cc:844] Serialized 2540 byte log entry
0709 13:04:56.729882 (+103611us) op_driver.cc:464] REPLICATION: finished
0709 13:04:56.741886 (+ 12004us) write_op.cc:301] APPLY: starting
0709 13:04:56.741966 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:56.742118 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:56.742132 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:56.868908 (+126776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:56.869561 (+   653us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:04:56.873418 (+  3857us) write_op.cc:312] APPLY: finished
0709 13:04:56.907852 (+ 34434us) log.cc:844] Serialized 53 byte log entry
0709 13:04:56.908245 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:56.908563 (+   318us) write_op.cc:454] Released schema lock
0709 13:04:56.908642 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:56.909638 (+   996us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:56.909672 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23370,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":11730,"apply.run_cpu_time_us":5298,"apply.run_wall_time_us":167616,"num_ops":6,"prepare.queue_time_us":252005,"prepare.run_cpu_time_us":8690,"prepare.run_wall_time_us":232502,"replication_time_us":104394,"spinlock_wait_cycles":8049024,"thread_start_us":145932,"threads_started":2}]]}
I20260709 13:04:57.475824 17236 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:57.495429 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.496477 16943 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:57.503090 16943 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:57.503634 16943 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.497593 15439 raft_consensus.cc:2410] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:57.498785 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:57.473013 17102 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.540395 17276 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.538480 15340 catalog_manager.cc:5697] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 3, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.541210 17276 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.541796 15340 catalog_manager.cc:5697] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 3, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.544162 17276 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.544854 15340 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.532945 15587 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:04:57.483775 15436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:46590
I20260709 13:04:57.559243 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:57.565331 17233 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:57.565760 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 99346.5us
I20260709 13:04:57.566011 17233 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:57.567408 17233 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.520917 17127 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:04:57.575390 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:04:57.552821 16899 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.576747 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:57.555892 16730 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:04:57.593513 16899 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.596310 17224 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:57.597666 17102 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.608011 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.578058 17146 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:57.613072 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56217.9us
I20260709 13:04:57.613838 17208 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.575855 16177 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:57.633636 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:57.636690 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 96126.3us
I20260709 13:04:57.637778 16145 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.596233 16899 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.646960 17224 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:04:57.613879 17270 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:57.651036 15340 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:57.655681 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 82591.4us
I20260709 13:04:57.656868 15438 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 2: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:57.659032 17162 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 3. Current term is 4.
I20260709 13:04:57.659838 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:57.651420 17249 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.665897 17249 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.666846 17249 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.669709 17249 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.670320 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.671294 15583 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:57.672639 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:57.673563 16181 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:57.674048 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:57.674886 15511 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:57.675916 16943 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.678462 16943 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.679080 15436 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.678956 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:57.679667 15436 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.679958 15583 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:04:57.678508 15340 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:04:57.685055 17266 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.219s	user 0.002s	sys 0.002s
I20260709 13:04:57.656634 17146 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.688489 17146 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.689023 17241 raft_consensus.cc:3055] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:57.689520 17241 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:57.689580 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:04:57.690498 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.690524 15406 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.690639 17241 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.693727 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:57.694661 15514 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:57.682828 15340 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 4, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 4 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:04:57.655207 17270 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:04:57.698824 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47714.9us
W20260709 13:04:57.713726 17267 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:04:57.712018 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:57.716454 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 59354.4us
I20260709 13:04:57.717376 17238 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:57.718163 17238 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:57.719621 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61625.4us
I20260709 13:04:57.719918 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:57.720942 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.721249 16181 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:57.719645 17279 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.722291 17279 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.724839 17279 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.725751 17144 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:57.727167 17144 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.699769 17270 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:57.729878 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 952f15e68b0745e5a8ca26a3b527cab0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:04:57.733371 15590 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:57.734907 16711 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:57.735395 16711 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:57.736452 16711 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.737944 16711 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.739718 17238 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.744557 15338 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.749964 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.753391 17258 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.754169 17258 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:57.757200 17233 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.758337 15438 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:57.758002 17233 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.761421 15438 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:57.785272 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:04:57.779083 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66286.5us
I20260709 13:04:57.776873 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:57.796792 15588 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:04:57.798933 17276 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.799676 17276 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.802040 17276 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.765676 17249 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:04:57.784968 17268 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.808303 17268 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.810653 17268 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.811870 17226 raft_consensus.cc:2243] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.813580 17233 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.815795 17235 consensus_queue.cc:1059] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:57.816331 17272 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:57.817476 17235 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:57.818112 17279 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.818266 17226 raft_consensus.cc:2272] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.818701 17279 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:57.818063 17235 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:57.820088 17235 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.820235 17279 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.823027 17235 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.821730 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.823263 17279 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.816094 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:57.824208 17258 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.794174 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:57.825503 17240 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:57.793191 17127 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:57.827960 17127 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:57.829017 17127 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.832770 16146 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:57.771517 17241 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.838946 16146 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:57.835414 15436 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.770529 17146 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:57.842607 15439 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 4. Ops: []
I20260709 13:04:57.841334 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:57.830598 17127 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:57.861399 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 94828.7us
I20260709 13:04:57.861964 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:57.882855 15442 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:04:57.811100 17270 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.846872 17248 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.892906 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:04:57.846596 17276 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.935725 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:57.942822 15592 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:57.896912 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:57.889074 17268 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.905476 17248 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.907107 17208 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.937570 16730 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:04:57.959159 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.949787 17113 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:57.934700 17146 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:57.968376 17236 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:57.967118 16730 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:57.988854 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:57.988998 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:57.989552 15516 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:57.990056 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:57.991285 17291 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.968096 17226 ts_tablet_manager.cc:1916] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:57.993883 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:57.996857 15511 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:57.962785 17097 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.029893 15586 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:58.029666 17097 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.030961 17236 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:57.963287 17248 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.019806 15510 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:04:58.013247 17003 consensus_meta.cc:287] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.008s
I20260709 13:04:58.040287 17003 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.012128 15436 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:57.947463 17268 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.003319 17146 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:58.021005 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.042856 17003 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.045804 15443 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:04:58.046928 15515 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:57.976260 17113 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:58.047847 17113 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.048707 17270 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:58.021334 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.050848 15513 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:58.053051 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.053809 15518 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.010462 17208 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.056196 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.027684 17291 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:04:58.056911 15517 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.014343 16730 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.044510 15583 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:58.059038 15512 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:58.060757 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.061376 15512 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.063161 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.064745 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.065732 15509 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:58.066576 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.067299 15509 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:58.069092 17162 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:58.062259 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.104408 15439 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:58.108322 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.109463 15509 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:58.111263 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.111974 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.113471 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.114102 15509 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:58.118667 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.125752 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.126459 15443 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:04:58.129159 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 287843us
I20260709 13:04:58.132951 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:58.138053 15515 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:04:58.124914 17212 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:58.139859 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.140208 17212 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.141741 17248 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.142578 17212 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:58.146293 16176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66d8364b020b43deb510a118a19d076a"
dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
 from {username='slave'} at 127.0.0.1:52910
I20260709 13:04:58.149566 15407 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.154181 17233 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:58.161922 15518 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:58.164549 15509 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:58.166332 15512 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:58.169157 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.170159 15518 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.172503 15515 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:58.170287 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.147379 16176 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:58.179368 15517 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:58.184561 15438 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:58.184983 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.186424 15512 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:58.188495 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:58.191705 17097 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:58.195588 15511 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:58.168884 17239 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:58.197973 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.205276 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.200625 17239 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.206264 17239 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.153482 17248 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:58.216490 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:58.220323 15518 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:04:58.222086 15515 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.130358 17003 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:04:58.206203 15434 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:58.227613 16145 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:58.223505 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:04:58.229807 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 59637.1us
I20260709 13:04:58.234122 15586 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.236040 16146 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:58.197052 16176 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.238186 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.242216 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.243021 17294 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:58.236744 17162 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:58.261791 17291 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:04:58.274570 17162 raft_consensus.cc:697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:58.275002 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.276015 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.275835 15513 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:04:58.275748 17162 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.277415 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.277576 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.243969 17277 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:58.278048 15513 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:58.278273 17277 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:58.278772 17277 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.278879 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.251371 16730 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.268724 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.237026 17208 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:58.237100 17097 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.281492 17097 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.281967 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.282259 16730 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:58.247623 15588 raft_consensus.cc:2410] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:04:58.284255 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.267524 15517 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:58.288147 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:04:58.291299 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.265818 15556 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.247787 15510 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:58.257795 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.228250 17165 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.265105 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.243378 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.265722 17294 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:58.258941 17248 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:58.243883 17146 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:58.268122 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.318212 15443 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:04:58.319105 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.325964 15437 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:58.329469 15583 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:58.329909 15583 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:58.331993 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.333351 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.334020 15513 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:58.334875 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.336517 17146 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.339057 17146 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:58.339635 17236 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.340577 17236 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.342881 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:58.303368 17291 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.343997 17291 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.344624 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:58.344599 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.345436 17097 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:58.345966 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.346350 17291 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:58.346769 15514 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:58.346561 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.347654 15510 raft_consensus.cc:2368] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:58.321768 17208 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:58.326928 17165 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.330782 15583 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:58.353602 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.354926 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.362727 15513 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:58.343252 17236 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.363111 15517 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:58.357741 15515 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:58.367973 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.368670 15586 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:04:58.369836 15436 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:58.376031 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.377262 15518 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:58.321991 17248 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:58.392248 17248 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.379055 17235 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:58.396124 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.396436 17235 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.397363 15510 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:58.316053 17294 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:58.379617 15512 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:58.406605 16179 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:58.417557 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:58.421501 15442 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:04:58.423969 15436 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:58.412804 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.426144 15588 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
W20260709 13:04:58.426308 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48441.2us
I20260709 13:04:58.408747 17165 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:58.438232 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:04:58.399482 17235 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.428699 17208 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:58.444603 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.443898 17233 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:04:58.491387 17113 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.496191 17208 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:58.499802 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56248us
I20260709 13:04:58.500757 17268 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.506603 16176 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.443181 17277 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.448096 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.514464 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.533839 15514 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:58.519368 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 226958us
I20260709 13:04:58.440801 17290 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:58.536921 15510 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:58.537235 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:58.537969 15590 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:58.526809 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.527463 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.530818 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.538625 16181 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
W20260709 13:04:58.533870 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 85882.7us
I20260709 13:04:58.539024 15518 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:04:58.512235 17238 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.540318 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.545075 15513 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:04:58.546537 15509 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:58.553093 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:58.562450 15511 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:58.548854 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.540524 17272 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:58.543840 17238 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:58.552922 17270 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:58.572682 17275 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.572454 16177 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 4: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:04:58.580054 17235 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.543177 17290 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.578999 17272 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:58.552001 17294 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.614691 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:04:58.616673 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 81279.2us
W20260709 13:04:58.616606 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.615585 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:58.620018 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.626036 15442 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:04:58.621444 17113 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.626878 17269 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.611052 17275 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.631807 15435 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:04:58.631528 17238 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.633138 17238 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.633332 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.634080 15435 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:58.636205 15556 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.637460 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.638926 17277 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.644932 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.649415 17240 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.650008 17240 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.650382 17240 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.656164 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.656575 16176 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.658026 17102 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:58.615329 17272 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:58.613672 17235 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:58.660739 17235 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.613086 17270 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:58.665616 17270 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.668979 17146 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:58.669945 15556 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.671758 17292 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:58.672187 17292 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.672561 17292 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.672930 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:58.673800 15516 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:58.674135 15516 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:04:58.668983 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56992.1us
W20260709 13:04:58.689147 17303 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:04:58.685194 17248 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.689862 17127 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:58.690217 17232 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.787791 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:04:58.691087 16730 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.675025 15516 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:58.691367 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:58.692147 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:04:58.698683 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.701656 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.703145 17290 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.703460 17275 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.705812 15584 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:58.707410 17294 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.609719 17239 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.709180 15583 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.795727 15590 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:58.780745 17248 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:58.784845 17235 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:58.802263 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 110622us
I20260709 13:04:58.800969 15514 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:58.802971 15510 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:04:58.814199 16730 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.818634 15516 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.838627 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:58.839152 16730 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:58.815143 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 122222us
W20260709 13:04:58.821338 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 130057us
I20260709 13:04:58.825722 16175 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:04:58.848281 15438 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:58.850884 15556 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.825539 17238 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:58.828538 17258 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.855085 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:58.861064 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:04:58.851575 15555 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.531s (SENT)
I20260709 13:04:58.862426 15406 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:58.863714 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:58.866777 15514 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:04:58.873843 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.949023 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 97502.1us
I20260709 13:04:58.886865 17315 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:58.951870 17315 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.951972 15583 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:58.952384 17127 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:58.890602 15407 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:58.953604 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 63102.6us
I20260709 13:04:58.953753 17165 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.954212 17165 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.954591 17165 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.862993 17258 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.955396 17258 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.955446 15516 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
W20260709 13:04:58.959741 17241 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:04:58.961768 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:58.850883 17146 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:58.901428 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.908118 17305 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.964443 17305 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:58.965554 17305 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:04:58.967074 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 104767us
I20260709 13:04:58.919096 17240 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.863780 17204 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:58.931363 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.933161 17239 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:58.925139 17226 ts_tablet_manager.cc:1929] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:58.940539 17272 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.096459 17226 log.cc:1199] T 66d8364b020b43deb510a118a19d076a P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/66d8364b020b43deb510a118a19d076a
I20260709 13:04:59.097886 17226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55290 (request call id 77) took 2034 ms. Trace:
I20260709 13:04:59.098192 17272 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:04:58.940488 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 238915us
W20260709 13:04:58.947914 17313 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.166s	user 0.009s	sys 0.000s
I20260709 13:04:59.098279 17226 rpcz_store.cc:276] 0709 13:04:57.064155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.065268 (+  1113us) service_pool.cc:224] Handling call
0709 13:04:57.142803 (+ 77535us) ts_tablet_manager.cc:1151] Deleting tablet 66d8364b020b43deb510a118a19d076a
0709 13:04:57.152321 (+  9518us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:04:58.648999 (+1496678us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:58.921283 (+272284us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:59.097792 (+176509us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":599074,"tablet-delete.queue_time_us":75741}
I20260709 13:04:58.948777 17269 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:58.953020 17127 raft_consensus.cc:697] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:59.100132 17291 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.101186 17127 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:58.911067 17292 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.104774 16175 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:59.105782 16181 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:59.106117 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:04:59.106691 17292 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.107191 16179 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:59.107587 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:59.107900 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:59.108654 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:59.109077 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:58.963027 17146 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.112512 17146 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:58.973520 17233 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:58.987650 17240 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.113418 17233 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.113988 17233 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.989001 17301 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:58.990913 17279 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.116565 17279 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.118808 17279 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.000115 17235 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.002662 16943 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:58.952443 17315 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:59.120164 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:59.122087 15442 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:59.005162 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:59.123977 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 118924us
I20260709 13:04:59.006974 17258 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.127097 17258 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:59.018518 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:59.022255 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:58.988427 16145 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:04:59.129043 15439 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:59.129465 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 141119us
I20260709 13:04:59.130589 17301 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:59.131153 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:59.131158 17301 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:59.133792 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:59.133726 17301 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.135596 16943 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:59.136209 16943 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:59.137167 16943 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.138965 15584 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:59.141670 15590 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:59.143752 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:59.143914 17272 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.144012 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:59.144614 17272 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.145506 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:59.147838 17272 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.148404 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:59.149255 15434 raft_consensus.cc:2368] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3.
I20260709 13:04:59.150492 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:04:59.153245 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:59.154181 15437 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:04:59.159564 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:59.161027 17279 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:59.161710 17279 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.162175 17279 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:59.173095 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:59.174502 17305 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:59.182819 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:59.184178 15590 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:59.186121 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:59.186978 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.099078 17204 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:59.192885 17204 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.197893 15439 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
W20260709 13:04:59.202538 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.148694 17272 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:04:59.224822 15482 connection.cc:256] RPC call timeout handler was delayed by -1.2770849040000485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:04:59.203889 17292 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.202190 17315 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.226054 17292 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.227717 17315 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:59.225497 15482 connection.cc:256] RPC call timeout handler was delayed by -1.22848490399997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 13:04:59.229513 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.229893 17292 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.231011 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.240494 17315 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:59.249615 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:59.252745 17146 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:59.255180 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.255417 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:59.257557 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:59.258980 15439 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:04:59.261670 15556 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:04:59.263622 17272 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:59.264091 17272 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.264555 17272 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.262383 17292 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.266858 17292 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:04:59.267941 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:04:59.268148 17292 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.269083 15590 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:59.270648 17315 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:59.272928 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.282363 17315 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.287887 17180 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:59.288766 17180 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:59.288875 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 94718.5us
I20260709 13:04:59.290181 17180 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.293174 16146 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:59.294813 16146 leader_election.cc:400] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3.
I20260709 13:04:59.295849 17305 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:59.301087 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 115114us
I20260709 13:04:59.303054 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.304538 17097 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:59.305399 17097 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:04:59.330216 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 57361.6us
I20260709 13:04:59.331274 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.357440 17146 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:59.357512 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:04:59.358464 15441 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:59.359099 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.359982 17291 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:59.360458 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.361299 17291 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:59.362637 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.363623 17291 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:59.367620 15586 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:59.379122 17301 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:04:59.379904 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.388067 17315 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:59.406651 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:04:59.410071 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47492.6us
W20260709 13:04:59.426074 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 123096us
I20260709 13:04:59.457108 15406 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:04:59.461659 15510 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.155s	sys 0.234s
W20260709 13:04:59.462049 15484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.043s	sys 0.037s
W20260709 13:04:59.463138 15484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.043s	sys 0.037s
W20260709 13:04:59.462617 15510 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.155s	sys 0.234s
I20260709 13:04:59.483160 17232 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:04:59.498088 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.504760 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.104168 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet 66d8364b020b43deb510a118a19d076a (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
W20260709 13:04:59.507771 15326 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 403596us
I20260709 13:04:59.508924 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:59.510636 17238 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.511822 16730 raft_consensus.cc:2764] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Leader election decision vote started in defunct term 3: won
I20260709 13:04:59.512657 17299 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:59.516470 17146 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.517251 17146 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.491233 15341 catalog_manager.cc:5697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.479097 17258 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:59.535843 15441 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:59.548791 15439 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:59.306797 17097 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.286334 17165 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.478864 16943 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:04:59.555977 15517 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.003s	sys 0.018s
W20260709 13:04:59.556479 15517 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.003s	sys 0.018s
I20260709 13:04:59.391527 17272 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.534639 15341 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:04:59.554957 17258 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.587101 17258 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:59.588846 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.582324 15340 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 205) took 3351 ms. Trace:
I20260709 13:04:59.531921 17003 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:04:59.582199 15436 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:59.555402 16943 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.576874 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:59.561177 17291 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:04:59.557125 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 146134us
W20260709 13:04:59.598829 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 89993.8us
I20260709 13:04:59.605962 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:59.569176 17241 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.548449 17294 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:04:59.644021 17241 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.573148 17318 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:59.595167 15340 rpcz_store.cc:276] 0709 13:04:56.225717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.225946 (+   229us) service_pool.cc:224] Handling call
0709 13:04:59.576847 (+3350901us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:58.118941 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:58.289317 (+170376us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:58.289357 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:04:58.289377 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:58.290628 (+  1251us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:58.290682 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:58.290728 (+    46us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:58.347238 (+ 56510us) tablet.cc:701] Row locks acquired
0709 13:04:58.347260 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:04:58.347445 (+   185us) write_op.cc:270] Start()
0709 13:04:58.347610 (+   165us) write_op.cc:276] Timestamp: P: 1783602298347390 usec, L: 0
0709 13:04:58.347633 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:58.568961 (+221328us) log.cc:844] Serialized 4810 byte log entry
0709 13:04:58.637765 (+ 68804us) op_driver.cc:464] REPLICATION: finished
0709 13:04:58.638119 (+   354us) write_op.cc:301] APPLY: starting
0709 13:04:58.638203 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:58.638491 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:58.638599 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:58.647621 (+  9022us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:58.647868 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:04:58.647916 (+    48us) write_op.cc:312] APPLY: finished
0709 13:04:58.648262 (+   346us) log.cc:844] Serialized 89 byte log entry
0709 13:04:58.648475 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:58.648670 (+   195us) write_op.cc:454] Released schema lock
0709 13:04:58.648749 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:58.782255 (+133506us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd52e28 00007fcf7f78d581 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d 000000000038f354 000000000038f199
0709 13:04:58.782577 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:58.782633 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":463928,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":3823,"apply.run_wall_time_us":10981,"num_ops":12,"prepare.queue_time_us":233965,"prepare.run_cpu_time_us":14666,"prepare.run_wall_time_us":674772,"replication_time_us":289969,"spinlock_wait_cycles":211830016}]]}
W20260709 13:04:59.673854 17233 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.000s
I20260709 13:04:59.674573 17233 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.676072 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 209) took 6731 ms. Trace:
I20260709 13:04:59.676266 17232 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:59.676544 15337 rpcz_store.cc:276] 0709 13:04:52.961056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.970135 (+  9079us) service_pool.cc:224] Handling call
0709 13:04:53.145556 (+175421us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:04:59.647955 (+6502399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":290702,"reported_tablets":19,"spinlock_wait_cycles":15315712}
I20260709 13:04:59.595016 17305 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:04:59.680703 17305 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:59.681233 17305 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:04:59.682359 17305 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.657440 17235 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:59.689299 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:04:59.692569 15511 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:59.694588 15516 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:04:59.653653 17300 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:04:59.661072 17239 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:04:59.701296 17299 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:59.701797 17299 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:04:59.647246 17241 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.706157 15443 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:04:59.708297 17233 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:59.708540 17279 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.003s
I20260709 13:04:59.709172 17279 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:59.719645 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 135648us
I20260709 13:04:59.723109 15590 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:59.638389 16943 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:59.736388 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:59.737392 15513 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:59.738909 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:59.745312 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 168593us
I20260709 13:04:59.758496 17238 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.759248 17238 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.762503 17238 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:59.772881 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:59.779466 15442 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:59.782691 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 146514us
I20260709 13:04:59.808284 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:59.820866 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:59.779083 17146 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:59.821557 15439 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:59.798385 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:59.815488 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.740707 17236 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:04:59.826646 15555 leader_election.cc:400] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
I20260709 13:04:59.830693 15555 leader_election.cc:403] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:59.660588 17318 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.830832 15518 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:59.834446 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:59.803258 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:04:59.784497 17305 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.789907 17279 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.785377 17292 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:04:59.855248 17204 consensus_meta.cc:287] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.000s
I20260709 13:04:59.838150 17258 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:04:59.852646 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65072.5us
I20260709 13:04:59.832779 17291 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:59.852895 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:59.854144 17318 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:59.854717 15509 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:04:59.855789 15511 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:59.835959 17238 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:04:59.830732 17241 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:59.894351 17241 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.894845 17249 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:04:59.895413 17249 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.896822 17241 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:04:59.897696 17334 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:59.898242 17249 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:59.846020 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:04:59.899171 15518 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:59.858057 17335 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:04:59.858824 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 74578.4us
I20260709 13:04:59.880790 15512 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.855614 17292 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.885597 17336 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:59.893594 17318 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:59.869489 17235 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3.
W20260709 13:04:59.904114 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 57356.9us
I20260709 13:04:59.905457 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:04:59.946873 15586 raft_consensus.cc:2393] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:04:59.920950 15514 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:59.903892 15511 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:59.950551 17239 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:59.951989 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45482.2us
W20260709 13:04:59.957228 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 116221us
I20260709 13:04:59.967705 15518 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:04:59.886759 17165 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:04:59.976927 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.909566 17233 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:04:59.882200 17204 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.909974 17346 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:04:59.962146 17272 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:04:59.990985 15512 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:04:59.991110 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 83793.3us
I20260709 13:04:59.970707 17277 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:04:59.994413 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:04:59.885947 17291 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:04:59.941277 17232 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:05:00.004201 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44123us
I20260709 13:05:00.005262 15407 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:04:59.954259 17348 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:05:00.013000 15583 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:00.015297 17258 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:00.015806 17204 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:04:59.955035 17336 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:04:59.993073 17233 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.018592 17336 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:00.018698 17233 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:04:59.991379 17165 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:00.019382 17165 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:00.020408 17165 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.021618 17165 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:00.030823 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:00.029668 17349 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:00.035807 15513 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:00.043308 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:00.056717 17352 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:00.057463 17352 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:00.058825 17352 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.049019 17235 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:00.062945 17235 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:00.063335 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 58212us
I20260709 13:05:00.065678 17235 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:00.005183 17346 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:00.075258 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:00.076525 15443 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:05:00.077456 17346 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:00.078442 17292 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:00.085273 17299 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.086838 17299 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.094278 16943 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:00.095999 15435 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:00.059202 17291 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:00.129560 16943 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:00.159170 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:00.160142 16179 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:05:00.162228 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:00.164104 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:00.165160 16176 raft_consensus.cc:2393] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:00.197116 17127 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:00.198388 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 155194us
I20260709 13:05:00.198575 17127 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.199241 17127 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.199433 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:00.200198 17349 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:00.201403 17344 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.163084 17337 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:00.203510 17337 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:00.220412 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65224.2us
W20260709 13:05:00.239708 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 286352us
I20260709 13:05:00.241109 16730 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.241276 15406 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:00.255373 15406 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:00.262193 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:00.263355 16730 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.264056 16730 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:00.264981 16730 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:00.266564 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.267416 15517 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.290374 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:00.304781 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:00.304670 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 103807us
I20260709 13:05:00.307508 15587 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.262231 17165 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.308638 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:00.308725 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.309741 15517 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
W20260709 13:05:00.310456 15555 leader_election.cc:336] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.537s (SENT)
I20260709 13:05:00.316987 15592 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 4: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:00.318157 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:00.315064 15591 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:00.260115 17270 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:00.324402 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:00.325197 15590 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.327275 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.319934 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:00.326511 17270 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:00.323870 17165 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:00.333702 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:00.305325 17127 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:00.335630 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:00.359493 15584 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:00.303980 17349 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:00.361930 15517 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.356374 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:00.373028 15588 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:00.357343 15441 raft_consensus.cc:606] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:00.361094 15589 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:00.359160 15585 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:05:00.328444 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:00.374289 15441 raft_consensus.cc:614] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:00.374879 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 46537.9us
I20260709 13:05:00.319648 17315 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:05:00.363080 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.381805 15590 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:00.316718 17318 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:05:00.366701 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:00.369366 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:00.385283 15517 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:00.389461 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.389727 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.371206 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:00.377319 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.361250 17340 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:00.393237 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.398537 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.398790 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.402311 15516 raft_consensus.cc:2368] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:00.392062 15509 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:00.390973 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.403524 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:00.404007 15514 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:00.404459 17331 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.450s	user 0.002s	sys 0.000s
I20260709 13:05:00.404691 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:00.404946 17363 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.405295 17311 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:00.405894 17311 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:00.405926 17344 consensus_queue.cc:1059] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:05:00.410652 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.411674 15518 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:00.413429 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:00.414435 17127 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:00.407626 17360 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:00.414950 16176 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:00.415153 17343 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:05:00.404392 15435 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:00.417610 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.419587 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:00.420784 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.421037 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.421941 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.422354 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:00.422911 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.393518 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:00.425910 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.426487 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.426739 15513 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:00.427444 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.425820 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:00.428364 15514 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:00.428735 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.427652 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.427323 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.387964 17307 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:00.432940 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.433627 15512 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:00.375243 17248 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:05:00.437361 15514 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 4. Ops: []
I20260709 13:05:00.440439 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.441550 15518 raft_consensus.cc:2368] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:00.464519 15514 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:00.556134 17349 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.439507 17307 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:00.634156 17307 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.445266 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.536746 17337 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:00.636511 15512 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:00.618165 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:05:00.508205 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.637859 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.638480 15512 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.514587 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:00.422026 17299 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:00.609577 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:00.388247 17318 consensus_queue.cc:1243] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:05:00.640463 15588 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:00.640879 15555 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.568s (SENT)
I20260709 13:05:00.541241 17270 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:00.509336 17232 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:00.641608 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:00.432467 17233 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:00.642236 17232 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:00.642642 17233 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.644557 17232 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:00.645040 17233 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:00.445313 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.421837 17165 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.646260 15516 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:00.647001 15341 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 104) took 1368 ms. Trace:
I20260709 13:05:00.647182 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.635427 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.648473 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.656271 15516 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.663818 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "534703c18f76440380b33b80bf77802e"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:00.432287 16943 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.665690 16943 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.540807 17370 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.667016 17370 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:00.668375 17370 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:00.670223 17370 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.651014 15338 catalog_manager.cc:5697] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } }
I20260709 13:05:00.652053 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:00.653540 17240 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:00.622107 17291 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:00.655380 17371 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:00.521625 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:00.463378 15511 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:00.538483 17311 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:00.449247 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.695699 15510 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:00.517781 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:00.696342 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:00.696753 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 179141us
I20260709 13:05:00.608700 17305 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:00.640390 17299 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.445758 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:00.509989 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:00.507671 17360 raft_consensus.cc:697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:00.683300 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:00.722084 15516 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:00.724015 15516 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:00.686617 17337 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.692288 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.682099 15338 catalog_manager.cc:5697] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:00.691123 15588 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:00.713073 17236 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:00.714618 17305 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:00.629961 17340 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:00.748627 15338 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:00.702785 15512 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:00.776933 15516 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:00.779153 15512 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:00.647389 15341 rpcz_store.cc:276] 0709 13:04:59.278272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.278559 (+   287us) service_pool.cc:224] Handling call
0709 13:05:00.646905 (+1368346us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:59.850299 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:59.850928 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:59.850972 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:04:59.850991 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:59.851473 (+   482us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:59.851529 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:59.853602 (+  2073us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:59.853975 (+   373us) tablet.cc:701] Row locks acquired
0709 13:04:59.853990 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:04:59.854168 (+   178us) write_op.cc:270] Start()
0709 13:04:59.854320 (+   152us) write_op.cc:276] Timestamp: P: 1783602299854111 usec, L: 0
0709 13:04:59.854341 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:04:59.857779 (+  3438us) log.cc:844] Serialized 919 byte log entry
0709 13:05:00.330568 (+472789us) op_driver.cc:464] REPLICATION: finished
0709 13:05:00.411178 (+ 80610us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd52e28 00007fcf7f78d581 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d 000000000038f354 000000000038f199
0709 13:05:00.532740 (+121562us) write_op.cc:301] APPLY: starting
0709 13:05:00.532871 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:00.533097 (+   226us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:00.533138 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:00.533629 (+   491us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:00.533852 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:05:00.533916 (+    64us) write_op.cc:312] APPLY: finished
0709 13:05:00.534138 (+   222us) log.cc:844] Serialized 29 byte log entry
0709 13:05:00.534363 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:00.534479 (+   116us) write_op.cc:454] Released schema lock
0709 13:05:00.534535 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:00.534991 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:00.535025 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":160248,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":113911,"apply.run_cpu_time_us":2329,"apply.run_wall_time_us":23203,"num_ops":2,"prepare.queue_time_us":264188,"prepare.run_cpu_time_us":46364,"prepare.run_wall_time_us":561115,"raft.queue_time_us":253724,"raft.run_cpu_time_us":7346,"raft.run_wall_time_us":54802,"replication_time_us":476046,"spinlock_wait_cycles":6011264,"thread_start_us":465323,"threads_started":4,"wal-append.queue_time_us":126496}]]}
I20260709 13:05:00.750563 17236 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.783174 17236 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:00.782874 17360 consensus_queue.cc:237] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:00.786629 15406 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:00.694311 17371 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:00.785567 16730 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:05:00.791152 16730 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:00.788039 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:00.788210 15338 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:05:00.789608 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49431.8us
I20260709 13:05:00.800096 16730 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:00.742491 17258 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:00.802179 15509 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:00.793046 15338 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 4, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 4 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:00.809506 15555 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.685s (SENT)
I20260709 13:05:00.809927 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:00.812359 15338 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:00.820760 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.798s (SENT)
W20260709 13:05:00.822638 15555 leader_election.cc:336] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.810s (SENT)
I20260709 13:05:00.823220 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:00.751077 17340 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:00.826556 15338 catalog_manager.cc:5697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.830432 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:00.790040 17180 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:00.796535 16943 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:00.836547 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.852950 15435 raft_consensus.cc:606] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:00.837090 16730 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:00.854003 15589 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:01.240245 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:00.930341 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:01.241039 15590 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:01.002252 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 214306us
I20260709 13:05:00.932895 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:00.987110 16146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.002s	sys 0.028s
W20260709 13:05:01.244979 16146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.002s	sys 0.040s
I20260709 13:05:00.975097 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:00.855350 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:01.059095 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 282462us
I20260709 13:05:01.238512 15436 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:01.245579 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 809063us
I20260709 13:05:01.259086 15590 raft_consensus.cc:2410] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:05:01.271124 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:01.272177 15586 raft_consensus.cc:2368] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5.
W20260709 13:05:01.148594 17363 consensus_meta.cc:287] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.743s	user 0.006s	sys 0.008s
I20260709 13:05:01.083508 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:01.144471 17307 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:05:01.065399 17127 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:00.836043 17269 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.155964 15588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:37000
I20260709 13:05:00.813109 17351 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:01.268980 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.929s (SENT)
I20260709 13:05:01.283352 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:00.930020 17376 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.351s	user 0.000s	sys 0.000s
I20260709 13:05:00.834050 17292 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:01.293241 15510 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:01.374284 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:01.376710 15588 raft_consensus.cc:606] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:01.295794 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:01.389457 15588 raft_consensus.cc:614] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:01.391606 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:01.393620 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:01.378163 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:01.372396 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:01.296775 15592 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:00.923960 17305 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:01.386580 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:00.921748 17315 raft_consensus.cc:3055] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.912737 17299 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:01.297224 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:01.411419 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 157276us
I20260709 13:05:01.041808 17003 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:01.124657 17249 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:01.400373 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:01.400666 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:01.387580 17337 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
W20260709 13:05:01.412144 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 138612us
I20260709 13:05:01.293051 17363 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:01.292424 17248 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:01.288863 17277 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.431607 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:01.397401 17351 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:01.226387 17236 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.419519 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:00.835990 17258 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:01.422611 17301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.023s	sys 0.053s
I20260709 13:05:01.291793 17279 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 13:05:01.292906 17239 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.136s
I20260709 13:05:01.405113 17315 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:01.462900 15587 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.856463 17180 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.408527 17381 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.392992 17127 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:01.429497 17370 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.759s	user 0.015s	sys 0.000s
W20260709 13:05:01.467886 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 93947.3us
I20260709 13:05:00.973512 17371 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.463864 17291 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:01.387435 17307 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:01.484565 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 63835.2us
I20260709 13:05:00.903918 17340 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:01.479974 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 184289us
W20260709 13:05:01.504330 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.505342 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:01.425108 17378 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:01.424628 17337 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.519806 17337 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:01.520972 17337 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:01.521601 17279 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.432937 17249 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:01.523731 17238 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:01.524175 17238 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:01.524605 17249 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:01.525044 17238 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.526191 17299 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:01.526432 17238 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:01.523767 17371 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:01.528610 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.532680 17232 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:01.533417 17232 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:01.534296 16175 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:01.535580 17307 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:01.538226 17232 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:01.540939 17258 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:01.544601 17353 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:01.526805 17299 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:01.461463 17301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.024s	sys 0.053s
I20260709 13:05:01.550009 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1345) took 1039 ms. Trace:
I20260709 13:05:01.506698 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:01.469218 17240 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:01.454195 17248 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:01.518164 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 104681us
I20260709 13:05:01.566109 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:01.567417 16730 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:01.518116 17291 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.457369 17292 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:01.453088 17351 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:01.432605 17003 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:01.578573 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:01.579031 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:01.461000 17277 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:01.480232 17366 raft_consensus.cc:476] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:05:01.550648 15514 rpcz_store.cc:276] 0709 13:05:00.510561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.648502 (+137941us) service_pool.cc:224] Handling call
0709 13:05:00.665548 (+ 17046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.690599 (+ 25051us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:00.719339 (+ 28740us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.372453 (+653114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.410546 (+ 38093us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.410787 (+   241us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:01.444711 (+ 33924us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.458596 (+ 13885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.458730 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.549706 (+ 90976us) raft_consensus.cc:1685] finished
0709 13:05:01.549739 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.549926 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":356801,"prepare.queue_time_us":71973,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":4725,"raft.queue_time_us":269119,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":11919,"thread_start_us":305160,"threads_started":1,"wal-append.queue_time_us":670848}
I20260709 13:05:01.580935 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1339) took 1135 ms. Trace:
W20260709 13:05:01.559783 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.496381 17379 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:01.523344 17337 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:01.598074 15586 raft_consensus.cc:2368] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3.
I20260709 13:05:01.600211 15513 rpcz_store.cc:276] 0709 13:05:00.430105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.442508 (+ 12403us) service_pool.cc:224] Handling call
0709 13:05:00.442883 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.520487 (+ 77604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.520521 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.521261 (+   740us) log.cc:844] Serialized 26 byte log entry
0709 13:05:00.804448 (+283187us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:01.065127 (+260679us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.565025 (+499898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.565123 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.565166 (+    43us) raft_consensus.cc:1685] finished
0709 13:05:01.565177 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.565333 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":371211,"prepare.queue_time_us":51691,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":412764,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":11628,"thread_start_us":662243,"threads_started":3,"wal-append.queue_time_us":373383}
I20260709 13:05:01.608067 15587 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:01.505904 17370 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:01.620723 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 189291us
I20260709 13:05:01.661751 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:01.663311 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:01.572762 17381 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:01.677914 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:01.588369 17292 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:01.732276 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:01.733126 15441 raft_consensus.cc:606] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:01.733748 15441 raft_consensus.cc:614] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:01.733112 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55335.7us
I20260709 13:05:01.736537 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:01.644340 17366 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:01.604992 17337 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:01.742838 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:01.751263 15516 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:01.667937 17349 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.559527 17378 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:01.765213 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 367391us
I20260709 13:05:01.733170 17382 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:01.749158 17393 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.140s	user 0.003s	sys 0.000s
I20260709 13:05:01.767328 15510 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:01.748116 17292 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:01.749398 17370 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:01.643031 17379 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.755613 17232 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.792959 17403 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:01.794529 17403 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:01.772009 17399 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:01.775054 17305 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.772542 17405 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:01.828467 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1341) took 1352 ms. Trace:
I20260709 13:05:01.789088 17232 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.795032 17403 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:01.822472 15482 leader_election.cc:400] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5.
I20260709 13:05:01.833961 15482 leader_election.cc:403] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:01.823947 17398 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:05:01.813654 17003 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:01.765513 17349 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:01.829101 15518 rpcz_store.cc:276] 0709 13:05:00.475950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.508527 (+ 32577us) service_pool.cc:224] Handling call
0709 13:05:00.508878 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.747763 (+238885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.747801 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.748360 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.176121 (+427761us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:01.218339 (+ 42218us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.298030 (+ 79691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.298191 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.828131 (+529940us) raft_consensus.cc:1685] finished
0709 13:05:01.828166 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.828365 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105657,"prepare.queue_time_us":42805,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":112249,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":14285,"thread_start_us":591083,"threads_started":2,"wal-append.queue_time_us":740861}
I20260709 13:05:01.836584 17236 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:01.837850 17370 consensus_queue.cc:1059] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:05:01.786612 17337 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.834826 17305 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:01.838706 17268 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:01.862942 16175 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:01.863942 17291 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:01.864682 15585 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:01.883942 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.884320 16179 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:01.886149 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:01.886989 15509 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:05:01.890208 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:01.866073 17403 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:01.866145 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:01.876343 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:01.830022 17399 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:01.876168 17268 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:01.902791 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 278479us
W20260709 13:05:01.946163 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 55882.8us
I20260709 13:05:01.996759 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1615) took 1544 ms. Trace:
I20260709 13:05:01.997869 15441 raft_consensus.cc:606] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:01.947675 17305 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:01.868131 15512 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:01.995247 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:01.997709 15585 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:01.997328 15587 rpcz_store.cc:276] 0709 13:05:00.351122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.357542 (+  6420us) service_pool.cc:224] Handling call
0709 13:05:01.881320 (+1523778us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540015e5d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:01.895179 (+ 13859us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479105280}
I20260709 13:05:01.999933 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.001024 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.002404 15439 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:01.997949 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:02.022399 15437 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:02.023054 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.027585 15443 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:02.040346 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:01.891619 17311 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:01.873181 17337 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.053803 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:01.871743 17382 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5.
I20260709 13:05:01.871023 17370 raft_consensus.cc:3055] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:01.869005 17248 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.043957 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:01.867816 17299 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:01.869119 17405 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:01.839671 17408 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:02.061092 15555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.019s	sys 0.035s
I20260709 13:05:01.993391 17381 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:01.994302 17236 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:02.080955 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.053658 17311 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.026862 17403 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.067058 15436 raft_consensus.cc:2410] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:05:02.069861 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:02.070410 15555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.020s	sys 0.035s
I20260709 13:05:02.035332 17269 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.061844 17415 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:01.866307 17401 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.202s
W20260709 13:05:02.118070 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.062827 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.060756 17370 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:02.065034 17305 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.064742 17406 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.074528 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.155113 15585 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:02.137645 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:02.136828 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 867805us
I20260709 13:05:02.155028 15443 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:05:02.070246 17410 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.126113 17311 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.163463 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:02.161736 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.159001 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.954s (SENT) [suppressed 20 similar messages]
W20260709 13:05:02.156306 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 139464us
I20260709 13:05:02.162848 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:02.080464 17277 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.133787 17391 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:02.169713 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 96886.7us
I20260709 13:05:02.125156 17341 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.135380 17248 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.133100 17371 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.178944 16146 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:02.191202 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.192989 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.202765 15585 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:02.203438 16146 leader_election.cc:400] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3.
I20260709 13:05:02.203845 16146 leader_election.cc:403] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:05:02.203944 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.204597 15585 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:05:02.194594 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.082355 17408 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.218747 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.219533 15587 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:02.130221 17381 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.213016 15584 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:02.218364 15583 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:02.164529 17415 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:02.131304 17236 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.226390 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.081068 17405 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.142758 17269 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.244015 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.245285 15587 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:02.249342 15443 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:02.249539 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.222702 17277 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:02.266105 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49247.7us
W20260709 13:05:02.251504 17404 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:05:02.241400 17401 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.251506 17423 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.222258 17378 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.161576 17305 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.272760 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:02.240001 17351 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.608s	user 0.014s	sys 0.006s
W20260709 13:05:02.299494 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.310510 17351 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.275604 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.276600 15592 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:02.212563 17299 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:05:02.240950 17003 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.282342 17127 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:02.289950 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:02.223907 17371 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:02.277151 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 118200us
I20260709 13:05:02.307644 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:02.309382 17305 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.258674 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:02.293643 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:02.307004 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.323918 15441 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:02.212875 17248 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.327078 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:02.168383 17410 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.321015 15438 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:02.321312 15555 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.151s (SENT)
I20260709 13:05:02.251784 17370 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:02.326181 17366 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.572s	user 0.018s	sys 0.001s
I20260709 13:05:02.323339 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:02.202580 17391 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.340766 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:02.307417 17378 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.312860 17379 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.212688 17341 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.266469 17390 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:05:02.236784 17382 consensus_queue.cc:1059] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:05:02.348904 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:02.349426 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:02.385859 17371 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.386098 17341 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.368091 15438 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:02.350109 17427 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.350492 17400 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:02.350889 17417 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:05:02.352276 17420 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:05:02.352159 17347 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:02.357420 17416 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 13:05:02.358027 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 120566us
W20260709 13:05:02.299724 16175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 359) took 1679 ms (client timeout 1579 ms). Trace:
I20260709 13:05:02.394345 16179 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:02.373726 15518 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:02.343253 15509 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:05:02.306170 17401 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.342625 17421 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.320406 17003 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.398343 17399 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.415575 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:02.358827 17415 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.421830 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:02.347456 17268 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.359892 17366 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:02.419155 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:02.383291 17391 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.392359 17390 consensus_queue.cc:1243] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:05:02.425218 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 92131us
I20260709 13:05:02.392374 17355 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3.
I20260709 13:05:02.398736 17379 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.453511 15439 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:02.441043 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 167895us
W20260709 13:05:02.446112 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.446316 15518 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:02.456303 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:02.458755 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:02.403246 17378 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.462373 15406 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:02.316491 17423 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.472025 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:02.469362 17366 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:02.473779 17366 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.425547 17347 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.469659 17305 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:02.476212 17003 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.476433 17347 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.474253 17366 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.445488 17268 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.477077 17347 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:02.408751 16175 rpcz_store.cc:269] 0709 13:05:00.616337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.617816 (+  1479us) service_pool.cc:224] Handling call
0709 13:05:02.295291 (+1677475us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b5400520154. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:02.295498 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062330752}
I20260709 13:05:02.404808 17427 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.490916 17431 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:02.408912 17400 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.493451 17427 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.494287 17400 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.497687 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:02.482359 17003 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.500867 17003 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.465507 17379 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.505041 17433 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.498555 15516 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:05:02.506532 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 185233us
I20260709 13:05:02.527011 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:02.511363 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 87003.4us
I20260709 13:05:02.529124 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:02.530459 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 62242.6us
W20260709 13:05:02.610940 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 81949.2us
I20260709 13:05:02.612246 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:02.488333 17249 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.488161 17351 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.423398 17421 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.643579 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:02.560459 17427 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:02.491074 17412 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.216s
W20260709 13:05:02.680549 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 141120us
I20260709 13:05:02.634207 17408 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.639485 17003 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.650223 17382 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:02.707984 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 95869.2us
I20260709 13:05:02.713920 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:02.738937 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.674453 17427 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.741685 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:02.751900 17236 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:02.684413 17381 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.752480 17453 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:02.752978 17381 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.753510 17381 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.754135 17437 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.754773 17437 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.757982 17447 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:02.764746 17447 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:02.766607 17447 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:02.767021 17447 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.768682 17378 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:02.768478 17451 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:02.770551 17434 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:05:02.770371 17451 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.719070 17405 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.748930 17427 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:02.774576 17431 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:02.558810 17433 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.776590 17180 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:02.770418 17337 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.707s	user 0.015s	sys 0.000s
I20260709 13:05:02.779663 17337 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.780295 17337 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:02.782002 17292 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.998s	user 0.012s	sys 0.000s
I20260709 13:05:02.782431 17268 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.782513 17292 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.783095 17268 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.779220 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1524) took 1117 ms. Trace:
W20260709 13:05:02.721269 17420 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:05:02.767374 17447 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.811025 15585 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:02.782685 17337 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.799918 17456 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.800194 17232 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.802239 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:02.802649 17311 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.002s
I20260709 13:05:02.796885 17408 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:02.823971 17408 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.826447 17408 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:02.804826 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.775898 17366 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:02.828439 17403 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.689s	user 0.013s	sys 0.000s
I20260709 13:05:02.829053 17366 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.751109 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:02.785795 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.830123 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 79161.3us
I20260709 13:05:02.797463 15512 rpcz_store.cc:276] 0709 13:05:01.662154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.678465 (+ 16311us) service_pool.cc:224] Handling call
0709 13:05:01.678852 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.015252 (+336400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.778819 (+763567us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400295254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:02.779117 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434288896}
I20260709 13:05:02.812096 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.831825 15584 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:05:02.796172 17268 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.753532 17453 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.744958 17269 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.808662 17236 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.768639 17401 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.828573 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:02.759954 17410 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.777505 17433 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.771692 17423 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.806970 17381 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.822911 17311 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:02.848006 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.783936 17437 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.753855 17421 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.851050 17236 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.848006 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.870357 17311 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.854691 15586 raft_consensus.cc:2393] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 2: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:02.871248 17236 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.873082 17340 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:02.873682 17436 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:05:02.876050 17437 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.853587 17444 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:02.856528 17232 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.854476 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:02.865558 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 123944us
I20260709 13:05:02.747439 17382 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:02.867880 15555 connection.cc:256] RPC call timeout handler was delayed by -1.5846354660000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23010000000000003s for a response
W20260709 13:05:02.889619 15555 connection.cc:256] RPC call timeout handler was delayed by -1.5547023089999357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:05:02.889890 15555 connection.cc:256] RPC call timeout handler was delayed by -1.4521023089999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:05:02.890309 16146 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:02.891010 15555 leader_election.cc:336] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.115s (SENT)
I20260709 13:05:02.838506 17456 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.882203 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.884137 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:02.854015 17453 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.886785 17232 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.900621 17453 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.893085 17311 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.903062 17311 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:02.903970 17311 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.898524 17456 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.903862 17232 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.912760 17382 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:02.915323 17451 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:02.921715 17400 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.916471 17268 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:02.922984 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.922914 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.924324 17268 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:02.920759 17444 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:02.891417 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:02.932217 15406 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:02.932806 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:02.933104 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:02.935101 15512 pending_rounds.cc:85] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 1
I20260709 13:05:02.935451 15512 pending_rounds.cc:107] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:05:02.873111 17292 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:02.935721 15512 raft_consensus.cc:2889] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:02.936774 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:02.942410 15516 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:02.936880 17406 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.938041 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:02.938463 17258 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:02.945719 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54726.1us
W20260709 13:05:02.946728 15555 leader_election.cc:336] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.156s (SENT)
I20260709 13:05:02.947122 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:02.951694 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:02.952376 15516 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.953150 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:02.876636 17437 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:02.957901 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:02.959172 15517 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:02.950945 17421 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:02.962982 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:02.964751 16179 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:02.969901 15555 connection.cc:256] RPC call timeout handler was delayed by -1.3189023090000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 13:05:02.971346 15555 connection.cc:256] RPC call timeout handler was delayed by -1.1974023089999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:05:02.972287 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:02.972852 15555 connection.cc:256] RPC call timeout handler was delayed by -1.1443168550000564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:05:02.973927 15555 connection.cc:256] RPC call timeout handler was delayed by -1.1235847670000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3054s for a response
I20260709 13:05:02.971360 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:02.974857 15555 connection.cc:256] RPC call timeout handler was delayed by -1.0939168549999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:05:02.976121 15555 connection.cc:256] RPC call timeout handler was delayed by -1.0397101329999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 13:05:02.981076 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:02.981873 15518 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:02.984705 15443 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:02.986567 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:02.991351 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:02.993944 16730 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:02.994383 16730 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:02.994730 16730 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.995090 17232 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:02.991351 15556 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:02.991782 17419 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:02.997684 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:03.003861 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:03.004498 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.005098 17456 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:03.006534 17349 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:03.006878 17421 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.979077 17292 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.008706 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:02.951323 17406 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.010794 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:02.995980 17232 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:03.015887 15516 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:02.925619 17444 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.011452 17421 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.023910 17456 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:03.024762 17456 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.001212 17427 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.000841 17341 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:03.011991 17292 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.011590 17291 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.028705 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:03.029314 17291 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:03.030274 17291 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.030913 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:03.032444 17421 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.032553 17248 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:03.033017 17421 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:03.033973 17421 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.041064 16181 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.048857 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.049911 15510 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:05:03.050254 15436 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:03.050822 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:03.048868 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.052147 15513 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:05:03.052762 17456 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:03.056386 17459 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:03.056682 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.031320 17291 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.057670 15517 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.018998 16730 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.017208 15406 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:03.011353 17258 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:03.053998 17456 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:03.064568 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.059767 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.066433 15513 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:05:03.067474 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.056151 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.061379 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.061406 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:03.063169 17379 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.022264 17232 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:03.073993 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.072443 16730 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.069741 15516 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:03.018941 15443 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:03.070627 16176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 239) took 1775 ms. Trace:
I20260709 13:05:03.028965 17427 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.071964 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:03.028981 17292 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:03.064165 17366 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.063620 17406 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.062137 17442 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:03.056071 17370 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.064301 17258 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:03.093152 15517 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:03.082535 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.095896 15513 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.073344 17294 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.092979 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.075167 17003 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.075457 17439 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:03.105784 15407 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.104321 15516 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:03.107729 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.109843 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:03.110951 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.111385 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:03.115656 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:03.083981 17450 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:03.125409 16179 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
W20260709 13:05:03.180317 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69036.1us
I20260709 13:05:03.180435 15515 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:03.181856 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:03.065523 17311 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.080147 16176 rpcz_store.cc:276] 0709 13:05:01.325989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.394697 (+ 68708us) service_pool.cc:224] Handling call
0709 13:05:01.483514 (+ 88817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.525756 (+ 42242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.525804 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.525855 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:01.525895 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.070171 (+1544276us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b54004b8cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:03.070239 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.070513 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84300032}
I20260709 13:05:03.101920 17258 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.103812 17277 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:03.247694 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:03.248543 15591 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.093848 17341 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260709 13:05:03.257767 17341 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:03.258395 17341 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:03.221112 17449 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:03.222054 17400 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:03.228322 17409 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.259486 17449 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:03.259615 17341 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.259958 17409 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.226116 17238 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.264176 17238 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.266575 17238 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.225915 17444 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.229676 17311 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.103973 17366 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:03.267443 17444 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:03.268304 17366 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:03.232906 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.105327 17439 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:03.101621 17442 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.270641 17439 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.116833 17299 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:03.232221 17443 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
I20260709 13:05:03.178774 17422 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:03.212258 17412 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.240938 17447 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.242046 15513 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:03.244876 17292 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.253844 17437 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:03.258900 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.224740 17387 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:03.260491 17449 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.261154 17341 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.263456 17409 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.268476 17444 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.219841 17456 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.246734 17277 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:03.307963 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.311968 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.345384 15518 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:05:03.310261 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 222406us
W20260709 13:05:03.316129 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 205242us
I20260709 13:05:03.350011 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.329783 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.351465 15516 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:03.278234 15591 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:05:03.352380 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.326310 17387 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:03.343346 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:03.367740 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.383898 17406 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:03.387302 17387 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.387403 17406 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.389114 17127 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:03.389689 17127 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.389961 17406 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.390056 17127 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:03.354621 17360 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:05:03.332383 17277 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.295066 17447 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.376454 17315 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.316917 17180 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.295804 17442 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:03.354940 17390 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:03.397800 17390 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:03.398373 17390 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:03.400059 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 290281us
I20260709 13:05:03.401302 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:03.404289 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61024.6us
W20260709 13:05:03.406477 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54177.4us
I20260709 13:05:03.302680 17258 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.448043 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:03.449683 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:03.450742 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.476210 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 128926us
I20260709 13:05:03.476447 17449 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:03.437769 17307 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:03.438916 17360 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:03.475147 17422 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.445910 17409 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:05:03.467639 17315 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.495605 15442 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:03.482479 17449 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.503917 15442 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:03.488389 17360 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:03.509944 17258 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.492796 17387 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.513265 17450 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:03.514171 17387 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.515394 17341 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.515056 17450 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:03.515872 17341 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:03.516372 17450 consensus_queue.cc:1243] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:05:03.516990 17471 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.517391 17471 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:03.517009 17341 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.518476 17471 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.519140 17341 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.520006 17471 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.522838 17277 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.504597 17449 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.533145 17419 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.528841 17391 raft_consensus.cc:993] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:03.542146 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1543) took 1295 ms. Trace:
I20260709 13:05:03.562565 15514 rpcz_store.cc:276] 0709 13:05:02.246572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.389366 (+142794us) service_pool.cc:224] Handling call
0709 13:05:02.389666 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.476180 (+ 86514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.476213 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.476262 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:02.476295 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.541884 (+1065589us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b54001e5ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:03.541933 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.542071 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198444288}
W20260709 13:05:03.561622 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.580s (SENT)
I20260709 13:05:03.496412 17439 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.563165 17419 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:03.603827 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 129789us
I20260709 13:05:03.572703 17391 raft_consensus.cc:1081] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:03.608158 15443 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:03.618999 17469 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:03.633184 15587 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:03.633828 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:03.634575 15435 raft_consensus.cc:606] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:03.637383 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:05:03.638908 17232 consensus_meta.cc:287] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.004s
I20260709 13:05:03.645975 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:03.647010 15587 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:03.655777 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:03.656755 15591 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:03.642939 17127 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:03.653127 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 194578us
I20260709 13:05:03.654016 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:03.663357 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:03.667011 15591 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:05:03.669094 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 219520us
I20260709 13:05:03.669919 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:03.672828 17471 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.673252 17449 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.673453 17471 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:03.677165 15435 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:03.677220 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:03.678172 15435 pending_rounds.cc:85] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 2
I20260709 13:05:03.678625 15435 pending_rounds.cc:107] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:03.678989 15435 raft_consensus.cc:2889] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:03.679224 15587 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
W20260709 13:05:03.660753 17472 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.170s	user 0.000s	sys 0.002s
I20260709 13:05:03.639425 17232 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.683730 17366 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:03.696141 17366 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.682643 15591 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:03.683297 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:03.684795 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:03.686523 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.702400 15514 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.698253 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:03.703184 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.097s (SENT)
I20260709 13:05:03.703622 15512 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.703668 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.698529 15509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:05:03.704792 15509 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.705173 15509 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.695246 17277 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.699100 15443 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:03.707595 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:03.711256 15586 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:03.711635 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:03.712379 15588 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:03.714849 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:03.717381 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:03.721103 17445 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.721592 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:03.651477 17360 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:03.728233 17291 consensus_meta.cc:287] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.002s
I20260709 13:05:03.728428 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:03.729143 15583 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:03.729324 15591 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
W20260709 13:05:03.731237 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.696417 17449 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.696609 17366 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:03.736878 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 270207us
W20260709 13:05:03.738396 17473 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.227s	user 0.002s	sys 0.000s
I20260709 13:05:03.736927 17307 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 3 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:03.742072 16176 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:03.742615 17307 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:03.745033 16146 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:03.746455 17277 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:03.756213 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.760226 15514 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:03.761598 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.763132 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.764050 15514 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.698835 17127 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.799054 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:03.697263 17439 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:03.819448 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 99424.1us
I20260709 13:05:03.810822 16181 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:05:03.799767 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.820897 16181 pending_rounds.cc:85] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Aborting all ops after (but not including) 4
I20260709 13:05:03.821413 16181 pending_rounds.cc:107] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:05:03.821717 16181 raft_consensus.cc:2889] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:03.781631 15583 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:03.823261 15511 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.824447 15586 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:03.808907 15509 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:03.902518 15509 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.900422 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1636) took 1633 ms. Trace:
I20260709 13:05:03.844300 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:03.905683 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68111.3us
I20260709 13:05:03.908047 16179 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:03.907876 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 63684.4us
I20260709 13:05:03.909969 15513 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:03.904345 15585 rpcz_store.cc:276] 0709 13:05:02.196975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.205280 (+  8305us) service_pool.cc:224] Handling call
0709 13:05:02.212137 (+  6857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.811755 (+599618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.830550 (+1018795us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54001de7d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:03.830729 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376653056}
I20260709 13:05:03.907742 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.914031 15516 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:03.851526 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.812592 17232 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:03.919364 15514 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
W20260709 13:05:03.907624 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86736us
W20260709 13:05:03.842882 15515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1353) took 2983 ms (client timeout 1580 ms). Trace:
I20260709 13:05:03.930713 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:03.937093 15516 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
W20260709 13:05:03.929654 15515 rpcz_store.cc:269] 0709 13:05:00.839951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.929929 (+ 89978us) service_pool.cc:224] Handling call
0709 13:05:03.822699 (+2892770us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400212d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:03.822828 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4459260672}
I20260709 13:05:03.941185 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:03.815361 17445 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:05:03.973809 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48364.4us
I20260709 13:05:03.831424 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:03.969059 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:03.908305 17236 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:03.972741 16179 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:03.819387 17484 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:03.982348 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.829921 17471 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:03.984318 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.995844 15513 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:03.954777 17442 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.997413 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:04.001256 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:03.999130 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:04.002200 15518 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:04.003213 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.975739 15512 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:03.823698 17291 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:03.940168 17248 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.988363 15509 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:03.983180 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.989674 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:04.004808 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:04.005986 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:04.006204 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.938740 17421 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:05:03.954437 17311 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:05:03.979362 17424 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:04.035851 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:04.039505 15516 raft_consensus.cc:2376] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5. Re-sending same reply.
I20260709 13:05:04.042068 15513 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:04.043268 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:04.044663 15513 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:03.962154 17481 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:05:04.045923 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:04.047184 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:04.033334 17390 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.004s
I20260709 13:05:04.048355 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.987502 17484 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.012722 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:04.059055 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:03.996927 17236 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.036897 17248 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:04.045032 17337 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:04.041742 17470 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.990054 17445 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.013098 17291 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.010278 17442 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.049309 17424 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:04.094312 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.058240 17390 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.092466 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:04.153051 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1355) took 3312 ms. Trace:
I20260709 13:05:04.246655 15511 rpcz_store.cc:276] 0709 13:05:00.840766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.283473 (+442707us) service_pool.cc:224] Handling call
0709 13:05:03.822934 (+2539461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:03.823785 (+   851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.152665 (+328880us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b5400212d50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:04.152908 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5599764224}
I20260709 13:05:04.117254 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:04.201488 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 232505us
I20260709 13:05:04.248728 15511 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:05:04.170431 17474 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.575s	user 0.002s	sys 0.000s
W20260709 13:05:04.190819 17419 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.002s
I20260709 13:05:04.227865 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.257838 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:04.249483 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:04.259346 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 290945us
I20260709 13:05:04.249754 15591 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:04.158682 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:04.151664 17424 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.279348 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.089505 17337 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:04.093791 16176 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:04.125672 17236 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:04.192826 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:04.289783 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.289973 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.119112 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.156050 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:04.264604 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.266065 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.266335 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.268106 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.269276 15518 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:04.270975 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.279594 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.091181 17470 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:04.283030 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:04.295970 15443 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.291862 16181 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:04.284549 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.282280 17419 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.110181 17496 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:04.102512 17315 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.001s
W20260709 13:05:04.156996 17180 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.718s	user 0.013s	sys 0.000s
I20260709 13:05:04.291921 15587 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:04.294198 15515 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:04.294198 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:04.294986 15516 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:04.133612 17291 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.316310 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:04.316655 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:04.300446 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.300820 15518 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:04.302632 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.172847 17442 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.278975 17445 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:04.282631 17387 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.312922 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:04.313519 15511 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.314567 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.321790 15518 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:04.345650 17236 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:04.322605 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:04.347098 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:04.326745 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.326943 15510 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:05:04.350054 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.359231 15515 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:04.361766 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.310715 17424 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.302951 17490 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:04.359443 17382 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.372133 17424 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:04.373209 17366 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.001s
I20260709 13:05:04.373788 17366 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.324470 17180 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.328341 15443 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:04.109169 17248 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.330330 17291 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:04.442287 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:04.444633 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 176654us
I20260709 13:05:04.443897 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.445502 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.439332 16181 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.445860 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.445508 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.446760 15517 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:04.441488 17467 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.914s	user 0.004s	sys 0.000s
I20260709 13:05:04.445510 15441 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 3: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:04.424944 17418 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.027s	sys 0.024s
I20260709 13:05:04.448021 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:04.448560 17418 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.028s	sys 0.024s
I20260709 13:05:04.449050 15439 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:04.449108 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.450726 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.442261 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:04.451318 15439 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:04.451442 15585 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:04.452865 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.453032 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:04.454066 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.455309 17424 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.455963 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.456192 15442 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:04.372222 17382 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.367985 17387 raft_consensus.cc:697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:05:04.393445 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.457376 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.457978 17387 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.459460 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:04.463066 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:04.442350 15589 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.464088 15591 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:04.467270 17422 consensus_meta.cc:287] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.977s	user 0.015s	sys 0.000s
I20260709 13:05:04.468950 17506 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:04.465025 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.463312 15509 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
W20260709 13:05:04.474354 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.497548 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.498728 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.499864 15435 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:05:04.315287 17496 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.502664 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:04.509241 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.503568 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.504616 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:04.505097 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:04.506815 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:04.511883 15591 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:04.499472 15439 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 1.
I20260709 13:05:04.512725 15583 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:04.512830 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:04.512759 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52899us
I20260709 13:05:04.524188 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.506677 17277 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:04.367408 17490 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:04.528515 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.529927 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.469915 17501 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.535193 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.554474 15585 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:04.536047 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.555902 15590 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:04.538650 17424 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:04.444940 17337 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.496305 17422 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:04.529529 17315 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:04.529793 17277 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.540170 17419 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.541002 17390 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.541795 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.543358 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.543916 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.582746 15443 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:04.545007 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.528774 16176 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.497936 17506 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:04.559264 15434 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:04.564520 17360 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:04.567641 17239 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:04.444190 17470 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.497303 17291 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.586503 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.579909 15436 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.529963 17490 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:04.576161 17315 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:04.591055 17506 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.603900 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.593855 17427 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:05:04.608548 17427 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:04.608948 17427 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:04.609241 17496 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:04.609877 17277 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:04.607581 17480 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.081s	user 0.002s	sys 0.005s
I20260709 13:05:04.568545 17238 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:05:04.611416 17315 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.562556 17501 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.616860 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.618511 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.619177 17501 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.620887 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:04.621666 15440 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:04.622072 15440 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:04.623697 17291 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.625803 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.626144 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.626842 15443 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:04.609930 17427 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.623082 15440 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.628269 17427 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:04.628872 15440 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:04.599921 17127 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:05:04.630110 17490 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.632395 15586 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:04.634784 17490 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:04.646271 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.648090 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:04.648526 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.650363 17360 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:04.650851 17360 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:04.651185 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.652154 15438 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:04.651810 17360 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:04.653332 17360 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:04.660501 17478 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 1.067s	user 0.000s	sys 0.006s
I20260709 13:05:04.663376 17484 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:04.669786 17450 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:04.670455 17450 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:04.671710 17450 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.672957 17450 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:04.678359 17504 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:05:04.685632 15514 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:04.687237 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:04.689719 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 76696.3us
I20260709 13:05:04.692258 15407 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.701023 16730 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:04.701785 16730 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:04.702050 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 189290us
W20260709 13:05:04.699872 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 168232us
I20260709 13:05:04.707405 15440 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:04.705193 16730 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.704129 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:04.719270 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 273862us
I20260709 13:05:04.720312 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.720345 15513 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:04.726137 15512 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:04.729522 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:04.733888 15512 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:04.735155 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:04.737692 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:04.742812 15512 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.748237 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.731828 17291 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:04.722301 17507 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:04.735432 17506 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:04.766103 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.747349 17127 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:05:04.731217 17484 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:05:04.751942 17445 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:04.755528 17483 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:04.767590 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:04.793403 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:04.769270 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.770241 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:04.737170 17391 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:05:04.797362 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:04.734939 17501 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:04.798413 15517 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:04.796307 15590 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:04.739667 17500 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:05:04.800946 15590 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:04.767252 17513 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:04.773592 17291 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:04.779548 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 247914us
I20260709 13:05:04.781169 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:04.784710 15587 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:04.788286 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:04.789575 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:04.790251 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:04.775486 17424 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:04.827242 15509 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:04.804971 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.829625 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.799889 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:04.833724 15512 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:04.834453 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:04.834901 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.837406 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:04.840924 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.845533 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:04.804821 17496 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:04.801194 17442 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:04.808881 17490 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:04.854962 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.855096 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.827661 17337 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:04.856699 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.809304 17513 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.858043 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:04.862088 15443 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:04.857475 15437 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:05:04.863088 15509 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:04.860517 15440 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:04.830991 17360 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:04.838830 17483 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:04.851410 17291 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.872068 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:04.866477 17513 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:04.801678 17315 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.841624 17424 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:04.896600 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 103296us
I20260709 13:05:04.905632 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:04.906980 15509 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:05:04.919342 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.889012 15512 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:04.868496 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:04.927781 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55938us
I20260709 13:05:04.853295 17003 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:04.853272 17442 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.857949 17496 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.880317 17408 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:04.853055 17445 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:04.883669 17515 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:05:04.960285 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54803.5us
I20260709 13:05:04.949111 15514 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:04.961881 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 96555.3us
I20260709 13:05:04.965186 17412 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:04.966097 17360 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:04.952157 17442 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:04.965848 17449 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:04.881022 17291 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.971007 17502 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:04.973099 17422 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:04.973659 17291 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:04.975622 15516 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:04.977295 17484 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.978507 17484 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.978259 17424 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.979907 17127 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:04.980566 17127 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:04.950551 17496 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:04.981552 17127 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:04.909476 17390 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:05:04.927120 17419 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:05:04.990728 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:04.984885 17526 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:04.994057 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.004009 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.009335 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:05.010627 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 148317us
I20260709 13:05:05.011310 15406 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.014720 15434 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:05.014914 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.017931 15440 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:05.022550 16182 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:05.023619 16179 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:04.967149 17360 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:05.060943 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 49747.4us
I20260709 13:05:05.061570 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:05.061892 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:05.015767 17516 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.063437 15406 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.067526 15434 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:05:04.994661 17526 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.087504 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1514) took 1554 ms. Trace:
W20260709 13:05:05.098115 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 186686us
I20260709 13:05:05.058605 17506 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:05.103276 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:05.062888 17418 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:05.104288 15588 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:05.099718 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:05.101022 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:05.107712 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:05.098603 15442 rpcz_store.cc:276] 0709 13:05:03.532965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.533176 (+   211us) service_pool.cc:224] Handling call
0709 13:05:03.533594 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.456806 (+923212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.087009 (+630203us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54000a4e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:05.087369 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121276288}
I20260709 13:05:05.111966 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:05.066018 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 51216.1us
I20260709 13:05:05.122710 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:05.123716 15590 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:05.112869 15588 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:05.074299 17484 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:05.142697 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.070991 17127 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.076416 17232 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:05.080756 17485 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:05.081305 17315 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:05.170162 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:05.171180 15510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34302 (request call id 191) took 2096 ms (client timeout 1636 ms). Trace:
I20260709 13:05:05.173373 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:05.174211 16179 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:05.101975 17502 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:05.173712 15510 rpcz_store.cc:269] 0709 13:05:03.054542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.055474 (+   932us) service_pool.cc:224] Handling call
0709 13:05:05.150882 (+2095408us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002a1554. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:05.151025 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2891369856}
I20260709 13:05:05.183204 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:05.058869 17527 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:05:05.190951 15438 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:05.193140 17484 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:05.064872 17399 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:05:05.081131 17238 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
W20260709 13:05:05.210155 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.207350 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:05.177809 17382 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:05.252517 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45316.7us
W20260709 13:05:05.272176 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 77175.4us
I20260709 13:05:05.255324 17500 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:05.289700 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 106661us
I20260709 13:05:05.292482 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.293005 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.293232 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.293908 15436 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:05.295166 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:05.297045 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:05.298187 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.165916 17418 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.354944 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:05.361156 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 61405.1us
I20260709 13:05:05.362500 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.341714 17315 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:05.323416 17291 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.368099 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.342274 17506 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:05.387171 17530 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:05.296559 17513 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.298344 17540 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:05.341686 17484 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.409667 15510 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:05.389984 17315 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:05.367246 17522 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:05:05.382239 17291 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:05.445487 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 273613us
W20260709 13:05:05.453083 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 153094us
I20260709 13:05:05.461139 17494 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:05.462105 17494 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.415083 17540 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.447309 17502 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:05.473816 17494 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:05.481267 17291 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:05.491711 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.495739 17549 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:05:05.520147 15518 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:05.506784 15437 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:05.508245 17249 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:05.521714 15437 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:05.526059 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:05.508549 17442 consensus_meta.cc:287] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.000s
I20260709 13:05:05.511202 17291 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.528643 17291 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.510283 17502 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.518349 15513 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:05.527617 15518 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:05.497341 17526 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:05.539749 15437 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.536072 17442 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.566892 17544 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:05:05.516255 17513 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:05.531273 17291 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:05.571067 15437 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:05.571440 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 203463us
I20260709 13:05:05.592917 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.550483 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:05.594045 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 43663.8us
I20260709 13:05:05.602061 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:05.604132 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.535791 17249 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.608273 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.621260 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.568651 17449 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:05:05.627719 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:05.628034 17518 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.851s	user 0.004s	sys 0.009s
I20260709 13:05:05.605935 17513 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:05.605316 17291 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:05.640463 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:05.633924 17450 consensus_meta.cc:287] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.960s	user 0.010s	sys 0.008s
I20260709 13:05:05.642980 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.626905 17526 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:05.647835 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:05:05.659644 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.629125 17522 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:05.648375 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:05.638797 17424 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:05.675453 17547 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.676105 17547 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:05.676256 17516 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.674602 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.650142 17530 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:05.676566 17291 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:05.649255 17539 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:05.692107 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.699955 17291 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.702872 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.705776 17526 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:05.722826 15592 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:05.721987 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 1505) took 1268 ms. Trace:
I20260709 13:05:05.646711 17506 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:05:05.717144 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:05.725795 15586 rpcz_store.cc:276] 0709 13:05:04.453707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.453826 (+   119us) service_pool.cc:224] Handling call
0709 13:05:05.721694 (+1267868us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54003da754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:05.721907 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408084224}
W20260709 13:05:05.733875 17496 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.008s
I20260709 13:05:05.734541 17496 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.730129 15518 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:05.721688 17442 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:05.676599 17547 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.676806 17516 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.748292 17249 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:05.714316 17424 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:05.748921 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1593) took 1025 ms. Trace:
I20260709 13:05:05.754171 15514 rpcz_store.cc:276] 0709 13:05:04.723836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.723968 (+   132us) service_pool.cc:224] Handling call
0709 13:05:04.724301 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.962822 (+238521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.748710 (+785888us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000eb354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:05.748866 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482794880}
I20260709 13:05:05.757472 17496 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:05.707401 17127 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.535s	user 0.003s	sys 0.008s
I20260709 13:05:05.684698 17539 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:05.722071 17532 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:05.765990 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 48938.7us
I20260709 13:05:05.772673 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:05.775496 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:05.776345 16181 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:05.782431 17526 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:05.778570 17232 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:05:05.791918 17232 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:05.793402 17232 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:05.793853 17232 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:05.760951 17424 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:05.797444 17238 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:05.798082 17238 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:05.797504 17424 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:05.778389 17513 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:05.778926 17539 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:05.795854 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:05.790716 17526 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.812644 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.819437 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.821069 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.821566 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:05.821949 15443 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:05.824221 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.799887 17506 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:05.826913 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:05.810307 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.811403 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.826718 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:05.817248 17526 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:05.828161 15440 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:05.829314 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.788285 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:05.831791 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 43612us
I20260709 13:05:05.819289 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:05.818930 17360 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:05.836854 17522 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:05.846897 17522 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.847349 17522 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:05.824424 17556 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:05.819585 17238 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.852509 17238 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.853610 17418 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:05.863312 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.829759 17506 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.865268 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:05.863765 17556 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.867244 17366 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:05.867887 17516 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:05.868109 17525 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.907s	user 0.004s	sys 0.007s
I20260709 13:05:05.830670 17232 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.840355 17360 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:05.871508 15514 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:05.872125 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:05.880046 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:05.892696 15437 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:05.893705 17553 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:05.893882 15440 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:05.883591 17513 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:05.902570 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.906260 17516 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:05.907866 17501 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.905043 17291 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:05.884585 17506 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:05.915617 17291 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.916101 17291 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:05.912824 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:05.920882 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:05.922241 15436 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:05.922665 15440 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:05.921499 17442 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:05.926107 17442 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:05.926527 17442 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.930442 15509 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:05.933163 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.908476 17232 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:05.935566 17516 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:05.940935 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:05.914898 17553 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:05.923269 15437 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:05.945359 17513 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:05.948491 17506 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:05.903324 17539 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.955372 17382 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:05:05.961100 17556 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:05.954306 17530 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.969120 15439 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:05.971724 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.974484 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:05.974810 15435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 158) took 1689 ms (client timeout 1636 ms). Trace:
I20260709 13:05:05.975957 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:05.975253 15435 rpcz_store.cc:269] 0709 13:05:04.279856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.279989 (+   133us) service_pool.cc:224] Handling call
0709 13:05:05.968552 (+1688563us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54002d0854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:05.968718 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419371904}
I20260709 13:05:05.967806 17506 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:05.985589 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:05.970137 17530 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.003952 17424 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:05.986076 17532 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:06.015455 17360 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:06.005234 17382 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:05.993136 17513 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:05.961465 17553 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.027689 17506 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.028469 17553 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:06.013432 17558 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:05:06.036334 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 210) took 1023 ms. Trace:
I20260709 13:05:06.036871 15512 rpcz_store.cc:276] 0709 13:05:05.012768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.013298 (+   530us) service_pool.cc:224] Handling call
0709 13:05:05.013677 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:05.172460 (+158783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.172492 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:05.178999 (+  6507us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.364971 (+185972us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:05.365018 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.035830 (+670812us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400369cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:06.035886 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.035949 (+    63us) raft_consensus.cc:1685] finished
0709 13:05:06.035962 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.036256 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5205,"raft.queue_time_us":7583,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":9869,"spinlock_wait_cycles":351792896,"thread_start_us":121374,"threads_started":1,"wal-append.queue_time_us":146215}
W20260709 13:05:06.075395 17562 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:05:06.089254 16176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 371) took 1295 ms. Trace:
I20260709 13:05:06.096185 15434 raft_consensus.cc:2410] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:06.098275 17424 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.099203 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1526) took 1097 ms. Trace:
I20260709 13:05:06.100517 15438 rpcz_store.cc:276] 0709 13:05:05.001716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.002689 (+   973us) service_pool.cc:224] Handling call
0709 13:05:05.002995 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.191820 (+188825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.098938 (+907118us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54003a7354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:06.099138 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431657856}
I20260709 13:05:06.103816 17530 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.104858 17540 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.109146 17315 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:06.109709 17315 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:06.089888 16176 rpcz_store.cc:276] 0709 13:05:04.794052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.795740 (+  1688us) service_pool.cc:224] Handling call
0709 13:05:04.804200 (+  8460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:04.861402 (+ 57202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.866376 (+  4974us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:04.871030 (+  4654us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.867728 (+996698us) spinlock_profiling.cc:243] Waited 976 us on lock 0x7b24003266a8. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78af09c4 00007fcf78aeeacb 00007fcf78ca9dc9 00007fcf78ca9a55 00007fcf78ca909d 00007fcf7b8db10e 00007fcf7b8f288c 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221
0709 13:05:06.006479 (+138751us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b1800310720. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1
0709 13:05:06.010106 (+  3627us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:06.058625 (+ 48519us) log.cc:844] Serialized 14 byte log entry
0709 13:05:06.066154 (+  7529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.083445 (+ 17291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.086101 (+  2656us) raft_consensus.cc:1685] finished
0709 13:05:06.086119 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.089163 (+  3044us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59094,"prepare.queue_time_us":55500,"raft.queue_time_us":25668,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":14315,"spinlock_wait_cycles":45038720,"thread_start_us":138034,"threads_started":2,"wal-append.queue_time_us":89295}
I20260709 13:05:06.112540 17442 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.115128 17442 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:06.120419 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:06.070587 17291 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.110781 17315 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:06.129233 17409 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:05:06.132880 17526 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.142789 15510 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:06.124208 17539 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.139492 17501 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:06.166314 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1667) took 1660 ms. Trace:
I20260709 13:05:06.166916 15592 rpcz_store.cc:276] 0709 13:05:04.505659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.505837 (+   178us) service_pool.cc:224] Handling call
0709 13:05:05.722541 (+1216704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.729851 (+  7310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.165897 (+436046us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003da750. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:06.166212 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741284096}
I20260709 13:05:06.173475 17291 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:06.175740 17538 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:05:06.198387 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:06.145630 17547 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.216373 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:06.217301 16179 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:06.225651 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:06.226991 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.237527 17544 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:06.238332 17544 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.238857 17258 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:06.239641 17258 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.236461 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:06.251829 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:06.261914 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.270792 17565 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:05:06.268800 17526 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.207270 17522 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.281443 16179 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:06.286355 15438 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:06.284981 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:06.291503 17526 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:06.292212 17526 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:06.291354 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:06.293283 15438 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:06.293165 17526 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.298516 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1605) took 1460 ms. Trace:
I20260709 13:05:06.299057 15516 rpcz_store.cc:276] 0709 13:05:04.837907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.839258 (+  1351us) service_pool.cc:224] Handling call
0709 13:05:04.857776 (+ 18518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.976198 (+118422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.298162 (+1321964us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400294854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:06.298407 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270418816}
W20260709 13:05:06.304111 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.305729 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 1.4372e+06us
I20260709 13:05:06.320300 15586 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:06.326889 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.327217 15586 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.330746 15586 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:06.332159 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:06.322068 17548 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:06.341509 15586 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.324402 17382 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:06.330924 17539 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.357869 17538 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:06.358517 17538 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.355302 15586 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.329661 17444 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:06.356323 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:06.368537 15588 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:05:06.364007 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:06.348716 17516 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:06.367122 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.399176 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.403628 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:06.405716 15588 raft_consensus.cc:3055] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.406239 15588 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:06.337815 17500 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:05:06.413554 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.366454 17538 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:06.400626 17522 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:06.368664 17539 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.407274 15588 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.369848 17341 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.398103 17516 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.459097 16146 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:06.354976 17548 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.452024 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:06.490661 15586 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:06.504423 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1591) took 1787 ms. Trace:
I20260709 13:05:06.505091 15517 rpcz_store.cc:276] 0709 13:05:04.717426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.717992 (+   566us) service_pool.cc:224] Handling call
0709 13:05:04.718312 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.798847 (+ 80535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.503902 (+1705055us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b5400295254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:06.504301 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183637248}
I20260709 13:05:06.477778 17516 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:06.399854 17444 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.454373 17387 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:05:06.484820 17522 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:06.479584 17341 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.533789 17248 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:06.502771 17544 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:06.537834 17550 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.866s	user 0.006s	sys 0.000s
I20260709 13:05:06.515974 17574 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:06.544850 17248 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:06.570578 15510 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:06.578011 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:06.578863 15512 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 1.
I20260709 13:05:06.584487 17544 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:06.585193 17544 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.581655 17484 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.586207 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:06.586858 15511 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:06.581997 17248 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.586417 17484 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.588620 17548 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.589763 17539 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.590390 17484 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:06.571663 17574 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.591935 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:06.592679 15516 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:06.593294 15509 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:06.593528 17574 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:06.593923 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:06.596802 15510 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:05:06.598235 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:06.600384 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1681) took 1584 ms. Trace:
I20260709 13:05:06.602213 15511 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:06.534911 17522 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.613757 17539 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:06.617065 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:06.626523 17427 consensus_queue.cc:1059] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:06.627806 17531 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:06.601150 15589 rpcz_store.cc:276] 0709 13:05:05.015666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.016433 (+   767us) service_pool.cc:224] Handling call
0709 13:05:05.022328 (+  5895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.308874 (+1286546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.308915 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.309879 (+   964us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.525799 (+215920us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:06.525844 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.525935 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.600165 (+ 74230us) raft_consensus.cc:1685] finished
0709 13:05:06.600187 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.600315 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1286045,"raft.queue_time_us":1290429,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":170759,"threads_started":1,"wal-append.queue_time_us":228561}
I20260709 13:05:06.596894 17544 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.610599 17574 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:06.647339 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 188382us
I20260709 13:05:06.630945 17484 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:06.643739 17432 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:06.681418 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:06.659426 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:06.670203 17249 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:06.704417 17579 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:05:06.669817 17439 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:05:06.711257 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1683) took 1594 ms. Trace:
I20260709 13:05:06.711720 15587 rpcz_store.cc:276] 0709 13:05:05.116537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.116757 (+   220us) service_pool.cc:224] Handling call
0709 13:05:05.117294 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.313699 (+1196405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.313733 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.314238 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.506740 (+192502us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:06.506813 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.506937 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.710995 (+204058us) raft_consensus.cc:1685] finished
0709 13:05:06.711027 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.711188 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1195860,"raft.queue_time_us":1204904,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6675,"thread_start_us":192012,"threads_started":1,"wal-append.queue_time_us":223099}
I20260709 13:05:06.656466 17574 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.691252 17588 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:06.666739 17484 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.690573 17544 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:06.719151 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.720552 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.736857 17544 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:06.738529 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 1.728e+06us
I20260709 13:05:06.738668 17493 consensus_queue.cc:1059] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:06.707633 17249 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.742499 17249 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.725150 17444 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:06.744647 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 436910us
I20260709 13:05:06.746694 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:06.747738 17408 consensus_queue.cc:1059] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:06.748936 17408 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.750969 17408 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:06.752004 17236 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:06.752635 17236 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:06.753639 17236 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.756064 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1479) took 2214 ms. Trace:
I20260709 13:05:06.756521 15439 rpcz_store.cc:276] 0709 13:05:04.541722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.541934 (+   212us) service_pool.cc:224] Handling call
0709 13:05:05.968915 (+1426981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.969699 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.755679 (+785980us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54002d0850. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:06.755901 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3280653184}
I20260709 13:05:06.758313 17341 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:06.758836 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.758962 17341 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:06.759816 17450 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:06.760357 17450 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.761125 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:06.762789 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:06.762890 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:06.764118 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:06.764405 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:06.764825 15590 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:06.765204 15586 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:06.766518 17469 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.767724 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:06.758385 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1677) took 1964 ms. Trace:
I20260709 13:05:06.769538 15591 rpcz_store.cc:276] 0709 13:05:04.793897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.794609 (+   712us) service_pool.cc:224] Handling call
0709 13:05:04.795003 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:04.795410 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.795441 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:05.482968 (+687527us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b2c00033248. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:05:05.483494 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.600868 (+117374us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:05.722475 (+121607us) log.cc:844] Serialized 14 byte log entry
0709 13:05:06.757941 (+1035466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.758047 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.758095 (+    48us) raft_consensus.cc:1685] finished
0709 13:05:06.758191 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.758324 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1035783,"prepare.queue_time_us":201669,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":916,"raft.queue_time_us":1028602,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":18935,"spinlock_wait_cycles":3026304,"thread_start_us":211628,"threads_started":2,"wal-append.queue_time_us":197550}
I20260709 13:05:06.767032 17469 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.772147 17445 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:06.772744 17445 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.774083 17469 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:06.774868 17445 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:06.775012 17469 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:06.775964 17592 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:06.777135 17449 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.777578 17574 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.777791 17592 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:06.778177 17592 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:06.779901 17003 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:06.781333 17522 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:06.782692 17577 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.420s	user 0.003s	sys 0.000s
I20260709 13:05:06.715848 17588 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:05:06.776310 17580 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.281s	user 0.001s	sys 0.002s
I20260709 13:05:06.784003 17588 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.785182 17588 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.786388 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1684) took 1663 ms. Trace:
I20260709 13:05:06.786831 15585 rpcz_store.cc:276] 0709 13:05:05.123177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.123352 (+   175us) service_pool.cc:224] Handling call
0709 13:05:05.123773 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.314930 (+1191157us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:06.314973 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.315478 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.366774 (+ 51296us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:06.366814 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.366884 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.775496 (+408612us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:06.786037 (+ 10541us) raft_consensus.cc:1685] finished
0709 13:05:06.786062 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.786315 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1190602,"raft.queue_time_us":1198527,"spinlock_wait_cycles":18361984,"thread_start_us":50945,"threads_started":1,"wal-append.queue_time_us":179582}
I20260709 13:05:06.789024 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:06.789726 15585 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:06.795089 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:06.796521 15591 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:06.800030 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 122919us
W20260709 13:05:06.805635 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.812788 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:06.716806 15511 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:06.822132 15586 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:06.779091 17592 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:06.800619 17544 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.759502 17341 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.945400 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:06.813846 17469 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:06.947314 17258 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:06.948820 15590 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:06.948426 17439 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:05:06.945276 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 198725us
W20260709 13:05:06.955428 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 147980us
I20260709 13:05:06.909652 17544 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:06.955112 15591 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:06.964900 15586 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:06.948994 17258 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:06.945848 17236 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.957396 17592 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.974988 15512 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:06.951274 17469 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:06.987962 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.953790 17484 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:06.965385 17481 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.962970 17544 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:06.973695 17258 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:06.993697 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:06.973033 17450 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:06.997382 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:07.002888 17258 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.008459 17598 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:07.009156 17598 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.009881 17547 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:07.012657 17582 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
I20260709 13:05:07.014158 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1686) took 1854 ms. Trace:
I20260709 13:05:07.014591 15583 rpcz_store.cc:276] 0709 13:05:05.159820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.161472 (+  1652us) service_pool.cc:224] Handling call
0709 13:05:05.161940 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.316353 (+1154413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.316390 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.324285 (+  7895us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.516169 (+191884us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:06.516226 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.516315 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.011943 (+495628us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:07.013807 (+  1864us) raft_consensus.cc:1685] finished
0709 13:05:07.013830 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.014085 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1558304,"raft.queue_time_us":1170768,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":11625,"spinlock_wait_cycles":48875904,"thread_start_us":179312,"threads_started":1,"wal-append.queue_time_us":273262}
I20260709 13:05:07.005661 17483 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:06.986218 17492 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:05:07.001240 17481 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.020452 17492 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:07.021111 17492 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:07.021960 17492 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.023236 17492 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.019726 17483 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:07.021996 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1632) took 1136 ms. Trace:
I20260709 13:05:07.022449 17481 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:07.027278 15518 rpcz_store.cc:276] 0709 13:05:05.885887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.886079 (+   192us) service_pool.cc:224] Handling call
0709 13:05:05.886513 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:05.896489 (+  9976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.896523 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:05.901379 (+  4856us) log.cc:844] Serialized 52 byte log entry
0709 13:05:06.044808 (+143429us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:07.021107 (+976299us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b180033af00. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7f74f3c7 00007fcf7bd619a7 00007fcf7bd710bf
0709 13:05:07.021275 (+   168us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.021531 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.021611 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.021654 (+    43us) raft_consensus.cc:1685] finished
0709 13:05:07.021758 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.021931 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7381,"prepare.queue_time_us":30041,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":15522,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3387,"spinlock_wait_cycles":4466944,"thread_start_us":222294,"threads_started":2,"wal-append.queue_time_us":242705}
I20260709 13:05:06.982659 17516 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:07.035820 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:07.028688 17419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.002s	sys 0.002s
I20260709 13:05:07.029428 17483 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:07.036435 17268 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:07.039430 17483 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:07.041800 17576 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.749s	user 0.005s	sys 0.003s
I20260709 13:05:07.045558 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:07.044255 17456 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:07.046484 17444 raft_consensus.cc:2764] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:05:07.042701 17419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.002s	sys 0.003s
I20260709 13:05:07.051334 17341 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:07.056186 17258 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:07.058096 17581 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.563s	user 0.002s	sys 0.000s
I20260709 13:05:07.058876 17258 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.059675 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1682) took 2043 ms. Trace:
I20260709 13:05:07.060103 15584 rpcz_store.cc:276] 0709 13:05:05.016231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.016536 (+   305us) service_pool.cc:224] Handling call
0709 13:05:05.016893 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.310110 (+1293217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.310144 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.310662 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.366030 (+ 55368us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:06.366073 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.366960 (+   887us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.057421 (+690461us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:07.059252 (+  1831us) raft_consensus.cc:1685] finished
0709 13:05:07.059274 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.059595 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1291306,"raft.queue_time_us":1295617,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":9472768,"thread_start_us":41490,"threads_started":1,"wal-append.queue_time_us":183683}
I20260709 13:05:07.042865 17481 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 13:05:07.084995 17578 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.588s	user 0.003s	sys 0.000s
W20260709 13:05:07.024802 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 207026us
I20260709 13:05:07.131696 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:07.135900 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:07.150089 17604 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:05:07.152529 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.157586 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:07.159324 15512 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:07.173900 17238 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:07.037889 17544 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.177619 17586 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.179220 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:07.174950 17419 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:05:07.192268 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35752 (request call id 0) took 5704 ms. Trace:
I20260709 13:05:07.194247 17419 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.074322 17483 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:07.188460 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:07.191679 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:07.193064 17439 rpcz_store.cc:276] 0709 13:05:01.487917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.488161 (+   244us) service_pool.cc:224] Handling call
0709 13:05:03.039197 (+1551036us) spinlock_profiling.cc:243] Waited 9.25 ms on lock 0x7b5400730b20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd4520 00007fcf7bd5db42 00007fcf7bd5c800 00007fcf7bd559fa 00007fcf80d1d4c9 00007fcf7a299c54 00007fcf7a299be2 00007fcf7a299b11 00007fcf7a299a8c 00007fcf7a298d42
0709 13:05:03.072973 (+ 33776us) log.cc:844] Serialized 501 byte log entry
0709 13:05:03.734457 (+661484us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b18003807a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78be4c0a 00007fcf82324219 00007fcf78c6ca40 00007fcf78c674e4 00007fcf78c67455 00007fcf7bcb0b0b 00007fcf7bd35b63 00007fcf7bd5d752 00007fcf7bd559fa
0709 13:05:04.440679 (+706222us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:05.388829 (+948150us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b5400730b20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcccdbe 00007fcf7bcd7930 00007fcf7bcd78d8 00007fcf7bcd7858 00007fcf7bcd7813 00007fcf7bcd6a9c 00007fcf81bc2626 00007fcf81bbcdd8 00007fcf7bd137cb 00007fcf7bd162c0
0709 13:05:07.191813 (+1802984us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250417,"raft.queue_time_us":306610,"raft.run_cpu_time_us":2116,"raft.run_wall_time_us":52544,"spinlock_wait_cycles":1636552448,"thread_start_us":357421,"threads_started":1,"wal-append.queue_time_us":454386,"wal-append.run_cpu_time_us":26215,"wal-append.run_wall_time_us":2893131}
I20260709 13:05:07.198076 17494 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.202533 15512 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:07.203701 15517 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:07.199120 17418 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:07.219189 17418 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:07.205106 17603 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:05:07.206492 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:07.209337 15510 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:07.211671 17531 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.212025 17449 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:07.212440 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.226384 17531 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.233500 17516 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.235941 15588 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.240939 17418 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:07.243127 17449 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:07.252966 17595 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.256045 15511 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:07.224941 17419 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.261053 17232 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:07.262164 17232 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.262254 17449 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.259809 15515 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:07.268499 17513 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:07.275911 17586 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:07.280279 17419 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.256045 17599 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:07.281612 17599 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.286490 17544 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.270329 17513 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.312355 17419 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.313580 17419 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.321043 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:07.321790 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.322484 15438 raft_consensus.cc:2410] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:07.323844 17485 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.324921 17485 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:07.325632 17337 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.326668 17337 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.328332 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:07.328938 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:07.329933 15443 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.331146 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:07.333300 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:07.334422 15438 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.334955 17531 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.331121 17485 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:07.333675 17419 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.321848 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:07.256536 17595 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.342391 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.343899 15435 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
W20260709 13:05:07.345997 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.351958 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.353135 15440 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 1.
I20260709 13:05:07.358048 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:07.359434 15441 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:07.360241 15438 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
W20260709 13:05:07.360391 17248 consensus_meta.cc:287] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.772s	user 0.016s	sys 0.002s
I20260709 13:05:07.361766 17248 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:07.342465 15439 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.363662 17586 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:04.976863 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:07.292482 17494 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:07.372375 17248 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.373652 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 952f15e68b0745e5a8ca26a3b527cab0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:05:07.373227 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:07.375650 15341 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 3, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.377079 17494 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:07.378242 17315 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:07.382225 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:07.382645 15511 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:07.384560 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:07.399518 15443 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:07.401132 15518 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.402179 17232 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.403518 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:07.404752 15512 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:07.406446 17493 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:07.406569 17268 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:05:07.407639 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 341920us
W20260709 13:05:07.384582 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 338847us
I20260709 13:05:07.411770 17456 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:07.412375 17456 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:07.412938 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.413666 17456 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.415822 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.418573 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:07.418817 17598 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.420130 17337 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.415961 15518 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:05:07.366688 17595 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.415390 17456 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:07.444584 17513 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.372475 17539 raft_consensus.cc:3055] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:07.447919 17599 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:07.450790 17588 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.011s
I20260709 13:05:07.491773 15437 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:07.451066 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:07.476154 17539 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:07.455945 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 91406.5us
I20260709 13:05:07.509778 17513 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:07.511132 17513 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:07.516007 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65159.2us
W20260709 13:05:07.519601 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.529874 16175 raft_consensus.cc:1240] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:07.532008 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:07.532439 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.533605 17382 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.534271 17382 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.534828 16182 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:07.531890 15588 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:07.536257 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 164) took 1163 ms. Trace:
I20260709 13:05:07.536602 15588 rpcz_store.cc:276] 0709 13:05:06.372437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.405123 (+ 32686us) service_pool.cc:224] Handling call
0709 13:05:06.405545 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.744084 (+338539us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b58001a5dd0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd4dfe7 00007fcf7bd4f7de 00007fcf7bd59b49 00007fcf7bd5a416 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4
0709 13:05:07.232138 (+488054us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b58006effd0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd4dfe7 00007fcf7bd4f7de 00007fcf7bd59b49 00007fcf7bd5a416 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4
0709 13:05:07.535948 (+303810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.536173 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737379584}
I20260709 13:05:07.540072 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:07.576429 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:07.578164 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 46958.9us
I20260709 13:05:07.579954 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.603323 17315 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:07.604168 17526 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:07.605185 17526 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:07.607105 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.520637 17588 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:07.682257 17611 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 13:05:07.672745 17539 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:07.685325 15482 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.572s (SENT) [suppressed 14 similar messages]
I20260709 13:05:07.687309 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:07.688581 16179 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:07.703903 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.712381 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:07.718361 15437 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:07.581780 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:07.673655 17588 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.723042 17588 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:07.732206 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.604249 17315 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:07.790390 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 115483us
I20260709 13:05:07.801568 15441 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:07.810124 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:07.819152 15439 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:07.822132 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.823316 15441 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:07.823915 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.837209 17248 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:07.837862 17248 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:07.838274 17248 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:07.840378 17612 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.361s	user 0.000s	sys 0.002s
W20260709 13:05:07.841274 17483 consensus_meta.cc:287] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.005s
I20260709 13:05:07.836722 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:07.836589 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 216414us
I20260709 13:05:07.869042 15437 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:07.812870 17539 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.875420 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.888057 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.889253 15439 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:07.878386 15556 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:07.883049 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:07.903892 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.835661 16176 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.917330 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:07.942001 17492 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.880s	user 0.015s	sys 0.001s
I20260709 13:05:07.946074 17481 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.946892 17481 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:07.947911 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:07.949700 17481 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:07.936632 17419 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.964099 17419 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:07.964955 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 591550us
I20260709 13:05:07.966990 17419 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.971907 17513 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.972769 17513 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.973434 17513 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.982370 17315 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:07.983153 17315 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:07.983794 17315 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:07.899622 17526 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:08.016062 17387 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:08.017558 17481 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:08.039319 17513 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:08.143612 17612 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:05:08.254285 17608 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
W20260709 13:05:09.643344 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7ac0 after lost signal to thread 14296
W20260709 13:05:09.728754 16176 consensus_meta.cc:287] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 1.773s	user 0.024s	sys 0.001s
I20260709 13:05:09.729338 16176 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
W20260709 13:05:09.730235 16176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52910 (request call id 335) took 2275 ms (client timeout 1670 ms). Trace:
W20260709 13:05:09.730751 16176 rpcz_store.cc:269] 0709 13:05:07.454514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.491829 (+ 37315us) service_pool.cc:224] Handling call
0709 13:05:09.730092 (+2238263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:09.777278 17315 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:10.866075 15482 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 3.179s	user 0.046s	sys 0.123s
W20260709 13:05:10.867416 15482 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 3.181s	user 0.047s	sys 0.124s
W20260709 13:05:10.867899 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 3.18234e+06us
I20260709 13:05:10.870123 15443 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
W20260709 13:05:10.870970 15443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1539) took 3263 ms (client timeout 2039 ms). Trace:
W20260709 13:05:10.871424 15443 rpcz_store.cc:269] 0709 13:05:07.607717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.808964 (+201247us) service_pool.cc:224] Handling call
0709 13:05:10.870851 (+3061887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:10.881803 17621 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:10.883139 17621 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:10.886816 17621 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:10.887801 17622 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:10.888803 17622 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:10.889415 17621 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:10.891849 17622 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:10.891988 15482 connection.cc:256] RPC call timeout handler was delayed by -2.9693684180000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 13:05:10.892700 15482 connection.cc:256] RPC call timeout handler was delayed by -2.9693684180000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 13:05:10.892688 17622 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:10.893404 15482 connection.cc:256] RPC call timeout handler was delayed by -2.90261610999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.244s for a response
W20260709 13:05:10.894016 15482 connection.cc:256] RPC call timeout handler was delayed by -2.8270161099999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2524s for a response
I20260709 13:05:10.893678 17622 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:10.894445 15482 connection.cc:256] RPC call timeout handler was delayed by -2.804416649000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 13:05:10.895431 15482 connection.cc:256] RPC call timeout handler was delayed by -2.7905485190000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 13:05:10.897238 17622 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:10.898258 17622 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:10.899420 17622 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:10.902896 17622 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:10.903790 17622 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.904917 17622 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:10.907173 15482 connection.cc:256] RPC call timeout handler was delayed by -2.7280161099999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2634s for a response
W20260709 13:05:10.908914 17588 consensus_meta.cc:287] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 3.185s	user 0.017s	sys 0.020s
I20260709 13:05:10.909439 17588 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:10.910363 17622 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:10.911242 17622 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:10.912637 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 3.02548e+06us
I20260709 13:05:10.912084 17622 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:10.907295 17623 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:10.916643 17623 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:10.917137 17588 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:10.920572 17623 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:10.890348 17621 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:10.936229 17623 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:10.937219 17625 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:10.938153 17625 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:10.938166 17626 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.938715 17621 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:10.940834 17626 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:10.941425 15406 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:10.944531 15482 connection.cc:256] RPC call timeout handler was delayed by -2.408542680000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:05:10.945361 15482 connection.cc:256] RPC call timeout handler was delayed by -2.408542680000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:05:10.945726 15482 connection.cc:256] RPC call timeout handler was delayed by -2.3545426800000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 13:05:10.945853 17625 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:10.946170 15482 connection.cc:256] RPC call timeout handler was delayed by -2.3545426800000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 13:05:10.946504 15482 connection.cc:256] RPC call timeout handler was delayed by -2.3356161099999326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.307s for a response
I20260709 13:05:10.946857 17625 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:10.946990 15482 connection.cc:256] RPC call timeout handler was delayed by -2.312242680000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:05:10.947453 15482 connection.cc:256] RPC call timeout handler was delayed by -2.312242680000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:05:10.947959 15482 connection.cc:256] RPC call timeout handler was delayed by -2.312242680000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:05:10.948267 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2852426800000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:05:10.948544 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2852426800000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:05:10.949609 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9702426800000694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 13:05:10.950017 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9702426800000694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 13:05:10.950817 17624 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.937222 17623 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:10.951464 17624 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:10.953173 17623 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:10.949955 17626 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:10.954603 17624 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:10.950505 15482 connection.cc:256] RPC call timeout handler was delayed by -1.6176856770000541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 13:05:10.955272 17626 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:10.955610 15482 connection.cc:256] RPC call timeout handler was delayed by -1.6169207780000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 13:05:10.956027 17626 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:10.957625 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:10.947422 17625 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.959573 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 186) took 3593 ms. Trace:
I20260709 13:05:10.959982 17625 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:10.961144 17621 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:10.960214 15436 rpcz_store.cc:276] 0709 13:05:07.350121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.354067 (+  3946us) service_pool.cc:224] Handling call
0709 13:05:07.354606 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:07.368334 (+ 13728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.368386 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:07.370700 (+  2314us) log.cc:844] Serialized 26 byte log entry
0709 13:05:07.513077 (+142377us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:07.513124 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.513196 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:10.943106 (+3429910us) raft_consensus.cc:1685] finished
0709 13:05:10.943135 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.943358 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26258,"raft.queue_time_us":14496,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":53388,"thread_start_us":141704,"threads_started":1,"wal-append.queue_time_us":362563,"wal-append.run_cpu_time_us":6176,"wal-append.run_wall_time_us":1524178}
I20260709 13:05:10.961886 17621 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:10.962297 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 169) took 3637 ms. Trace:
I20260709 13:05:10.963598 17621 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:10.962726 15592 rpcz_store.cc:276] 0709 13:05:07.324519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.332753 (+  8234us) service_pool.cc:224] Handling call
0709 13:05:07.333337 (+   584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:07.419872 (+ 86535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.419914 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:07.420801 (+   887us) log.cc:844] Serialized 26 byte log entry
0709 13:05:07.478518 (+ 57717us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:07.479042 (+   524us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.479657 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.479738 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:10.961837 (+3482099us) raft_consensus.cc:1685] finished
0709 13:05:10.961858 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.962017 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85730,"prepare.queue_time_us":308,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":59,"raft.queue_time_us":101243,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":494,"thread_start_us":56996,"threads_started":1,"wal-append.queue_time_us":57522,"wal-append.run_cpu_time_us":8790,"wal-append.run_wall_time_us":1705726}
I20260709 13:05:10.964071 17622 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:10.968009 15338 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 201) took 12052 ms (client timeout 15000 ms). Trace:
I20260709 13:05:10.967988 17624 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:10.978770 17626 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:10.968770 15338 rpcz_store.cc:269] 0709 13:04:58.915072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.915225 (+   153us) service_pool.cc:224] Handling call
0709 13:05:10.967310 (+12052085us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:01.261473 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:01.262140 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:01.262186 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:05:01.262204 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:01.263217 (+  1013us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:01.263278 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:01.263305 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:05:01.264020 (+   715us) tablet.cc:701] Row locks acquired
0709 13:05:01.264040 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:05:01.264228 (+   188us) write_op.cc:270] Start()
0709 13:05:01.282510 (+ 18282us) write_op.cc:276] Timestamp: P: 1783602301264164 usec, L: 0
0709 13:05:01.282548 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:05:01.454032 (+171484us) log.cc:844] Serialized 2866 byte log entry
0709 13:05:02.076332 (+622300us) op_driver.cc:464] REPLICATION: finished
0709 13:05:02.358554 (+282222us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd52e28 00007fcf7f78d581 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d 000000000038f354 000000000038f199
0709 13:05:02.470046 (+111492us) write_op.cc:301] APPLY: starting
0709 13:05:02.478810 (+  8764us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:02.494703 (+ 15893us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:02.494731 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:02.501006 (+  6275us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:02.501286 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:05:02.501343 (+    57us) write_op.cc:312] APPLY: finished
0709 13:05:02.501684 (+   341us) log.cc:844] Serialized 59 byte log entry
0709 13:05:02.501943 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:02.502102 (+   159us) write_op.cc:454] Released schema lock
0709 13:05:02.502163 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:02.938878 (+436715us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b1800176080. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7f78def0 00007fcf7f78e489 00007fcf7f79071a
Metrics: {"mutex_wait_us":140209,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":302014,"apply.run_cpu_time_us":3865,"apply.run_wall_time_us":49506,"num_ops":7,"prepare.queue_time_us":80480,"prepare.run_cpu_time_us":14418,"prepare.run_wall_time_us":1097437,"replication_time_us":755017,"spinlock_wait_cycles":79379712,"thread_start_us":160203,"threads_started":1}]]}
I20260709 13:05:10.979844 17626 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:10.980331 17626 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:10.980816 17626 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:10.992029 17626 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:10.994711 17626 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:10.999338 15440 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1544) took 3058 ms (client timeout 2152 ms). Trace:
W20260709 13:05:10.999948 15440 rpcz_store.cc:269] 0709 13:05:10.998798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.999052 (+   254us) service_pool.cc:211] Skipping call since client already timed out
0709 13:05:10.999236 (+   184us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:05:11.000425 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65203us
W20260709 13:05:11.001816 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.001478 17626 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.004015 15443 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:11.010536 17626 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.010762 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:11.015460 17627 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:11.011896 17625 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.016002 17627 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:11.016489 17627 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:11.016647 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 3.17144e+06us
I20260709 13:05:11.018046 17626 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.020514 17625 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.021724 17588 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:11.025772 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:11.027355 17623 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:11.028394 17588 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:11.028746 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.029186 17588 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.030141 17623 consensus_queue.cc:1059] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:11.023068 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 3.1992e+06us
I20260709 13:05:11.031800 17623 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:11.032858 17623 raft_consensus.cc:697] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:11.033610 17292 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.034282 17292 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.035226 15443 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:11.035524 17592 consensus_meta.cc:287] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.036s	user 0.021s	sys 0.000s
I20260709 13:05:11.031839 17588 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:11.034085 17623 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.047365 15440 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:11.054759 15484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.139s	user 0.025s	sys 0.022s
I20260709 13:05:11.055796 17592 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:11.056905 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:11.073813 17292 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:11.061633 17513 raft_consensus.cc:3055] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:11.047467 15443 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:11.074324 17592 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.058815 16175 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:05:11.076567 15484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.168s	user 0.027s	sys 0.024s
W20260709 13:05:11.078702 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.027187 16146 connection.cc:256] RPC call timeout handler was delayed by -1.8633400929999198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 13:05:11.084542 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.087759 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.088236 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:11.090468 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 249) took 3264 ms. Trace:
I20260709 13:05:11.090864 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:11.090961 15515 rpcz_store.cc:276] 0709 13:05:07.825682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.825888 (+   206us) service_pool.cc:224] Handling call
0709 13:05:07.925690 (+ 99802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:11.090003 (+3164313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.090034 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:11.090117 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:11.090163 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.090248 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.090380 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:11.092931 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:11.093760 15592 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.095749 17592 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:11.097363 17592 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.079183 17513 raft_consensus.cc:740] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:11.100628 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:11.100720 17513 consensus_queue.cc:260] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.106650 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.114545 15592 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:05:11.120167 17513 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.121053 17548 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.122045 17548 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.127760 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:11.128695 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:11.130613 15591 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:11.130916 17409 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.130992 15406 connection.cc:256] RPC call timeout handler was delayed by -1.9904044109999859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:05:11.131006 17626 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:11.133385 17409 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.133839 17626 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.134742 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:11.135987 17409 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:11.136211 17626 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:11.136654 17409 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:11.137342 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:11.137282 17409 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.126909 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.139312 17588 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:11.139871 17625 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.140125 17588 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:11.140743 17625 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.141407 17588 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:11.131875 15406 connection.cc:256] RPC call timeout handler was delayed by -1.9076044110000794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:05:11.143633 16148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.152s	user 0.066s	sys 0.056s
I20260709 13:05:11.136006 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:11.144047 15406 connection.cc:256] RPC call timeout handler was delayed by -1.7897044110000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:05:11.144495 15406 connection.cc:256] RPC call timeout handler was delayed by -1.77350441100009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:05:11.144805 15406 connection.cc:256] RPC call timeout handler was delayed by -1.7429044110000405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 13:05:11.145149 15406 connection.cc:256] RPC call timeout handler was delayed by -1.72400441100001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:05:11.145843 15406 connection.cc:256] RPC call timeout handler was delayed by -1.6736044110000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:05:11.146728 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:11.147501 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 121903us
I20260709 13:05:11.075204 17292 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:05:11.152951 17382 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.153972 17382 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:11.154721 17292 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:11.154632 17382 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.140045 15583 raft_consensus.cc:1813] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Handling vote request from an unknown peer 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:11.143267 17625 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.156059 15583 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:05:11.146872 15406 connection.cc:256] RPC call timeout handler was delayed by -1.5872044110000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 13:05:11.132711 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:11.158237 16148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.167s	user 0.066s	sys 0.057s
W20260709 13:05:11.159981 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.161832 17629 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:11.162252 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.161916 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.161895 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:11.168280 15441 raft_consensus.cc:2376] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3. Re-sending same reply.
I20260709 13:05:11.151921 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.083454 17627 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.177223 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.163096 15435 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:11.174695 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.204685 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:11.207311 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:11.208138 15435 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:11.205504 15442 raft_consensus.cc:2376] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3. Re-sending same reply.
I20260709 13:05:11.209877 17409 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:11.217597 15591 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:11.155488 17292 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.219753 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.162778 17629 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.227521 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.230947 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.229645 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.247778 17632 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:11.241130 17628 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.240797 15341 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 4, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.245795 15442 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:11.260244 17630 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.260982 17630 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.241328 17292 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:11.266233 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.240628 17634 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.249205 17628 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.275465 17628 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.276202 17628 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.278319 17628 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.280270 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.268483 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.285063 15583 raft_consensus.cc:2410] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:11.289743 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.290906 15591 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:11.299480 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.300733 15442 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:11.302539 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.303393 15439 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:11.307441 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:11.266510 17638 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:11.311714 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:11.313601 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 108358us
I20260709 13:05:11.275805 17634 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.316787 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.297905 17292 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.319813 15341 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.323060 16146 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:11.328151 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.326476 17382 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:11.314929 17638 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.340440 15592 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:11.341574 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.342437 15592 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:11.342588 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:11.345400 17634 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:11.346513 17634 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.351459 17607 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 3.814s	user 0.000s	sys 0.037s
I20260709 13:05:11.347110 17636 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.343353 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.353283 15435 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:11.322326 17627 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.254889 17632 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.361886 17632 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.362874 17632 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:11.343084 17638 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.363409 17632 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:11.365051 17632 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:11.354099 15591 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:11.367467 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.372792 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:11.347257 17634 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.384135 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.374311 17636 raft_consensus.cc:697] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:11.374890 17292 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.381259 15341 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 4, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 4 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:11.388644 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.390031 15591 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:11.394788 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.395092 17639 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:11.395846 17639 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.396660 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.397492 15591 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:05:11.398504 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:11.368422 17382 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:05:11.383610 17629 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:11.402066 17629 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:11.402771 17629 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.403146 17292 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:11.403872 17292 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:11.386456 17638 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:11.404515 17292 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:11.387770 17456 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 3.888s	user 0.018s	sys 0.063s
I20260709 13:05:11.407799 15341 catalog_manager.cc:5697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 4, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.411732 17628 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.412756 17630 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.405292 17638 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:11.410632 17636 consensus_queue.cc:237] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.409426 17634 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:11.442548 15587 raft_consensus.cc:2410] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:11.422806 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:11.464432 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:11.438407 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 144783us
I20260709 13:05:11.539795 15591 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:05:11.556506 17644 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:05:11.559163 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.407337 17637 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:11.562995 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.571503 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 148831us
I20260709 13:05:11.560313 17637 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.574378 17645 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:11.574896 17645 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:11.575330 17645 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.576371 17637 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.571452 17513 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:11.580402 17513 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.572727 17630 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:11.591020 17630 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.594481 17630 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:11.568264 17628 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:11.608264 17639 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:11.573597 17382 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.617177 17292 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:11.597672 17628 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:11.757714 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.887041 15591 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:05:11.888607 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 131059us
I20260709 13:05:11.905788 17513 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.908273 17628 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:11.907456 17632 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 13:05:11.909214 17632 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.911981 17632 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.619313 17382 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.913314 17628 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.913893 17628 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.915230 17382 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.912868 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:11.920228 15483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.001s	sys 0.007s
W20260709 13:05:11.920786 15483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.001s	sys 0.007s
W20260709 13:05:11.948243 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.954906 17382 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:11.963179 17382 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.965879 17382 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.958930 17628 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:11.955315 17632 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.969605 17645 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:11.984381 17632 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:11.989854 17645 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:11.998733 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.003116 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.003827 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.004397 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.005983 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.006919 15443 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:12.021135 17632 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:12.057070 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.057353 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:12.057017 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.057941 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.057968 15435 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:12.058964 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.060007 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.061730 15439 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:12.080812 15511 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:12.112094 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.113332 15511 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:12.162679 17638 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.176149 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.177663 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1534) took 1014 ms. Trace:
I20260709 13:05:12.178571 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.182242 17629 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:12.196715 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 173) took 1111 ms. Trace:
I20260709 13:05:12.197444 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.202558 17540 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:12.203418 17540 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:12.205197 17540 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:12.207420 16145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.212s	user 0.016s	sys 0.033s
I20260709 13:05:12.214071 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:12.217285 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1702) took 1103 ms. Trace:
I20260709 13:05:12.197253 15584 rpcz_store.cc:276] 0709 13:05:11.085211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.195516 (+1110305us) service_pool.cc:224] Handling call
0709 13:05:12.195959 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.196196 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.196223 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.196290 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:12.196320 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.196376 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.196506 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.240756 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1696) took 1139 ms. Trace:
W20260709 13:05:12.250690 15481 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.360s	user 0.067s	sys 0.062s
I20260709 13:05:12.253721 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.254020 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.266664 15517 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:12.257385 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.267386 15512 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:12.257899 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.178260 15438 rpcz_store.cc:276] 0709 13:05:11.163437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.175705 (+1012268us) service_pool.cc:224] Handling call
0709 13:05:12.177567 (+  1862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.264674 15588 rpcz_store.cc:276] 0709 13:05:11.101440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.239079 (+1137639us) service_pool.cc:224] Handling call
0709 13:05:12.239750 (+   671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.240238 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.240281 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.240345 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:12.240391 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.240472 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.240662 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.268615 15513 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
W20260709 13:05:12.308041 17588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.021s	sys 0.066s
W20260709 13:05:12.308701 17588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.022s	sys 0.066s
W20260709 13:05:12.309623 16145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.320s	user 0.016s	sys 0.035s
I20260709 13:05:12.309984 15584 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:12.397507 15584 pending_rounds.cc:85] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 1
I20260709 13:05:12.310845 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.310918 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.311841 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.304726 17636 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:12.314632 15481 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.424s	user 0.068s	sys 0.062s
I20260709 13:05:12.324050 17540 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:12.326879 17539 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 4.433s	user 0.026s	sys 0.019s
W20260709 13:05:12.330233 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.334090 17632 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:12.304975 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1697) took 1203 ms. Trace:
I20260709 13:05:12.261263 15586 rpcz_store.cc:276] 0709 13:05:11.113394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.215744 (+1102350us) service_pool.cc:224] Handling call
0709 13:05:12.216254 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.216606 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.216644 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.216703 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:12.216783 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.216856 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.217054 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:12.358106 15556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.025s	sys 0.064s
W20260709 13:05:12.410861 15556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.025s	sys 0.064s
I20260709 13:05:12.401903 15509 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:12.398638 15510 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:12.417323 15516 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:12.417578 17645 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.418526 17645 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.419369 17648 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.397923 15584 pending_rounds.cc:107] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:12.409811 15589 rpcz_store.cc:276] 0709 13:05:11.101894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.213574 (+1111680us) service_pool.cc:224] Handling call
0709 13:05:12.304901 (+ 91327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.420282 15584 raft_consensus.cc:2889] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.438104 17648 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:12.441190 15556 connection.cc:256] RPC call timeout handler was delayed by -2.0737903010000309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:05:12.442015 15556 connection.cc:256] RPC call timeout handler was delayed by -2.0413903010000922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:05:12.442446 15556 connection.cc:256] RPC call timeout handler was delayed by -1.9225903010000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 13:05:12.442817 15556 connection.cc:256] RPC call timeout handler was delayed by -1.7884903010000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:05:12.443217 15556 connection.cc:256] RPC call timeout handler was delayed by -1.7884903010000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:05:12.443624 15556 connection.cc:256] RPC call timeout handler was delayed by -1.6867903010000873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260709 13:05:12.444007 15556 connection.cc:256] RPC call timeout handler was delayed by -1.6507903010000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 13:05:12.444389 15556 connection.cc:256] RPC call timeout handler was delayed by -1.6012903010000628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 13:05:12.444766 15556 connection.cc:256] RPC call timeout handler was delayed by -1.6012903010000628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 13:05:12.445113 15556 connection.cc:256] RPC call timeout handler was delayed by -1.2088903009999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2683s for a response
I20260709 13:05:12.448671 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1716) took 1213 ms. Trace:
I20260709 13:05:12.449913 15584 rpcz_store.cc:276] 0709 13:05:11.222964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.309066 (+1086102us) service_pool.cc:224] Handling call
0709 13:05:12.309496 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.436292 (+126796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.436660 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.427429 17628 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.432034 17629 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:12.459849 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 197776us
I20260709 13:05:12.487617 15589 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:05:12.488369 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.459205 17623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.418s	user 0.009s	sys 0.019s
I20260709 13:05:12.488348 15589 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:12.449913 17648 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:12.495096 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.497447 15516 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:12.497690 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:12.500511 15518 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:12.503248 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106173us
W20260709 13:05:12.493185 17623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.452s	user 0.010s	sys 0.019s
I20260709 13:05:12.495885 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 177) took 1158 ms. Trace:
I20260709 13:05:12.441236 17636 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.494444 17645 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:12.510752 15589 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.510337 15588 rpcz_store.cc:276] 0709 13:05:11.337060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.312660 (+975600us) service_pool.cc:224] Handling call
0709 13:05:12.313016 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.313262 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:12.469685 (+156423us) log.cc:844] Serialized 14 byte log entry
0709 13:05:12.495355 (+ 25670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.495431 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:12.495504 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.495613 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.495803 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":169749,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"thread_start_us":181105,"threads_started":2}
I20260709 13:05:12.485316 17628 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.527031 15589 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:12.495893 17629 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.546744 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:12.548372 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.546103 15588 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:12.551752 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.556524 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 71802us
I20260709 13:05:12.563679 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:12.565924 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.576125 15441 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:12.545852 17650 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:12.581179 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.582149 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.584667 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:12.586024 15439 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:12.587822 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.588660 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.591662 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.592602 15516 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:12.593923 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:12.601678 15442 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:12.596495 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:12.606410 15515 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:12.612336 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:12.612800 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:12.613494 16181 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:12.608263 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:12.619846 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:12.625484 15510 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:12.661441 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:12.625752 17660 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:05:12.628201 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.617723 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:05:12.673126 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71809.1us
I20260709 13:05:12.589577 17664 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.672036 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 63874.1us
I20260709 13:05:12.678658 15438 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:12.687217 17664 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.688426 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.689429 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:12.689888 17664 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:12.684851 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 161018us
I20260709 13:05:12.674345 17666 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:12.690586 17307 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:05:12.693397 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1703) took 1579 ms. Trace:
I20260709 13:05:12.703729 17666 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:12.622263 17483 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:12.704383 17307 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:12.704071 15590 rpcz_store.cc:276] 0709 13:05:11.113808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.691960 (+1578152us) service_pool.cc:224] Handling call
0709 13:05:12.692533 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.692858 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.692894 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.692946 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:12.692984 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.693055 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.693199 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.699415 15589 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:05:12.706126 15589 pending_rounds.cc:85] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 5
I20260709 13:05:12.704252 17666 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:12.702118 15515 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:12.702764 17526 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:12.702977 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.681502 17628 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:12.656982 17629 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:12.706378 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800037080 after lost signal to thread 15375
I20260709 13:05:12.697487 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
W20260709 13:05:12.701872 15556 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Timed out: Call waited in the queue past client deadline [suppressed 28 similar messages]
I20260709 13:05:12.707091 15589 pending_rounds.cc:107] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:05:12.705291 17307 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:12.704802 17483 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.713457 17483 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:12.715602 15439 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:12.709970 17667 raft_consensus.cc:2764] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:12.710669 17526 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.718815 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:12.719838 17645 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:12.720314 17645 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.720790 17645 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:12.711920 15589 raft_consensus.cc:2889] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.703755 17444 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:12.722295 17444 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:12.722766 17444 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:12.724054 15585 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 6. Ops: []
I20260709 13:05:12.707607 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.711115 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:12.725991 15438 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:12.726322 17664 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:12.726960 17664 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:12.728160 17664 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.728799 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:12.729525 15440 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:12.730108 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1531) took 1569 ms. Trace:
I20260709 13:05:12.729763 17307 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.731201 17307 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:12.720674 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:12.609549 17650 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:12.749354 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:12.750579 17623 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:12.751044 17623 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.752686 17623 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:12.754063 15407 connection.cc:256] RPC call timeout handler was delayed by -3.0119087829999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:05:12.754659 15407 connection.cc:256] RPC call timeout handler was delayed by -3.0020087829999511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
I20260709 13:05:12.734570 17444 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:12.755018 15407 connection.cc:256] RPC call timeout handler was delayed by -2.9971739089999119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 13:05:12.751708 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:12.755846 15583 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:05:12.756553 15583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1728) took 1488 ms (client timeout 1517 ms). Trace:
W20260709 13:05:12.756982 15583 rpcz_store.cc:269] 0709 13:05:11.268290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.298191 (+ 29901us) service_pool.cc:224] Handling call
0709 13:05:12.751596 (+1453405us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5c000e9d8c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7f6c1161 00007fcf7f862a79 00007fcf80d1c9b6 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:12.756458 (+  4862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68904832}
I20260709 13:05:12.757768 17444 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:12.758481 17444 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:12.760254 17650 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:12.759140 17444 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.761266 15437 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:12.762120 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1546) took 1762 ms. Trace:
I20260709 13:05:12.762423 15437 rpcz_store.cc:276] 0709 13:05:10.999731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.760558 (+1760827us) service_pool.cc:224] Handling call
0709 13:05:12.760987 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:12.761742 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.762053 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.763260 17444 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:12.764469 17483 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.746488 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:12.766309 15510 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.766476 17624 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:12.767000 17624 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:12.770175 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.767457 17624 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:12.709132 15516 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:05:12.775938 17628 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:12.777359 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:12.752323 17629 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:12.779925 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.730456 15440 rpcz_store.cc:276] 0709 13:05:11.160238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.160482 (+   244us) service_pool.cc:224] Handling call
0709 13:05:12.728608 (+1568126us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800003698. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:05:12.730011 (+  1403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2909440}
I20260709 13:05:12.783996 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:12.785022 17588 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:12.785514 17588 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.785907 17588 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:12.776674 17628 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:12.788327 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:12.789124 15514 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:12.789366 17628 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.792917 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:12.796110 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.796901 15518 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
W20260709 13:05:12.797785 15587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1707) took 1679 ms (client timeout 1621 ms). Trace:
I20260709 13:05:12.798101 15591 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:05:12.798477 15591 pending_rounds.cc:85] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 2
I20260709 13:05:12.798769 15591 pending_rounds.cc:107] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:05:12.799160 15591 raft_consensus.cc:2889] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.764508 17623 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.800254 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:12.802274 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:12.793744 16182 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:05:12.798249 15587 rpcz_store.cc:269] 0709 13:05:11.118118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.125437 (+  7319us) service_pool.cc:224] Handling call
0709 13:05:12.797348 (+1671911us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540028b4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:12.797687 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654915840}
I20260709 13:05:12.811750 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.819602 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:12.823793 17444 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:12.824642 17444 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:12.837177 17668 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.245s	user 0.000s	sys 0.004s
W20260709 13:05:12.838932 15407 connection.cc:256] RPC call timeout handler was delayed by -2.9309984979998944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 13:05:12.843557 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:12.825714 16175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 383) took 5132 ms (client timeout 1869 ms). Trace:
W20260709 13:05:12.844825 16175 rpcz_store.cc:269] 0709 13:05:07.687785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.711937 (+ 24152us) service_pool.cc:224] Handling call
0709 13:05:12.819318 (+5107381us) spinlock_profiling.cc:243] Waited 3.34 s on lock 0x7b5400121e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:12.819476 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7692691840}
I20260709 13:05:12.847908 17483 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:12.848877 17483 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.849539 17483 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.849905 17636 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:12.840420 17650 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:12.851852 17650 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:08.004017 17248 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:12.865440 17248 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:12.829209 17629 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.868893 15511 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:12.900837 17444 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:12.902055 17666 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:12.903822 15407 connection.cc:256] RPC call timeout handler was delayed by -2.8657739089999268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
I20260709 13:05:12.904162 15517 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:12.904405 15407 connection.cc:256] RPC call timeout handler was delayed by -2.8315739089999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 13:05:12.908082 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.909094 15515 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:12.913189 15442 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
W20260709 13:05:12.916702 15407 connection.cc:256] RPC call timeout handler was delayed by -2.7383984979999241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 13:05:12.796950 15510 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
W20260709 13:05:12.917611 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.918267 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.919006 15407 connection.cc:256] RPC call timeout handler was delayed by -2.4971984979999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 13:05:12.919524 15407 connection.cc:256] RPC call timeout handler was delayed by -2.106440148000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:05:12.920384 15407 connection.cc:256] RPC call timeout handler was delayed by -2.0950900089999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:05:12.920787 15407 connection.cc:256] RPC call timeout handler was delayed by -2.0353401480000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 13:05:12.916968 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 215109us
W20260709 13:05:12.925290 15407 connection.cc:256] RPC call timeout handler was delayed by -1.8943900089999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:05:12.925930 15407 connection.cc:256] RPC call timeout handler was delayed by -1.8781900090000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:05:12.926297 15407 connection.cc:256] RPC call timeout handler was delayed by -1.8718900090000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:05:12.926654 15407 connection.cc:256] RPC call timeout handler was delayed by -1.8475900089999868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 13:05:12.927001 15407 connection.cc:256] RPC call timeout handler was delayed by -1.8286900089999563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:05:12.927361 15407 connection.cc:256] RPC call timeout handler was delayed by -1.8214900089999446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 13:05:12.927755 15407 connection.cc:256] RPC call timeout handler was delayed by -1.7782900089999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:05:12.928134 15407 connection.cc:256] RPC call timeout handler was delayed by -1.6918900089999624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:05:12.928857 15407 connection.cc:256] RPC call timeout handler was delayed by -1.2825293810000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 13:05:12.929378 15407 connection.cc:256] RPC call timeout handler was delayed by -1.1410900089999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2577s for a response
I20260709 13:05:12.931294 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:12.921394 17444 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:12.932835 17483 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:12.933041 17444 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.930768 17540 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.934576 17540 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:12.918042 17419 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.941162 15514 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:12.953069 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1715) took 1742 ms. Trace:
W20260709 13:05:12.954052 15372 debug-util.cc:398] Leaking SignalData structure 0x7b080029c9a0 after lost signal to thread 15467
W20260709 13:05:12.998003 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.014070 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.941629 17483 consensus_queue.cc:1059] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:05:12.923341 17671 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:13.041766 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800336000 after lost signal to thread 15468
I20260709 13:05:13.049552 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1695) took 6204 ms. Trace:
W20260709 13:05:13.050365 15372 debug-util.cc:398] Leaking SignalData structure 0x7b080038a8a0 after lost signal to thread 15542
W20260709 13:05:13.052311 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7de0 after lost signal to thread 15616
W20260709 13:05:13.052745 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7e00 after lost signal to thread 15617
W20260709 13:05:13.054535 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800045640 after lost signal to thread 16206
W20260709 13:05:13.054908 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa2e0 after lost signal to thread 16207
W20260709 13:05:13.055308 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee0a0 after lost signal to thread 17258
I20260709 13:05:13.047823 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:13.041638 15591 rpcz_store.cc:276] 0709 13:05:11.211035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.909786 (+698751us) service_pool.cc:224] Handling call
0709 13:05:12.797655 (+887869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.802931 (+  5276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.952725 (+149794us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540028b4d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:12.952962 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040401152}
I20260709 13:05:13.050093 15585 rpcz_store.cc:276] 0709 13:05:06.845553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.589788 (+5744235us) service_pool.cc:224] Handling call
0709 13:05:12.723690 (+133902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.724545 (+   855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.954301 (+229756us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b54001de7d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:13.049462 (+ 95161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146011904}
I20260709 13:05:13.062525 15434 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:13.063719 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800386b80 after lost signal to thread 17391
W20260709 13:05:13.064452 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3780 after lost signal to thread 17450
W20260709 13:05:13.064746 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08002e13a0 after lost signal to thread 17469
W20260709 13:05:13.065115 15372 debug-util.cc:398] Leaking SignalData structure 0x7b080033dac0 after lost signal to thread 17490
W20260709 13:05:13.065362 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800284780 after lost signal to thread 17494
W20260709 13:05:13.065593 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800321f40 after lost signal to thread 17495
W20260709 13:05:13.066039 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800305240 after lost signal to thread 17507
I20260709 13:05:13.068780 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.069226 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.069597 15511 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:13.053563 17444 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:13.064385 17622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.090s	user 0.046s	sys 0.056s
W20260709 13:05:13.066694 15372 debug-util.cc:398] Leaking SignalData structure 0x7b080035db00 after lost signal to thread 17516
W20260709 13:05:13.080193 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08003373a0 after lost signal to thread 17550
W20260709 13:05:13.080526 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 329498us
W20260709 13:05:13.046512 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.082221 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.080585 15372 debug-util.cc:398] Leaking SignalData structure 0x7b080034a0c0 after lost signal to thread 17564
W20260709 13:05:13.088064 15372 debug-util.cc:398] Leaking SignalData structure 0x7b080030e040 after lost signal to thread 17579
W20260709 13:05:13.088385 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08003377a0 after lost signal to thread 17580
W20260709 13:05:13.088707 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800397c80 after lost signal to thread 17584
W20260709 13:05:13.088999 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800397c20 after lost signal to thread 17586
W20260709 13:05:13.106459 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800328ae0 after lost signal to thread 17587
W20260709 13:05:13.077208 17622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.103s	user 0.046s	sys 0.057s
I20260709 13:05:13.055120 17419 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.109135 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:13.112674 15584 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:13.113603 15517 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:13.053598 17635 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:05:13.067680 17483 consensus_queue.cc:1243] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:05:13.106916 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800254ea0 after lost signal to thread 17594
W20260709 13:05:13.120807 15372 debug-util.cc:398] Leaking SignalData structure 0x7b080023a400 after lost signal to thread 17595
W20260709 13:05:13.121176 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800254fe0 after lost signal to thread 17596
W20260709 13:05:13.121446 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08001d0da0 after lost signal to thread 17597
W20260709 13:05:13.121719 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800350200 after lost signal to thread 17598
I20260709 13:05:13.067724 17439 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:05:13.066530 17671 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:13.137070 17623 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:13.137850 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.135803 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.138721 15584 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:13.141106 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.141422 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.145866 15514 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:13.098968 17444 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:05:13.123703 17548 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:13.129885 17526 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:13.135727 17672 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.138808 17540 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:13.153301 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 316293us
I20260709 13:05:13.154930 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:13.168309 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.169247 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.172153 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:13.147735 17629 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:13.175421 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.185307 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.186276 15514 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:13.189404 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:13.230355 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.136570 17448 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:13.156944 17650 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:13.190156 15587 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
W20260709 13:05:13.246023 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 65966.2us
I20260709 13:05:13.250797 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:13.247994 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:13.175014 17526 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:13.296022 17526 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.296571 17526 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.258517 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:13.299846 15518 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:13.300364 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.300899 17628 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:13.301465 17628 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:13.302834 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.259969 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.260569 17444 raft_consensus.cc:3055] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.303431 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.259624 17638 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:13.303728 17444 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:13.303893 15513 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:13.259624 17448 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.304847 17444 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.261736 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 175) took 2112 ms. Trace:
I20260709 13:05:13.306229 17444 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.262208 17650 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.306757 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.307102 17650 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.307492 15441 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:13.307765 17638 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.307886 17682 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:13.308318 17638 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:13.308379 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:13.309249 15436 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:13.272491 17674 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:05:13.252463 17679 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:13.314599 17679 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:13.271991 15583 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:13.316285 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.315928 17679 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.316955 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.317533 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.176452 17672 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:13.318152 15587 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:13.319120 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.290068 15586 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:13.172549 17645 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.303083 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:13.325300 15435 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.324967 15586 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:13.303833 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.326958 15442 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:13.267169 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:13.311933 15482 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.572s (SENT)
I20260709 13:05:13.306155 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:13.327944 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 77375.5us
I20260709 13:05:13.258057 17664 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:05:13.232293 15591 raft_consensus.cc:2955] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:13.324993 15587 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:13.187872 17588 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:13.280727 17671 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:13.290277 17419 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:13.306277 17448 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:13.309764 17650 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:13.343760 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.306428 15592 rpcz_store.cc:276] 0709 13:05:11.149267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.402273 (+253006us) service_pool.cc:224] Handling call
0709 13:05:11.402698 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.403061 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.403093 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:11.404564 (+  1471us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.005024 (+1600460us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800389260. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1
0709 13:05:13.035686 (+ 30662us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:13.061192 (+ 25506us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.261305 (+200113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.261394 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.261436 (+    42us) raft_consensus.cc:1685] finished
0709 13:05:13.261530 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.261674 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21418,"prepare.queue_time_us":20462,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":62391,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":34325,"spinlock_wait_cycles":34905344,"thread_start_us":325434,"threads_started":2,"wal-append.queue_time_us":200670,"wal-append.run_cpu_time_us":2568,"wal-append.run_wall_time_us":1311467}
I20260709 13:05:13.321722 17682 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.322926 15509 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:13.320009 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.354283 15514 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
W20260709 13:05:13.322734 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 260252us
I20260709 13:05:13.330917 15517 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:13.318184 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.356700 15583 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:05:13.332759 15434 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
W20260709 13:05:13.334189 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47721.1us
I20260709 13:05:13.359647 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:13.363169 15434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1519) took 6026 ms (client timeout 2015 ms). Trace:
I20260709 13:05:13.320056 17672 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:13.367241 16181 raft_consensus.cc:2368] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5.
I20260709 13:05:13.368496 15587 raft_consensus.cc:2368] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
W20260709 13:05:13.369299 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 57397.1us
I20260709 13:05:13.369524 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:13.370393 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.370394 15583 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:05:13.363756 15434 rpcz_store.cc:269] 0709 13:05:07.332117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.366186 (+ 34069us) service_pool.cc:224] Handling call
0709 13:05:12.958334 (+5592148us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b5c00046a8c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7f6c1161 00007fcf7f862a79 00007fcf80d1c9b6 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:13.358203 (+399869us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16173312}
I20260709 13:05:13.373633 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.343502 17636 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:13.344123 15586 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.392741 15514 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.406710 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.393491 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:13.393566 15518 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.374652 15584 raft_consensus.cc:2376] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6. Re-sending same reply.
I20260709 13:05:13.394548 15511 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:13.395588 15512 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:13.401419 15435 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:05:13.404675 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.409372 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.410706 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.413280 17636 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:13.413761 17588 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:13.413937 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.378399 17650 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:05:13.416440 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.418222 15440 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:13.426605 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.427457 15592 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.428709 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.429557 15586 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:13.429764 15583 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
W20260709 13:05:13.377058 17624 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.595s	user 0.014s	sys 0.002s
I20260709 13:05:13.419425 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:13.428881 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 70888.3us
I20260709 13:05:13.437081 15585 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.442440 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.443609 15583 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:13.446770 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.447832 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.449625 15584 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:13.450801 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.413852 17636 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:13.452773 15587 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:13.451526 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.460304 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.461046 17645 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:13.461974 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.450727 17588 consensus_queue.cc:1059] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:05:13.469885 17588 raft_consensus.cc:3055] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:13.470360 17588 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:13.310290 17628 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:13.460541 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.472886 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.473551 15442 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:13.480742 15436 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:13.483429 15513 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:13.483642 15585 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.483431 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.473578 15512 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:13.484972 15435 raft_consensus.cc:2368] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:13.488117 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.489161 15584 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.492507 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.494437 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:13.489094 15555 connection.cc:256] RPC call timeout handler was delayed by -4.5316477910000685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:05:13.495683 15442 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
W20260709 13:05:13.495632 15555 connection.cc:256] RPC call timeout handler was delayed by -4.5118477910000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:05:13.496361 15555 connection.cc:256] RPC call timeout handler was delayed by -4.3750477910000427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:05:13.496778 15555 connection.cc:256] RPC call timeout handler was delayed by -4.36694779100003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:05:13.497206 15555 connection.cc:256] RPC call timeout handler was delayed by -4.342647791000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:05:13.497618 15555 connection.cc:256] RPC call timeout handler was delayed by -4.3309477910000851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:05:13.498086 15555 connection.cc:256] RPC call timeout handler was delayed by -4.3048477910000429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:05:13.498644 15555 connection.cc:256] RPC call timeout handler was delayed by -4.2238477910000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 13:05:13.499061 15555 connection.cc:256] RPC call timeout handler was delayed by -4.2238477910000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 13:05:13.499455 15555 connection.cc:256] RPC call timeout handler was delayed by -4.1266477910000958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 13:05:13.499889 15555 connection.cc:256] RPC call timeout handler was delayed by -4.0753477910000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 13:05:13.500262 15555 connection.cc:256] RPC call timeout handler was delayed by -4.04024779100007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 13:05:13.500587 15555 connection.cc:256] RPC call timeout handler was delayed by -4.0159477910000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 13:05:13.501099 15555 connection.cc:256] RPC call timeout handler was delayed by -3.9880477910000991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260709 13:05:13.501523 15555 connection.cc:256] RPC call timeout handler was delayed by -3.9520477910000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 13:05:13.501951 15555 connection.cc:256] RPC call timeout handler was delayed by -3.5101477910000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2683s for a response
W20260709 13:05:13.502358 15555 connection.cc:256] RPC call timeout handler was delayed by -3.3301477910000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2883s for a response
W20260709 13:05:13.502769 15555 connection.cc:256] RPC call timeout handler was delayed by -3.2761477910000849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2943s for a response
W20260709 13:05:13.503170 15555 connection.cc:256] RPC call timeout handler was delayed by -3.0493477910000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3195s for a response
I20260709 13:05:13.504683 17685 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:05:13.505738 17307 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.008s
I20260709 13:05:13.505918 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.506582 15517 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:13.494355 17648 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.508059 15517 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:13.508294 17648 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:13.509673 15517 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:05:13.512202 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.512854 15585 raft_consensus.cc:2376] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3. Re-sending same reply.
I20260709 13:05:13.513724 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.514855 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.515933 16180 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:05:13.516924 17687 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:05:13.516952 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.517846 15587 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:13.518827 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.519495 15587 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.515933 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.519889 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.520236 17682 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:13.520447 15592 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:13.520772 17682 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.521086 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.521387 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.521312 17682 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.522039 15592 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:13.522331 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.522815 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.511324 17648 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:13.524694 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.525629 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.527915 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.527244 15587 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.529184 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.529831 15512 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:13.527962 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.531034 15512 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:13.531075 15592 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.532792 17691 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:13.532992 17690 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.533485 17690 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:13.533530 15583 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:13.534890 17690 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.535717 17685 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:13.536139 17685 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:13.536491 17690 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.440727 17624 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.537568 17685 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.539996 17624 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:13.540901 15515 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:13.542289 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:13.543597 17419 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:13.544080 17419 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.544541 17419 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:13.547761 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.528769 15513 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:13.550176 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.551613 15583 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
W20260709 13:05:13.564267 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.565056 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.564908 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 235976us
I20260709 13:05:13.566337 16146 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:13.535244 17666 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:13.567866 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.569550 15586 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:13.574534 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.533492 17691 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.580775 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.588366 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.589587 15587 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:13.590663 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.591270 15587 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.591993 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.597958 15585 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.592547 15407 leader_election.cc:400] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5.
I20260709 13:05:13.598846 15407 leader_election.cc:403] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:13.593678 17685 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:13.611335 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 170176us
I20260709 13:05:13.594422 17538 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:13.608028 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.622784 15590 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:13.579888 17307 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:13.602272 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.626863 15588 raft_consensus.cc:2376] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2. Re-sending same reply.
I20260709 13:05:13.564530 17682 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:13.623231 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1732) took 2283 ms. Trace:
I20260709 13:05:13.629182 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.603454 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.633121 15511 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:13.633234 15589 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:13.632108 15586 rpcz_store.cc:276] 0709 13:05:11.347957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.410991 (+1063034us) service_pool.cc:224] Handling call
0709 13:05:12.465713 (+ 54722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.289906 (+824193us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b540006e120. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd591c0 00007fcf7bd5a231 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c
0709 13:05:13.570006 (+280100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.622933 (+ 52927us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b540028aad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:13.623165 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513265280}
I20260709 13:05:13.628479 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.634266 15518 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:13.634374 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.512239 17650 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:13.626338 17307 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.621989 17538 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:13.637355 17307 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:13.638185 17538 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:13.639609 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.640168 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.641091 15588 raft_consensus.cc:2410] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:13.641940 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.643244 17248 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:13.644240 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.471319 17588 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:13.644240 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.672240 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.662165 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.663921 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.667033 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:13.689119 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.689328 15589 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.689616 15437 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.670368 15583 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:13.690001 15518 raft_consensus.cc:2368] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:13.693674 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:13.694169 15585 raft_consensus.cc:2376] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6. Re-sending same reply.
I20260709 13:05:13.645323 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.691689 15586 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:13.690629 15587 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:13.699277 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.680508 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.709942 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.710752 15590 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.712381 15514 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:13.713523 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.719412 17691 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:13.714251 15518 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:13.673974 17666 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:13.723976 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 127672us
W20260709 13:05:13.776834 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.777386 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.777659 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.778645 15585 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:13.716557 17540 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.783928 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:13.789506 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 217019us
I20260709 13:05:13.676167 17307 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:13.805315 15442 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:13.698709 17650 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.815968 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.817502 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.818310 15514 raft_consensus.cc:2410] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:13.823311 15589 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:13.792608 17588 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.832129 15585 raft_consensus.cc:2410] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:13.833804 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.835166 15589 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:13.839593 15585 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:13.842983 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.848694 15518 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:13.731184 17697 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:05:13.846813 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:13.853359 15442 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:13.780918 17666 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:05:13.848851 17638 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.002s
W20260709 13:05:13.848354 17526 consensus_meta.cc:287] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.009s
W20260709 13:05:13.870404 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 64152.6us
W20260709 13:05:13.901337 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.912658 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.919178 15442 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:13.920047 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.868479 17307 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:13.924871 15437 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:13.927822 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:13.925930 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:13.929973 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.930481 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.931154 15437 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:13.933270 16180 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:13.937485 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:13.940239 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68142.3us
I20260709 13:05:13.944360 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:13.946506 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:13.947395 16179 raft_consensus.cc:2368] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:05:13.947975 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:13.948441 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:13.948747 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:13.949961 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:13.951499 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:13.956180 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.956655 17666 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:05:13.957630 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:13.959084 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:13.955964 16175 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.960392 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.961174 15511 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:13.962841 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:13.873124 17638 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:13.964531 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:13.963769 15518 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
W20260709 13:05:14.006493 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.007026 15443 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:14.008536 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:14.009862 15583 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:14.008620 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.013173 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:14.014140 15585 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.006150 15556 leader_election.cc:400] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:05:14.019420 15556 leader_election.cc:403] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:14.021543 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:14.024269 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:14.025506 15583 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:13.874073 17526 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:14.027144 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:14.028079 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76827.2us
I20260709 13:05:14.028199 15518 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:14.032028 15518 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:14.034375 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.037761 15583 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:14.041471 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.049410 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:14.050339 15511 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.052205 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.052520 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:14.056893 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 91104.3us
W20260709 13:05:14.057643 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.060663 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:14.065636 15585 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:14.066239 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:14.059283 17691 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.042351 17686 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.069487 15443 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:14.077231 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.079923 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.082007 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.089784 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:14.093623 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.113163 15515 raft_consensus.cc:2410] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:14.069139 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:14.102944 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.113750 15589 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:14.102972 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.115944 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.116676 15518 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:14.095227 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.118188 15510 raft_consensus.cc:2368] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
W20260709 13:05:14.121721 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:14.122421 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.124018 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.124542 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:14.126083 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.126194 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.126935 15510 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:14.127995 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.128800 15510 raft_consensus.cc:2368] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:14.093289 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.128970 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.129601 15517 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:14.130631 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.131978 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.133240 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.128082 15590 raft_consensus.cc:2410] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:05:14.102715 17701 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 13:05:14.102339 17705 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:05:14.135587 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:14.078338 17699 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.434s	user 0.000s	sys 0.004s
I20260709 13:05:14.073012 17526 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:14.137295 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.137606 16181 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:14.138473 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:14.071264 17638 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:14.141350 15585 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:14.081410 17691 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:05:14.072638 17483 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.092334 17650 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:14.143675 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:14.145949 15556 leader_election.cc:400] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:14.147683 15443 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:14.154345 15556 leader_election.cc:403] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:14.146698 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.155380 15437 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:14.156601 15590 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:14.142617 17448 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:14.083927 17686 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.073153 17712 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:05:14.149855 17690 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.136178 17685 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:05:14.185842 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:14.192116 15585 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.160466 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:14.181619 17650 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
W20260709 13:05:14.200969 15482 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.610s (SENT)
I20260709 13:05:14.205328 15509 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.190536 17690 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:14.182682 17448 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:14.219743 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 282307us
W20260709 13:05:14.220329 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 496890us
I20260709 13:05:14.225852 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:14.215687 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:14.224071 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1692) took 1425 ms. Trace:
I20260709 13:05:14.232275 15583 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
W20260709 13:05:14.205320 17702 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:05:14.235872 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:14.227445 15482 leader_election.cc:336] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.670s (SENT)
I20260709 13:05:14.244508 15589 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:14.246873 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:14.247779 15589 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:05:14.249001 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:14.249758 15589 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:14.232909 17690 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.236824 15516 rpcz_store.cc:276] 0709 13:05:12.791052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.791690 (+   638us) service_pool.cc:224] Handling call
0709 13:05:12.792107 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.130497 (+338390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.130530 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.417650 (+287120us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b2c00031148. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:05:13.447153 (+ 29503us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.570876 (+123723us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:13.570915 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.570985 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.202572 (+631587us) raft_consensus.cc:1685] finished
0709 13:05:14.202596 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.215910 (+ 13314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10122,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"spinlock_wait_cycles":60432128,"thread_start_us":374543,"threads_started":2,"wal-append.queue_time_us":217536}
I20260709 13:05:14.254650 15585 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:14.258163 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:14.258741 15585 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:05:14.246531 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 179653us
I20260709 13:05:14.234797 17448 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:14.256176 15482 leader_election.cc:336] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.717s (SENT)
I20260709 13:05:14.267932 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:14.269799 15586 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.270238 15586 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:14.272527 15589 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:14.253654 16178 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:05:14.284287 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 138442us
W20260709 13:05:14.264614 17636 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.003s
I20260709 13:05:14.285696 15556 leader_election.cc:400] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:14.286334 15556 leader_election.cc:403] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:14.286520 15586 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.298084 15585 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
W20260709 13:05:14.301344 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45217.8us
I20260709 13:05:14.301602 15586 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:14.302470 15482 leader_election.cc:336] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.747s (SENT)
I20260709 13:05:14.303016 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:14.316164 15585 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.275810 17526 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:14.322285 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:14.322940 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:14.323379 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.308143 17650 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
W20260709 13:05:14.328174 17719 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:05:14.329239 17718 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:05:14.331053 17717 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:05:14.332624 17697 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:14.333264 17686 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:14.333338 17697 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:14.340066 15592 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:14.340579 15592 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:14.341430 15592 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.342428 15592 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.343734 17716 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:14.344208 17686 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:14.348665 15586 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:14.354440 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 82543.1us
W20260709 13:05:14.358647 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56228.9us
W20260709 13:05:14.372773 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 118437us
I20260709 13:05:14.372136 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.324676 17628 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:14.376653 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:05:14.378343 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.380849 15592 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:05:14.384997 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 118837us
I20260709 13:05:14.387249 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:14.301015 17636 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:14.385200 17540 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.002s
W20260709 13:05:14.403028 17419 consensus_meta.cc:287] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.858s	user 0.013s	sys 0.007s
I20260709 13:05:14.406710 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.407267 17419 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:14.410267 17419 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:14.387351 17686 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:14.407980 17691 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:14.400928 17716 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.420607 16178 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:05:14.430761 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.407903 17727 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:14.419790 16175 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:14.432421 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:14.439752 15511 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
W20260709 13:05:14.444761 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 85362.9us
I20260709 13:05:14.416757 17540 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5.
W20260709 13:05:14.447479 15482 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.785s (SENT)
I20260709 13:05:14.448946 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:14.415104 17690 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:14.453588 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:14.456389 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:14.460289 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:14.446509 17691 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:14.446599 17686 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:14.476370 15406 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:14.454257 17714 raft_consensus.cc:2764] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:14.478605 15589 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.462548 17716 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.485973 15511 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.488140 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.487437 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.486672 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.489006 15516 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:14.489248 15510 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:14.489203 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.489949 15511 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:14.493043 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:14.493806 15515 raft_consensus.cc:2376] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5. Re-sending same reply.
I20260709 13:05:14.494120 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.495277 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.496106 15511 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:14.475615 17628 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:14.464764 17725 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:14.479786 17708 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:14.500582 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 93180.4us
I20260709 13:05:14.501864 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:14.503582 15556 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.501595 17708 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.493144 17716 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:14.492457 17540 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.503595 15518 raft_consensus.cc:2376] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4. Re-sending same reply.
I20260709 13:05:14.507301 17708 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:14.513803 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 66781.6us
W20260709 13:05:14.515776 15482 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.970s (SENT)
W20260709 13:05:14.517128 17707 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.490s	user 0.002s	sys 0.002s
I20260709 13:05:14.519652 17690 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:14.522856 17448 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.525127 17538 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.510423 17727 raft_consensus.cc:2764] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:14.526845 17691 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:14.510650 17716 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.507899 17725 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:14.519728 17728 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:05:14.511785 17540 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.545624 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:14.546614 15515 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:14.552547 17731 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:14.553110 17725 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.531812 17686 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:14.574281 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.574433 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.538805 17448 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:14.586630 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.587476 15443 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
W20260709 13:05:14.587491 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.550298 17540 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.590265 15437 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:14.593312 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.593480 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:14.594201 15442 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.602381 17743 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:14.605962 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.559710 17419 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:05:14.607944 15442 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:14.583843 17636 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:14.610117 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:14.610814 15437 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.615950 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:14.616729 15435 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.619944 17448 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:14.620428 17448 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.620757 17448 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.621829 17708 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.623318 15337 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 3 to 4, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.626613 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 184) took 1543 ms. Trace:
I20260709 13:05:14.627189 15591 rpcz_store.cc:276] 0709 13:05:13.083604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.103986 (+ 20382us) service_pool.cc:224] Handling call
0709 13:05:13.123360 (+ 19374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.156380 (+ 33020us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:13.482372 (+325992us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.625142 (+142770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.625206 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:13.632758 (+  7552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.270105 (+637347us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b1800389380. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c382a6 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419
0709 13:05:14.626370 (+356265us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54001c1454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:14.626418 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.626549 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4854,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":57211,"spinlock_wait_cycles":73776768,"thread_start_us":130035,"threads_started":1,"wal-append.queue_time_us":354532}
I20260709 13:05:14.629261 17448 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.633322 15436 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:14.634943 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:14.589988 17727 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:05:14.637018 15442 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:14.637705 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1395) took 1246 ms. Trace:
I20260709 13:05:14.638576 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:14.639386 15436 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.640584 17483 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.641176 17483 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:14.593923 17690 raft_consensus.cc:2764] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:14.642376 17483 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:14.607251 17419 consensus_queue.cc:1243] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:05:14.651698 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.652834 17737 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:14.653479 17737 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:14.654490 17737 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.659292 17638 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:14.661502 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:14.662473 15440 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:14.649845 17703 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:14.659250 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:14.666265 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:14.668269 15436 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:14.664048 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:14.638245 15509 rpcz_store.cc:276] 0709 13:05:13.391590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.391808 (+   218us) service_pool.cc:224] Handling call
0709 13:05:14.202858 (+811050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.219325 (+ 16467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.637426 (+418101us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b5400213c50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:14.637620 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864025856}
I20260709 13:05:14.684118 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:14.684923 15442 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.685298 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:14.686151 15443 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:14.686437 15435 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:14.619407 15437 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:14.695022 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:14.697964 16146 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:14.695886 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.703934 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:14.710882 15443 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:14.702154 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:14.714990 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:14.721246 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:14.728225 17650 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:14.728976 17650 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:14.737078 17697 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:14.740149 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:14.744187 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:14.745234 15591 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:14.775414 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 77564.7us
W20260709 13:05:14.780311 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 84509us
I20260709 13:05:14.692754 17638 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:14.783982 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.789445 15442 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:14.773846 17628 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:14.697585 17419 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:05:14.779749 17731 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:14.785458 17483 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.702116 17307 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:05:14.785482 17679 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:14.790777 17635 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:14.787264 17691 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:14.785320 17448 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:14.712298 17726 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:05:14.804499 17712 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:14.819319 17708 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:14.807116 17714 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:05:14.842648 17650 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.913050 17650 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.843055 17540 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.917407 17540 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:14.868427 16180 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:14.869911 15591 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:05:14.890522 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:14.891332 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 176402us
I20260709 13:05:14.919615 15406 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:14.897590 17526 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:14.898280 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46255.6us
I20260709 13:05:14.920930 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:14.884164 17706 raft_consensus.cc:2764] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:14.888216 17628 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:14.932255 17686 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:14.930399 17709 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:14.935163 17709 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:14.935681 17691 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:05:14.966269 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 248256us
I20260709 13:05:14.900557 17731 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:14.975885 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.060832 15442 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:14.939205 17628 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.097944 17248 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.098587 17248 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:15.105022 17248 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:15.106568 17248 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:15.113596 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.066531 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 147010us
I20260709 13:05:15.117192 15442 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:15.062500 17419 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:14.977689 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.928910 17635 raft_consensus.cc:697] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:14.931499 17716 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:14.973641 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:15.069249 17727 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:15.071887 17715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.017s	sys 0.004s
W20260709 13:05:15.073848 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 352531us
I20260709 13:05:14.964772 17686 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:15.083576 17709 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:15.116762 15406 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:15.124011 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
W20260709 13:05:15.124490 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 150970us
I20260709 13:05:15.128832 15443 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.129596 17716 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:15.126129 17727 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:15.130679 17686 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:15.126223 17690 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:05:15.125216 17715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.018s	sys 0.004s
I20260709 13:05:15.135829 17526 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:15.149573 17526 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.138659 17691 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:15.148341 17749 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:15.156347 17749 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:15.155659 17731 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:15.156805 17749 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.140129 15442 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:05:15.146239 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:15.161401 17727 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:15.165836 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:15.146579 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:15.150118 17716 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:15.126655 17725 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:15.167323 16181 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:15.168648 15442 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:15.168298 17638 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.176680 17714 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.178335 17483 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:15.179062 17714 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:15.179469 17714 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:15.179929 17714 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.180652 15442 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:15.181787 15435 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:15.181977 15436 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.183115 15440 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.168469 17716 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:15.173707 16180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52918 (request call id 259) took 1226 ms. Trace:
I20260709 13:05:15.184273 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.184340 16180 rpcz_store.cc:276] 0709 13:05:13.941518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.941797 (+   279us) service_pool.cc:224] Handling call
0709 13:05:15.166634 (+1224837us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54005f0fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:15.168000 (+  1366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730129792}
I20260709 13:05:15.184528 17716 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:15.182986 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.186363 15434 raft_consensus.cc:2368] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5.
I20260709 13:05:15.187717 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.165786 17690 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:05:15.188429 15434 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:15.187882 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:15.174185 17727 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:05:15.191252 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:15.192075 15442 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.191949 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.194208 15436 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:15.173296 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:15.215030 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:15.218146 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:15.211885 17638 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.220944 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:15.191287 17727 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.207990 17690 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.165768 17628 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:15.225227 17727 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:15.147836 17635 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:15.317683 15555 leader_election.cc:336] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.548s (SENT)
I20260709 13:05:15.233215 17679 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:15.313624 15442 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
W20260709 13:05:15.315629 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 94778.2us
I20260709 13:05:15.316220 15434 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:15.321278 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.321833 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:15.326251 15435 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:15.326373 15436 raft_consensus.cc:2368] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5.
I20260709 13:05:15.326283 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:15.330928 15555 leader_election.cc:336] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.570s (SENT)
I20260709 13:05:15.332154 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:15.334966 17448 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:15.338160 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:15.339450 17638 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.340464 17638 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:15.341054 17638 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:15.341521 17638 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.322903 17483 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:05:15.345779 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:15.323607 17679 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:15.358799 17526 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:15.357364 17749 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:15.322221 17690 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:15.333408 17650 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.360731 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.355934 17727 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:15.363202 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:15.370486 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:15.385521 15510 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.370234 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.371236 15434 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:15.371501 15511 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:15.374369 15517 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.375224 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.376781 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:15.393725 15589 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:15.377018 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.395267 15591 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:15.379429 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.373063 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.374506 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:15.392271 15442 raft_consensus.cc:2376] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5. Re-sending same reply.
I20260709 13:05:15.363251 17679 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.401073 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:15.433490 15514 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.417919 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:15.427006 15555 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.722s (SENT)
I20260709 13:05:15.435479 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:15.436983 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.435283 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.438351 15592 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:15.438474 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:15.440147 15583 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:15.443261 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.446328 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.446979 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.447326 15583 raft_consensus.cc:2410] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:15.447649 15590 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:15.448215 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.452206 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.453487 15591 raft_consensus.cc:2376] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5. Re-sending same reply.
I20260709 13:05:15.454783 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.456542 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.457293 15586 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:05:15.458881 15585 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:15.463867 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:15.468488 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:15.400790 17439 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.483302 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.485040 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.485334 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.485723 15585 raft_consensus.cc:2376] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4. Re-sending same reply.
I20260709 13:05:15.486191 15592 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:15.474275 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.489012 15590 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:15.471369 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.482353 16180 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:15.490592 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:15.491297 15341 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 206) took 14428 ms (client timeout 15000 ms). Trace:
I20260709 13:05:15.491470 15586 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:15.497080 15510 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:15.489184 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.499972 15591 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:15.361841 17714 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:15.501202 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 163142us
I20260709 13:05:15.502092 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:15.460275 17691 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.507841 15583 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:15.510828 16146 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:15.523010 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.524061 15584 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:15.524341 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.525606 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:15.526202 15592 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:05:15.484761 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:15.535097 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:15.535841 15588 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:15.491782 15341 rpcz_store.cc:269] 0709 13:05:01.062487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.062765 (+   278us) service_pool.cc:224] Handling call
0709 13:05:15.491222 (+14428457us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:11.985798 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:11.986771 (+   973us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:11.986833 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:05:11.986860 (+    27us) tablet.cc:662] Decoding operations
0709 13:05:12.066427 (+ 79567us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:12.066579 (+   152us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:12.066631 (+    52us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:05:12.067529 (+   898us) tablet.cc:701] Row locks acquired
0709 13:05:12.067631 (+   102us) write_op.cc:260] PREPARE: finished
0709 13:05:12.067885 (+   254us) write_op.cc:270] Start()
0709 13:05:12.068184 (+   299us) write_op.cc:276] Timestamp: P: 1783602312067792 usec, L: 0
0709 13:05:12.068210 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:05:12.257302 (+189092us) log.cc:844] Serialized 2094 byte log entry
0709 13:05:12.825092 (+567790us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:13.309156 (+484064us) op_driver.cc:464] REPLICATION: finished
0709 13:05:13.864473 (+555317us) write_op.cc:301] APPLY: starting
0709 13:05:13.864642 (+   169us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:13.864853 (+   211us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:13.864897 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:13.916940 (+ 52043us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:13.951746 (+ 34806us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:05:13.951796 (+    50us) write_op.cc:312] APPLY: finished
0709 13:05:13.954568 (+  2772us) log.cc:844] Serialized 47 byte log entry
0709 13:05:13.954796 (+   228us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:13.954918 (+   122us) write_op.cc:454] Released schema lock
0709 13:05:13.954990 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:13.955414 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:13.955442 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3708892,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":526679,"apply.run_cpu_time_us":3971,"apply.run_wall_time_us":104559,"num_ops":5,"prepare.queue_time_us":424467,"prepare.run_cpu_time_us":17727,"prepare.run_wall_time_us":560903,"raft.queue_time_us":645487,"raft.run_cpu_time_us":48924,"raft.run_wall_time_us":250592,"replication_time_us":1240739,"spinlock_wait_cycles":5591936,"thread_start_us":1003816,"threads_started":5,"wal-append.queue_time_us":334102}]]}
I20260709 13:05:15.548166 16175 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:15.551054 17710 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:15.551788 17710 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:15.552768 17710 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:15.554889 17628 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:15.555935 17628 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:15.556439 17628 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:15.545553 17636 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:05:15.556802 17628 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.490566 17439 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:15.562079 17439 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:15.560060 15584 pending_rounds.cc:85] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 1
I20260709 13:05:15.563329 15584 pending_rounds.cc:107] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:05:15.563829 15584 raft_consensus.cc:2889] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:15.568298 17726 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:15.569546 17726 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:15.575664 17764 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:05:15.579255 17749 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:15.581619 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:15.585371 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:15.586174 15441 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:15.598935 15592 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:15.571272 17726 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:15.616003 17751 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:15.648670 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50039us
I20260709 13:05:15.629853 15514 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:15.594023 15556 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:15.638861 15587 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 2.
I20260709 13:05:15.642580 15588 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:15.665144 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 71264.9us
I20260709 13:05:15.665863 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:15.666901 15588 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.528795 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:15.690268 15511 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:15.675371 17448 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:15.631310 17727 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:15.702224 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46118.6us
I20260709 13:05:15.637444 17726 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:15.705072 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.709487 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 198761us
I20260709 13:05:15.683948 17690 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:15.745085 15406 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:15.767580 16146 leader_election.cc:400] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5.
I20260709 13:05:15.768141 16146 leader_election.cc:403] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.731153 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:15.720369 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:15.712639 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 224021us
I20260709 13:05:15.770037 15514 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.779225 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:15.698246 17448 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:15.800304 15337 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 105) took 11983 ms (client timeout 15000 ms). Trace:
I20260709 13:05:15.710482 17751 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:15.792059 17548 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5.
I20260709 13:05:15.755312 17526 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:15.792946 17448 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.792588 17723 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:15.742720 17714 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:15.893812 17483 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:15.900481 15514 raft_consensus.cc:3055] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:15.926817 15514 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:15.906553 17745 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:05:15.911319 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 409214us
I20260709 13:05:15.916528 17686 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.919175 15588 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:15.936538 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.927479 15338 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 4 to 5, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 5 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:15.942783 17742 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:05:15.800807 15337 rpcz_store.cc:269] 0709 13:05:03.799733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.818387 (+ 18654us) service_pool.cc:224] Handling call
0709 13:05:15.782824 (+11964437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:14.850411 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:14.851112 (+   701us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:14.851151 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:05:14.851169 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:14.851572 (+   403us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:14.851634 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:14.851704 (+    70us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:14.851905 (+   201us) tablet.cc:701] Row locks acquired
0709 13:05:14.851931 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:05:14.852109 (+   178us) write_op.cc:270] Start()
0709 13:05:14.852242 (+   133us) write_op.cc:276] Timestamp: P: 1783602314852064 usec, L: 0
0709 13:05:14.852265 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:14.854529 (+  2264us) log.cc:844] Serialized 536 byte log entry
0709 13:05:15.128116 (+273587us) op_driver.cc:464] REPLICATION: finished
0709 13:05:15.233197 (+105081us) write_op.cc:301] APPLY: starting
0709 13:05:15.322395 (+ 89198us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:15.333824 (+ 11429us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:15.362782 (+ 28958us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:15.458067 (+ 95285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:15.499623 (+ 41556us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:15.506471 (+  6848us) write_op.cc:312] APPLY: finished
0709 13:05:15.518986 (+ 12515us) log.cc:844] Serialized 23 byte log entry
0709 13:05:15.519238 (+   252us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:15.519379 (+   141us) write_op.cc:454] Released schema lock
0709 13:05:15.519439 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:15.519955 (+   516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:15.520003 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3985478,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":91219,"apply.run_cpu_time_us":12129,"apply.run_wall_time_us":298587,"num_ops":1,"prepare.queue_time_us":223700,"prepare.run_cpu_time_us":3217,"prepare.run_wall_time_us":25162,"replication_time_us":273750,"thread_start_us":300870,"threads_started":2}]]}
I20260709 13:05:15.946070 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:15.951437 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 234631us
I20260709 13:05:15.927791 15514 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:15.968007 15514 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.966473 15338 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 9, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:15.971360 15338 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 4, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:15.975122 15441 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:15.802367 17708 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
W20260709 13:05:15.991811 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45959us
I20260709 13:05:15.998562 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:16.000641 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:15.979509 15338 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:05:15.999850 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86831.8us
W20260709 13:05:16.020522 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.731s (SENT)
I20260709 13:05:16.024250 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:16.018486 15338 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 4 to 5, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:16.037283 15338 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:16.039245 15338 catalog_manager.cc:5697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 5, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } }
W20260709 13:05:16.045188 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48431.9us
I20260709 13:05:16.009604 17526 raft_consensus.cc:2764] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:15.799619 17726 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:16.013917 17749 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:16.055905 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:16.013397 17723 raft_consensus.cc:697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:15.969067 17483 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:16.067857 15338 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 3 to 6, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:05:16.051028 17638 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.013s
I20260709 13:05:16.005321 17538 consensus_queue.cc:1059] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:05:16.112100 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.981599 17686 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:16.126360 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.125413 15338 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:16.128883 15338 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:16.075083 17749 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:16.107293 17765 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.413s	user 0.002s	sys 0.000s
I20260709 13:05:16.140938 15338 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:05:16.154676 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 111891us
I20260709 13:05:16.115828 17526 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:16.160392 15338 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 4 to 5, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:16.147106 16175 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:16.106786 17638 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:16.147251 17749 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:16.203742 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 183249us
I20260709 13:05:16.215871 17526 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:16.261798 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.263262 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:16.264313 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 286468us
I20260709 13:05:16.123627 17751 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:16.336007 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 324974us
W20260709 13:05:16.339854 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 76692.5us
I20260709 13:05:16.346956 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:16.348016 17526 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:16.348153 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:16.348634 17526 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:16.349260 17783 raft_consensus.cc:2764] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:16.349661 17526 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:16.350281 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:16.351135 17783 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:16.351683 17783 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:16.351804 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:16.352289 17783 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.352819 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:16.350961 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:16.345300 15585 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:05:16.344419 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.393350 17749 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:16.394919 15517 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:16.398088 17749 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:16.399245 17749 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:16.401117 17749 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:16.404855 15509 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:16.425467 17783 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:16.326013 17779 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.334226 17725 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.441586 15443 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:16.432158 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:16.345930 17679 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.010s
I20260709 13:05:16.437655 15509 pending_rounds.cc:85] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 4
I20260709 13:05:16.448946 15509 pending_rounds.cc:107] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:16.449397 15509 raft_consensus.cc:2889] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:16.347144 17686 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:16.439646 17784 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:05:16.465986 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 109842us
I20260709 13:05:16.335057 17792 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:05:16.485433 17686 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.197829 17723 consensus_queue.cc:237] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:16.468375 16146 leader_election.cc:336] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.688s (SENT)
I20260709 13:05:16.490329 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:16.516032 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.517252 17636 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.456223 17638 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:16.452987 17679 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:16.452682 17779 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:16.556528 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46867.4us
I20260709 13:05:16.675163 17774 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.854096 17526 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.854449 17774 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:16.854873 17526 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:16.648360 15555 leader_election.cc:336] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.758s (SENT)
I20260709 13:05:16.857167 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:16.762043 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 350122us
W20260709 13:05:16.760500 15586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.009s
W20260709 13:05:16.841100 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 456583us
W20260709 13:05:16.859647 15586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.009s	sys 0.012s
I20260709 13:05:16.864339 15584 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:05:16.502712 17690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.015s	sys 0.025s
W20260709 13:05:16.852360 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 499588us
I20260709 13:05:16.868727 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:16.857751 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.557324 17783 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:16.586862 17787 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:05:16.641256 17794 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:05:16.745491 17628 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.188s	user 0.015s	sys 0.000s
W20260709 13:05:16.684923 17784 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:05:16.864835 17790 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.626s	user 0.000s	sys 0.002s
I20260709 13:05:16.499073 17804 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:05:16.935361 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 66723.7us
I20260709 13:05:16.958233 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:16.958967 15585 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:16.958865 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:16.937407 15510 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:16.816413 17782 log.cc:927] Time spent T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:05:16.685158 17730 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.491966 17686 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:16.944649 15584 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:16.711653 17800 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.951948 17691 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:16.867744 17690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.020s	sys 0.027s
I20260709 13:05:16.966409 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:16.972116 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 323771us
W20260709 13:05:17.036919 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.771s (SENT)
I20260709 13:05:16.991113 15584 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:16.950933 17802 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:05:16.957104 17783 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.595009 17483 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:17.038858 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.800s (SENT)
I20260709 13:05:17.058130 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:16.587172 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:17.069274 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1768) took 1575 ms. Trace:
I20260709 13:05:17.069923 15591 rpcz_store.cc:276] 0709 13:05:15.493935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.500791 (+  6856us) service_pool.cc:224] Handling call
0709 13:05:15.501175 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.506388 (+  5213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.506419 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:15.530703 (+ 24284us) log.cc:844] Serialized 26 byte log entry
0709 13:05:15.677301 (+146598us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18004147c0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:05:15.852602 (+175301us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:16.147768 (+295166us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.148167 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.148334 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.068881 (+920547us) raft_consensus.cc:1685] finished
0709 13:05:17.068989 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.069180 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124178,"prepare.queue_time_us":462921,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":341739,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":11217,"spinlock_wait_cycles":6436096,"thread_start_us":288809,"threads_started":2,"wal-append.queue_time_us":802877}
I20260709 13:05:16.980976 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:16.737457 17749 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:16.954864 17628 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:17.095299 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56485.9us
W20260709 13:05:17.096779 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.890s (SENT)
W20260709 13:05:17.097942 15555 leader_election.cc:336] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.890s (SENT)
I20260709 13:05:17.103317 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:17.075407 17802 consensus_queue.cc:1243] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 6ff41728dec842afad5b53c20446a5a0 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:17.078466 17800 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:17.115891 15516 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:17.073554 17833 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:17.120654 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.082973 17526 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:17.127816 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 254266us
I20260709 13:05:17.132510 15585 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:17.133265 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 256210us
I20260709 13:05:17.136758 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:17.048137 17691 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.139642 15442 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:17.152124 15442 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:17.152734 15440 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
W20260709 13:05:17.150162 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 183871us
I20260709 13:05:17.156435 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:17.143392 15555 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.509s (SENT)
I20260709 13:05:17.159430 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:17.098618 16175 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:17.150432 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:17.144513 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1771) took 1649 ms. Trace:
I20260709 13:05:17.176016 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:17.115163 17774 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:17.138034 17795 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.014s	sys 0.026s
I20260709 13:05:17.186275 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:17.187693 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44354.3us
I20260709 13:05:17.167966 15442 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:17.173465 15586 rpcz_store.cc:276] 0709 13:05:15.496914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.525296 (+ 28382us) service_pool.cc:224] Handling call
0709 13:05:15.592464 (+ 67168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.593038 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.593080 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:15.617850 (+ 24770us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.028722 (+410872us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:16.160913 (+132191us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.860699 (+699786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.860824 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.144161 (+283337us) raft_consensus.cc:1685] finished
0709 13:05:17.144195 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.144415 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104763,"prepare.queue_time_us":375444,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":321356,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":194,"thread_start_us":1025865,"threads_started":3,"wal-append.queue_time_us":472107}
I20260709 13:05:17.128793 17804 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:17.135362 17833 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:17.152105 17650 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:17.208009 15442 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:17.205235 17795 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.015s	sys 0.026s
I20260709 13:05:17.198920 17526 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:17.200587 17783 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:17.201241 17793 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.270098 15442 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:05:17.261137 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 106537us
I20260709 13:05:17.214470 17800 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:17.207753 17818 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:17.243007 17679 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:17.299448 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 97827.7us
W20260709 13:05:17.331295 15555 leader_election.cc:336] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.998s (SENT)
W20260709 13:05:17.332546 15555 leader_election.cc:336] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.055s (SENT)
I20260709 13:05:17.333130 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:17.334657 15555 leader_election.cc:336] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.094s (SENT)
W20260709 13:05:17.272883 17790 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:05:17.301913 15443 raft_consensus.cc:606] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:17.302567 17723 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.214670 17833 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.301671 17713 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:17.285494 17800 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:17.335184 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:17.252126 17751 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.250455 17809 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:17.253387 17526 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:17.339342 17804 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:17.352133 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.121s (SENT)
I20260709 13:05:17.363270 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:17.364953 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.152s (SENT)
I20260709 13:05:17.365548 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:17.358032 17795 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:17.364476 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 224920us
I20260709 13:05:17.260512 17783 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:17.371500 17783 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:17.372653 15513 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:17.375759 17825 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:17.375494 17248 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:17.376050 15555 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.192s (SENT)
I20260709 13:05:17.376634 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:17.377640 17795 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:17.379068 17816 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:17.341946 17779 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:17.379853 17816 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.380406 17795 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:17.376643 17825 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:17.381047 17795 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:17.382632 17816 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:17.384348 17820 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:05:17.384986 17795 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:17.387836 17825 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.388229 17834 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.223s
I20260709 13:05:17.347784 17679 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:17.286608 17793 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:17.390188 15555 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.519s (SENT)
I20260709 13:05:17.409448 15512 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:17.454241 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:17.352667 17686 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:17.346710 17723 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.359483 17751 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.339443 17818 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:17.354743 17713 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:17.459404 15511 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:17.371652 17806 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:17.533313 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1767) took 2039 ms. Trace:
W20260709 13:05:17.509394 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 119289us
I20260709 13:05:17.850709 16180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 268) took 1889 ms. Trace:
W20260709 13:05:17.782267 17448 consensus_meta.cc:287] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.828s	user 0.013s	sys 0.006s
I20260709 13:05:17.813978 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 307) took 1382 ms. Trace:
I20260709 13:05:17.388517 17825 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.851997 17448 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.851501 16180 rpcz_store.cc:276] 0709 13:05:15.961519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.961660 (+   141us) service_pool.cc:224] Handling call
0709 13:05:16.004853 (+ 43193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.045413 (+ 40560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.045467 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.766286 (+720819us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b2c0001d2f8. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:05:16.820119 (+ 53833us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.131923 (+311804us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:17.131977 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.132087 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.850335 (+718248us) raft_consensus.cc:1685] finished
0709 13:05:17.850364 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.850599 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68419,"raft.queue_time_us":41064,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":9376,"spinlock_wait_cycles":17277696,"thread_start_us":263286,"threads_started":1,"wal-append.queue_time_us":976306}
I20260709 13:05:17.854777 17448 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:17.629683 17827 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.892232 17827 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.894804 17827 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:17.524004 17838 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:05:17.670866 17793 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:17.388502 17795 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.896992 17795 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:17.898486 17785 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 1.775s	user 0.015s	sys 0.010s
I20260709 13:05:17.900241 17795 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:17.900527 17726 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:17.362774 17526 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:17.663926 17846 log.cc:927] Time spent T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:05:17.669003 17691 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:17.858239 17751 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:17.353163 17800 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:17.361974 17730 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:17.812376 17848 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 13:05:17.673437 17727 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.969s	user 0.008s	sys 0.008s
I20260709 13:05:17.526568 17809 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:17.814764 17715 raft_consensus.cc:3055] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:17.539877 17832 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.539149 17805 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.317s	user 0.000s	sys 0.002s
W20260709 13:05:17.888090 17798 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 1.751s	user 0.016s	sys 0.000s
I20260709 13:05:17.846051 17841 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.854812 17825 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:17.749871 17771 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:17.762233 17783 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:17.976133 17833 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.000s
I20260709 13:05:17.956749 17832 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.963858 17841 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:17.982438 17841 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:17.979419 17832 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:18.042423 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 587028us
W20260709 13:05:18.046648 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 896073us
W20260709 13:05:18.048084 15441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.003s	sys 0.028s
W20260709 13:05:18.048681 15441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.004s	sys 0.029s
I20260709 13:05:18.053789 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:17.800896 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.022s	sys 0.041s
W20260709 13:05:18.062325 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.023s	sys 0.042s
I20260709 13:05:17.852447 15509 rpcz_store.cc:276] 0709 13:05:16.431215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.436868 (+  5653us) service_pool.cc:224] Handling call
0709 13:05:16.437381 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.450567 (+ 13186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.450625 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.454514 (+  3889us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.663778 (+209264us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:16.663820 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.663910 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.813634 (+1149724us) raft_consensus.cc:1685] finished
0709 13:05:17.813667 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.813878 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":208799,"threads_started":1,"wal-append.queue_time_us":1357005}
W20260709 13:05:18.063199 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 876989us
W20260709 13:05:17.851081 15555 leader_election.cc:336] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.543s (SENT)
I20260709 13:05:18.067215 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1772) took 1687 ms. Trace:
I20260709 13:05:18.067277 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:18.069098 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1783) took 2437 ms. Trace:
I20260709 13:05:18.069177 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1769) took 2574 ms. Trace:
W20260709 13:05:18.070516 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 219484us
I20260709 13:05:18.070683 15583 rpcz_store.cc:276] 0709 13:05:15.494159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.508684 (+ 14525us) service_pool.cc:224] Handling call
0709 13:05:15.509087 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.540973 (+ 31886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.541007 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:15.579186 (+ 38179us) log.cc:844] Serialized 26 byte log entry
0709 13:05:15.844561 (+265375us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:16.404531 (+559970us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.404815 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.404931 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.897523 (+1492592us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:18.068367 (+170844us) raft_consensus.cc:1685] finished
0709 13:05:18.068605 (+   238us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.068938 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116164,"prepare.queue_time_us":490623,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":488204,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":60220,"spinlock_wait_cycles":143410944,"thread_start_us":613207,"threads_started":2,"wal-append.queue_time_us":465205}
I20260709 13:05:18.066484 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:18.067874 15518 rpcz_store.cc:276] 0709 13:05:16.380028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.381246 (+  1218us) service_pool.cc:224] Handling call
0709 13:05:16.381637 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.868002 (+486365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.868055 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.868891 (+   836us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.157219 (+288328us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:17.157276 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.157369 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.066313 (+908944us) raft_consensus.cc:1685] finished
0709 13:05:18.066382 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.066815 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208285,"raft.run_cpu_time_us":555,"raft.run_wall_time_us":31362,"thread_start_us":659516,"threads_started":2,"wal-append.queue_time_us":307518}
W20260709 13:05:18.075286 15555 leader_election.cc:336] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.549s (SENT)
I20260709 13:05:18.069840 15587 rpcz_store.cc:276] 0709 13:05:15.643315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.935089 (+291774us) service_pool.cc:224] Handling call
0709 13:05:15.935648 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.936170 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.936210 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:15.936895 (+   685us) log.cc:844] Serialized 26 byte log entry
0709 13:05:15.993386 (+ 56491us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:16.464493 (+471107us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.515427 (+ 50934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.515575 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.887169 (+1371594us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:17.896058 (+  8889us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b1800413f80. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:18.068405 (+172347us) raft_consensus.cc:1685] finished
0709 13:05:18.068446 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.068768 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146772,"prepare.queue_time_us":415500,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":727565,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":276,"spinlock_wait_cycles":28521088,"thread_start_us":368363,"threads_started":2,"wal-append.queue_time_us":120723}
I20260709 13:05:18.076045 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:17.755026 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1785) took 2111 ms. Trace:
I20260709 13:05:18.078526 15589 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:17.850422 15590 rpcz_store.cc:276] 0709 13:05:15.493709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.498942 (+  5233us) service_pool.cc:224] Handling call
0709 13:05:15.513186 (+ 14244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.527015 (+ 13829us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:15.898073 (+371058us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.193071 (+294998us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.374769 (+1181698us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800414160. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd61716 00007fcf7bd72287 00007fcf7bd72208
0709 13:05:17.377365 (+  2596us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b1800414160. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:17.532688 (+155323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:17.532778 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:17.532880 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.532989 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.533203 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":397616,"prepare.queue_time_us":996354,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":98,"raft.queue_time_us":501607,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":81324,"spinlock_wait_cycles":75242368,"thread_start_us":675975,"threads_started":4,"wal-append.queue_time_us":333774}
I20260709 13:05:18.081303 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1778) took 2541 ms. Trace:
I20260709 13:05:18.078361 15588 rpcz_store.cc:276] 0709 13:05:15.644086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.966504 (+322418us) service_pool.cc:224] Handling call
0709 13:05:15.966930 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.133350 (+166420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.133387 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.135276 (+  1889us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.335813 (+200537us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:16.335856 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.335931 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.754690 (+1418759us) raft_consensus.cc:1685] finished
0709 13:05:17.754720 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.754932 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":272650,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":365244,"threads_started":2,"wal-append.queue_time_us":1549093}
I20260709 13:05:18.081938 15592 rpcz_store.cc:276] 0709 13:05:15.539491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.728301 (+188810us) service_pool.cc:224] Handling call
0709 13:05:15.728818 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.950780 (+221962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.950815 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:15.972788 (+ 21973us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.155240 (+182452us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:16.263176 (+107936us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.263394 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.263480 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.080601 (+1817121us) raft_consensus.cc:1685] finished
0709 13:05:18.080645 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.081040 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218786,"prepare.queue_time_us":305598,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":533941,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":45196,"thread_start_us":323142,"threads_started":2,"wal-append.queue_time_us":857084}
I20260709 13:05:17.481783 17628 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.089987 17628 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:18.090708 17448 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:18.092096 17448 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:18.091286 17628 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.093267 17483 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.094156 17483 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:18.096918 15555 leader_election.cc:336] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.559s (SENT)
I20260709 13:05:18.097239 17628 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.097962 17628 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:18.098887 17628 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:17.460742 17679 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:17.649533 17686 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.850735 17818 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:18.105278 17686 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.990612 17783 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:17.951335 17715 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:17.967484 17771 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:17.991690 17833 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.109491 17855 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:18.122850 17855 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:18.123306 17706 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:18.124560 17706 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.111655 17723 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.103212 17628 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:17.950753 17730 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.117563 17715 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.107389 17679 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.111697 17783 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:18.123461 17855 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.129827 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1763) took 2208 ms. Trace:
I20260709 13:05:18.128234 17712 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.131270 17815 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:18.099057 15555 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.606s (SENT)
I20260709 13:05:18.151913 17686 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:18.153960 17833 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:18.160835 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 115835us
I20260709 13:05:18.124720 17713 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.171221 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:18.175424 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 109243us
I20260709 13:05:18.177266 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:18.178791 17715 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.179255 17854 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:18.185837 17859 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:18.188277 17783 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.191273 17712 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.192544 17706 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.193882 17730 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.195268 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1768) took 1847 ms. Trace:
I20260709 13:05:18.200891 15517 rpcz_store.cc:276] 0709 13:05:16.347324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.347491 (+   167us) service_pool.cc:224] Handling call
0709 13:05:16.348051 (+   560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.395365 (+ 47314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.194598 (+1799233us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b54000ebd54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:18.195043 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107255040}
I20260709 13:05:18.204866 17771 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.205879 17712 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:18.207597 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 108659us
W20260709 13:05:18.208703 15555 leader_election.cc:336] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.692s (SENT)
I20260709 13:05:18.208770 17825 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:18.209408 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:18.209808 17825 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.210665 17818 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:18.210768 17825 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.213063 17815 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:18.214916 17825 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:18.198500 17752 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:18.209872 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44656 (request call id 19) took 1723 ms. Trace:
I20260709 13:05:18.216244 17818 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:18.217031 17752 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:18.217571 17752 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:18.217657 17783 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.217305 17818 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.206393 17859 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:18.197328 17526 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.215942 15443 rpcz_store.cc:276] 0709 13:05:16.485957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.494681 (+  8724us) service_pool.cc:224] Handling call
0709 13:05:18.209359 (+1714678us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400302ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd51853 00007fcf80d1f60a 00007fcf7a2a57d4 00007fcf7a2a5762 00007fcf7a2a5691 00007fcf7a2a560c 00007fcf7a2a48c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:18.209524 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557825920}
I20260709 13:05:18.225448 17818 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.225603 17833 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:18.226263 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1751) took 2640 ms. Trace:
I20260709 13:05:18.226495 17809 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:18.227731 17727 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:18.251645 17833 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:18.251461 15516 rpcz_store.cc:276] 0709 13:05:15.586010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.586163 (+   153us) service_pool.cc:224] Handling call
0709 13:05:15.615190 (+ 29027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.121941 (+1506751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.225714 (+1103773us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002a2e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:18.225997 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3450714368}
I20260709 13:05:18.252099 17809 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.253348 17833 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.257498 15513 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:18.262543 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.255316 17809 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.265669 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 310) took 1630 ms. Trace:
I20260709 13:05:18.266287 15514 rpcz_store.cc:276] 0709 13:05:16.635219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.263884 (+1628665us) service_pool.cc:224] Handling call
0709 13:05:18.264616 (+   732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.264944 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.264972 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:18.265053 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:18.265160 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.265251 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.265402 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:18.268375 15589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1747) took 2851 ms (client timeout 1758 ms). Trace:
W20260709 13:05:18.268987 15589 rpcz_store.cc:269] 0709 13:05:15.416546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.442913 (+ 26367us) service_pool.cc:224] Handling call
0709 13:05:18.268004 (+2825091us) spinlock_profiling.cc:243] Waited 2.63 s on lock 0x7b54001f4d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:18.268224 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6057407360}
I20260709 13:05:18.230789 17752 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.271133 17802 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.272092 17802 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.274678 17802 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.228507 17448 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:18.219326 17859 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:18.276811 17859 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.252095 17727 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.278877 17859 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:18.266191 17679 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:18.165308 15510 rpcz_store.cc:276] 0709 13:05:15.920945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.921101 (+   156us) service_pool.cc:224] Handling call
0709 13:05:15.921388 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.961005 (+1039617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.129025 (+1168020us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400213c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:18.129554 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335957888}
I20260709 13:05:18.233527 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 210) took 1098 ms. Trace:
W20260709 13:05:18.224623 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47689.9us
I20260709 13:05:18.236671 17691 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:18.246228 17483 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:18.246912 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.219063 17686 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:18.209913 17723 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:05:18.250558 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:18.232144 15555 leader_election.cc:336] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.705s (SENT)
I20260709 13:05:18.296825 17752 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.299723 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:18.301023 17691 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:18.301481 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69453.2us
I20260709 13:05:18.303176 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:18.303639 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:18.304148 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.304360 17526 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.305068 15442 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:18.309383 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:18.312132 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:18.314213 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:18.315974 17483 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.316960 17483 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.317476 15514 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:18.319777 17448 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.319988 17526 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:18.320591 17448 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.320941 17783 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:18.321195 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.322212 15516 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
W20260709 13:05:18.324323 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.818s (SENT) [suppressed 87 similar messages]
W20260709 13:05:18.348563 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:18.348802 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 295289us
I20260709 13:05:18.349933 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.351120 15442 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:18.352530 17749 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:18.353214 17869 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:18.354846 17749 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:18.349911 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:18.357623 17873 consensus_queue.cc:1059] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:18.358837 17875 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:18.361308 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:18.363744 17873 raft_consensus.cc:3055] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:18.364428 17873 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:18.368590 17875 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:18.369210 17875 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:18.369379 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:18.321830 17783 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:18.371594 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.372033 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.372705 15438 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:18.373315 17783 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.374439 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.321424 17526 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:18.375396 17731 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:18.370633 17875 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.376839 17526 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.377975 17875 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:18.359264 17716 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:18.379338 17716 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:18.374454 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:18.381022 15434 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.350104 17483 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.326047 17727 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:18.284420 15441 rpcz_store.cc:276] 0709 13:05:17.134615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.134830 (+   215us) service_pool.cc:224] Handling call
0709 13:05:17.135411 (+   581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.288310 (+152899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.288399 (+    89us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.289058 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.049490 (+760432us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:18.050399 (+   909us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.161215 (+110816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.168932 (+  7717us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.169010 (+    78us) raft_consensus.cc:1685] finished
0709 13:05:18.169025 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.233002 (+ 63977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94590,"prepare.queue_time_us":56508,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":1121118,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":453,"thread_start_us":877371,"threads_started":3,"wal-append.queue_time_us":478507}
I20260709 13:05:18.399919 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.404510 15440 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:18.401734 15518 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:18.408046 15518 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:18.408273 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.409287 15518 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.410567 15518 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:18.408068 17877 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:05:18.413820 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 89552.6us
I20260709 13:05:18.418534 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.417351 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:18.334774 17679 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.417179 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.389514 17686 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.431018 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.433496 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.439666 15589 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:18.432590 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:18.443815 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.444559 15516 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:18.448031 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.448875 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:18.451980 17869 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:18.453087 17869 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:18.458619 17869 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:18.448307 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 68870.2us
I20260709 13:05:18.448167 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.461486 15438 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 1.
I20260709 13:05:18.461855 15407 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:18.437263 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:18.463369 15435 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:18.443802 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.457080 15442 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
W20260709 13:05:18.464295 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.894s (SENT)
I20260709 13:05:18.457811 17448 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:18.448173 15437 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:18.367311 17873 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.463490 17731 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:18.420401 17855 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.467886 15513 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:18.485834 17873 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.496891 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.501513 15434 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:18.513813 17712 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:18.516714 17712 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:18.518410 17712 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.508509 17833 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.520921 17833 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.521396 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:18.524693 15516 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:18.526897 15513 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:18.472242 15583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "562c25b8842b442a928630e10d13e618"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:37000
I20260709 13:05:18.528218 17833 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.537221 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:18.537354 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 75627.5us
W20260709 13:05:18.542045 17726 consensus_meta.cc:287] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.641s	user 0.000s	sys 0.025s
I20260709 13:05:18.542937 17815 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:18.544162 17815 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:18.544859 17815 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:18.546041 17815 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.552145 15583 raft_consensus.cc:606] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:18.552865 15583 raft_consensus.cc:614] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:18.538928 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:18.544869 15517 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:18.572364 17870 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:18.544085 17855 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.582803 17726 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:18.585368 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 149023us
I20260709 13:05:18.576609 17870 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:18.591406 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 52705us
I20260709 13:05:18.592761 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:18.594411 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:18.595252 17716 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:18.595580 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.595834 17871 raft_consensus.cc:2764] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:18.596092 17874 consensus_queue.cc:1059] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:05:18.597036 17849 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.597595 17874 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:18.598074 17874 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:18.597713 17849 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.599699 17835 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.599378 17874 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.600207 17835 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:18.600899 17874 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.601277 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:18.602129 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 78933.5us
I20260709 13:05:18.603778 17715 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:18.604234 17715 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.604633 17715 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:18.604851 16181 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:18.607678 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:18.608629 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 97135.7us
I20260709 13:05:18.609562 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:18.610538 17691 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:18.610664 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:18.611096 17691 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.611833 17727 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:18.574517 17731 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:18.603215 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:18.612039 17448 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:18.604228 17800 consensus_meta.cc:287] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.573s	user 0.015s	sys 0.009s
I20260709 13:05:18.617022 17727 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.619956 17448 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.620306 17727 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.620462 17448 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.621608 17870 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.589939 17833 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:05:18.623800 17712 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.611845 17691 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:18.626209 17834 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:18.626799 17834 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.627193 17834 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:18.618417 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.620126 17800 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:18.589273 17815 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:18.646600 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:18.647454 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:18.653251 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45361.9us
W20260709 13:05:18.675043 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.674862 15556 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:18.705113 15517 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:18.747817 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 73049.9us
I20260709 13:05:18.749279 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:18.749075 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:18.760778 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45448.8us
I20260709 13:05:18.717774 17679 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.780015 15518 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:05:18.780568 15518 pending_rounds.cc:85] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:05:18.788713 15518 pending_rounds.cc:107] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:05:18.793735 15518 raft_consensus.cc:2889] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:18.793919 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:18.794839 15437 raft_consensus.cc:606] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:18.800757 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.788919 17686 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:18.807731 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.768275 17774 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
W20260709 13:05:18.825613 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.743718 17833 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:05:18.714120 17726 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:18.781014 17825 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:18.843986 17825 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.844544 17825 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:18.845916 17726 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:18.847949 17725 raft_consensus.cc:2764] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:18.833930 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:18.858296 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:18.859514 17809 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:18.860090 17809 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.860515 17809 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:18.840029 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 80368.9us
W20260709 13:05:18.819025 15555 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.683s (SENT)
W20260709 13:05:18.842454 17885 log.cc:927] Time spent T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
W20260709 13:05:18.879513 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.145077 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:19.134742 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 430848us
I20260709 13:05:18.869141 15510 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:18.863128 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:19.154261 17815 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.013s
W20260709 13:05:19.031458 17869 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.016s
W20260709 13:05:18.840018 17859 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.009s
W20260709 13:05:19.147406 17727 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.014s
W20260709 13:05:19.172966 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 379603us
I20260709 13:05:19.084599 17686 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:19.155086 17873 consensus_meta.cc:287] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.007s
W20260709 13:05:19.150147 17874 consensus_meta.cc:287] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.549s	user 0.019s	sys 0.009s
I20260709 13:05:19.128072 17800 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:05:18.976061 17795 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.977026 17483 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:19.200937 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 438884us
I20260709 13:05:18.864061 17849 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:18.987337 17715 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:19.211912 17483 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.214462 17483 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.214677 17709 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:19.215301 17709 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:19.217787 17709 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:19.218616 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.215204 17483 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:19.221771 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.883s (SENT)
I20260709 13:05:19.222872 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:19.181183 17727 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.206807 17795 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:19.208024 17448 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.582s	user 0.030s	sys 0.013s
I20260709 13:05:18.975234 17834 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:19.229681 17712 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.010s
I20260709 13:05:19.180233 17869 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:19.263247 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.278512 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 81634.8us
W20260709 13:05:19.263739 17875 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.009s
W20260709 13:05:19.269601 17691 consensus_meta.cc:287] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.002s
I20260709 13:05:19.234810 17448 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.295097 17483 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:19.320168 15511 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:19.325605 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 115054us
I20260709 13:05:19.309108 17483 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.300225 17691 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.330242 17483 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:19.338418 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:19.339187 15514 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:19.320415 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.348337 17834 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:19.353538 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.943s (SENT)
I20260709 13:05:19.354379 17869 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:19.359513 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:19.365597 17448 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:19.369401 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.326413 17795 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.367242 17835 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:19.373420 16146 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.579s (SENT)
I20260709 13:05:19.388425 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:19.364055 17875 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:19.363291 17727 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:19.394423 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 84442.1us
W20260709 13:05:19.394551 17892 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:05:19.388444 17715 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.394338 17448 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:19.403483 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62148.1us
I20260709 13:05:19.392877 17875 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:19.411166 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:19.381690 17712 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:05:19.387043 17874 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 13:05:19.419499 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.405642 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:19.415998 17859 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.434523 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:19.414310 17875 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:19.455937 15515 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:19.469842 17686 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:19.470508 17686 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:19.479746 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:19.480500 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:19.481195 15511 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:19.481887 15514 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:19.485178 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.486809 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.487282 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.428668 15555 connection.cc:256] RPC call timeout handler was delayed by -1.0299253010000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 13:05:19.493295 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.427275 17834 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:19.430173 17815 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:05:19.499444 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 3.195s (SENT)
I20260709 13:05:19.412575 17835 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:05:19.513986 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:19.525911 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 152544us
W20260709 13:05:19.529398 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 666353us
I20260709 13:05:19.530452 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:19.534114 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 224) took 1217 ms. Trace:
I20260709 13:05:19.502220 17815 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:19.518461 17859 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:19.540675 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.541074 16146 leader_election.cc:336] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.735s (SENT)
I20260709 13:05:19.538982 15556 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:19.550629 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:19.534590 15588 rpcz_store.cc:276] 0709 13:05:18.310872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.339753 (+ 28881us) service_pool.cc:224] Handling call
0709 13:05:18.368036 (+ 28283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.368916 (+   880us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:18.581077 (+212161us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.939532 (+358455us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.047448 (+107916us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.047689 (+   241us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:19.047735 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.047826 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.527637 (+479811us) raft_consensus.cc:1685] finished
0709 13:05:19.527671 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.527868 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29850,"prepare.queue_time_us":361162,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2140,"raft.queue_time_us":54416,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":318,"thread_start_us":421831,"threads_started":2,"wal-append.queue_time_us":640008}
I20260709 13:05:19.544833 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:19.600268 15510 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:19.536836 17727 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:19.612599 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 185602us
I20260709 13:05:19.543819 17859 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:19.620671 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 88353.4us
I20260709 13:05:19.597098 17873 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:19.540388 17834 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 13:05:19.632947 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 136235us
I20260709 13:05:19.636555 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:19.615178 17795 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.628090 17859 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:19.614676 17894 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:19.629400 17873 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:19.633991 17709 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:19.663026 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 135480us
I20260709 13:05:19.677495 15511 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:19.679073 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:19.655872 17691 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.663506 17873 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.636200 17727 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.707937 17899 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.708405 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:19.708647 17899 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.709069 15443 raft_consensus.cc:606] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:19.709431 15443 raft_consensus.cc:614] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:19.676075 17841 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.195s
I20260709 13:05:19.684902 17815 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.686965 17834 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:19.662348 17894 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.710902 17899 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.712085 17835 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.703048 17875 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.732851 17835 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.713225 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:19.736555 15443 raft_consensus.cc:606] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:19.736999 15443 raft_consensus.cc:614] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:19.714450 17825 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.005s
W20260709 13:05:19.729516 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 99732.7us
W20260709 13:05:19.740464 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 334924us
I20260709 13:05:19.739359 17825 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.735255 17875 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:19.678915 17448 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.729012 17815 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.731279 17727 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.664400 17795 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.731828 17834 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:19.731662 17894 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.728684 17900 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.728214 17896 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:19.765326 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 138414us
I20260709 13:05:19.714740 17483 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.780831 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:19.788185 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:19.791344 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:19.792788 15434 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:19.798035 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:19.798832 15440 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:19.798954 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:19.799943 15438 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:19.801148 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:19.802205 15437 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:19.753110 17448 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:19.752436 17691 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:19.807060 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:19.808174 15443 raft_consensus.cc:606] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:19.814060 15443 raft_consensus.cc:614] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:19.772555 17875 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:19.773877 17835 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:19.775400 17894 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:19.825558 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 137446us
I20260709 13:05:19.825297 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:19.825796 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:19.806391 17448 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.828176 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:19.829478 15439 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:19.835462 15434 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:19.813127 17900 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:19.840844 15435 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:05:19.847695 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.838725 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80296.4us
I20260709 13:05:19.842622 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.809341 17686 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:19.853104 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 97380.3us
I20260709 13:05:19.849706 15586 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
W20260709 13:05:19.862264 15555 connection.cc:256] RPC call timeout handler was delayed by -1.0823457249999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:05:19.868408 15555 connection.cc:256] RPC call timeout handler was delayed by -1.0428040379999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:05:19.821388 17691 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.874776 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:19.893046 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:19.878937 17825 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.880488 17795 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.884714 17905 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:19.866035 17834 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:19.890126 17686 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:19.893857 16180 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:19.904665 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.851025 17875 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:05:19.869336 17906 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:19.937343 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.938176 15587 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:19.939868 15587 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:19.940300 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.941210 15591 raft_consensus.cc:2368] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4.
I20260709 13:05:19.941269 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:19.941954 15587 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:19.944207 17483 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.943486 17859 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.947945 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.948591 15442 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:19.949443 16175 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:19.950879 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.951162 17859 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:19.927508 17825 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:19.900595 17894 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.955466 17691 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.953477 17906 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.956019 17825 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.970325 17825 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:19.922991 17809 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.062s	user 0.015s	sys 0.004s
I20260709 13:05:19.951472 15587 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:19.958262 15590 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:19.956125 17686 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:19.975579 15440 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:19.975972 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.976879 15586 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:19.925267 17911 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:19.971689 17909 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:05:19.978828 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 128596us
I20260709 13:05:19.981030 15589 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:19.967315 17906 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.956745 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.957321 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:19.957785 17894 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:19.971107 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:19.999984 15584 raft_consensus.cc:2368] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5.
I20260709 13:05:19.990497 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.001677 15586 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.002938 15438 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:19.975437 17896 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:19.925633 17905 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.040249 17905 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:20.042054 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.016296 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:20.018694 17900 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:19.987032 17686 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.029136 15588 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:20.030579 17873 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:20.031160 17870 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.031533 17896 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.037379 17448 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:19.977873 17809 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:20.044900 15592 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:20.020123 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49190.7us
I20260709 13:05:20.016111 15585 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:20.023591 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:20.048045 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.065133 15587 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.048388 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.021080 17912 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:20.047585 15556 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.070380 15584 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.070890 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.071659 15585 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.076516 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.081447 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:20.078740 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 55275.1us
I20260709 13:05:20.082397 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.000789 17911 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:20.083251 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 181158us
I20260709 13:05:20.083444 15438 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:20.089637 15583 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:20.086231 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.091449 15588 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.087471 15591 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:20.088433 15437 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.020886 17859 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:05:20.089558 15440 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:20.100497 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.101336 15439 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:20.102298 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.102653 17859 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:20.103044 17859 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:20.097131 17779 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:05:20.059736 17870 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:20.107755 15555 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.055s (SENT)
I20260709 13:05:20.108398 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:20.107834 17870 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:20.109356 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:20.109961 17894 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:20.110069 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:20.111821 15555 leader_election.cc:336] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.093s (SENT)
I20260709 13:05:20.113303 17841 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:20.113513 17875 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.115428 17873 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:20.085462 17904 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:20.121285 17835 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:20.125164 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.126034 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.157400 15436 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:20.157480 15440 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:20.126430 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.127944 15443 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:20.127799 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.128908 15513 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:20.158602 15435 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.128784 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:20.096987 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:20.169445 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 72554us
W20260709 13:05:20.144486 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.149397 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.150825 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:20.152746 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.172547 15583 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:20.172709 17906 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:20.172978 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61234.9us
I20260709 13:05:20.155050 15437 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:20.170917 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.161899 15587 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:20.119448 15586 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:20.171334 15585 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:20.185189 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:20.186761 15589 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:20.188977 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:20.196614 15590 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.144937 17894 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:20.199277 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.204512 15438 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:20.151809 17904 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.185189 17483 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.210918 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:20.211333 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:20.211577 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:20.212132 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:20.128937 16175 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:20.169888 17835 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.213852 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.225971 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:20.222067 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.229787 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:20.300568 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.302210 15586 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:20.185914 17905 raft_consensus.cc:2764] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:05:20.304104 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 86104.9us
W20260709 13:05:20.306555 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 196012us
I20260709 13:05:20.221019 17904 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:20.214948 17774 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:20.317266 15591 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.223493 17691 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:20.321589 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.324954 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:20.311779 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:20.329144 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.305449 17835 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:20.331171 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.330556 15556 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.329941 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:20.337495 15516 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:20.338925 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.342085 15589 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:20.346928 15511 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:20.221208 17894 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.321929 17686 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:20.324559 17774 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:20.350461 15510 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:20.299803 17483 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.332840 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:20.356081 17911 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:20.355774 17691 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:20.356709 17913 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:20.344542 17825 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:20.228606 17859 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:20.369575 15556 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:20.371896 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.364257 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.378371 15586 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.380767 16180 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:20.380089 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:20.384006 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 247165us
I20260709 13:05:20.388550 15583 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:20.389621 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:20.390215 15583 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
W20260709 13:05:20.391526 15482 connection.cc:256] RPC call timeout handler was delayed by -4.2034336940000685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 13:05:20.392939 15482 connection.cc:256] RPC call timeout handler was delayed by -3.6631843530000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:05:20.393517 15482 connection.cc:256] RPC call timeout handler was delayed by -3.3481843529999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 13:05:20.393893 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2069843530000526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33370000000000005s for a response
I20260709 13:05:20.377794 17686 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:20.404111 15514 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:20.411928 15592 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:20.381412 17896 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:20.380005 17913 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:20.383677 17727 raft_consensus.cc:2764] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:20.405426 17686 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.428952 15435 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:20.384119 17825 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:20.442196 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:20.419078 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.441226 17483 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:20.413976 17906 raft_consensus.cc:2764] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:20.448443 15586 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:20.465250 15592 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.455077 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:20.474308 15509 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:20.440568 17859 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:20.478031 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 108671us
I20260709 13:05:20.454099 17686 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:20.482813 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:20.489166 15585 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:20.483430 17483 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:20.484145 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.484766 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:20.490978 15586 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:20.484202 17927 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:05:20.493434 15588 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:20.486908 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:20.481616 17920 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.326s	user 0.001s	sys 0.001s
I20260709 13:05:20.505074 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.513618 15592 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:20.479976 17931 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.519136 17825 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:20.521821 17922 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:05:20.531953 15584 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:20.533859 15586 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:20.528173 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:20.506884 17874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.020s	sys 0.018s
I20260709 13:05:20.523993 17903 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:20.472090 17774 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:20.549018 17774 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.549382 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.548583 17903 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:20.559122 15514 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.560402 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.561062 17903 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:20.503798 17899 raft_consensus.cc:2764] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:20.561951 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.567718 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.566398 15591 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:20.551030 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.568820 15441 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.533293 17931 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.585352 15435 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:20.516058 17896 raft_consensus.cc:2764] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:05:20.562585 17874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.021s	sys 0.019s
W20260709 13:05:20.595460 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 64112.2us
I20260709 13:05:20.572566 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.594060 15516 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:20.597390 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.600771 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.601686 15590 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:20.602926 17849 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:20.603406 17849 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:20.486080 17691 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.608630 15434 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:20.608711 15518 raft_consensus.cc:2368] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5.
I20260709 13:05:20.603892 15442 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:20.603718 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.620100 15516 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:20.620919 15514 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.622051 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.626847 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.629696 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.622850 17935 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:05:20.636423 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.642347 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.643235 15516 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.643862 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.645222 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:20.645280 15436 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:20.645890 15514 raft_consensus.cc:2368] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:20.646731 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.604453 17849 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:20.648344 17849 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.648520 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.649050 17903 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:20.649513 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:20.649816 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.650545 15516 raft_consensus.cc:2368] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:20.650462 17911 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.652029 17903 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:20.652716 17903 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:20.653762 17903 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.654347 17924 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:20.654595 15434 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:20.654790 17924 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:20.655803 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.656586 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.658035 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.659184 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.659945 15516 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.661113 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.661288 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.662442 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.612807 17894 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:20.646770 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.666682 15509 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:20.663762 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.672420 15436 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:20.673605 15516 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.676519 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:20.607933 17931 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:20.680815 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.587904 17913 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.689409 17712 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:20.690079 17712 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:20.655804 17924 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.682422 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.694972 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.699163 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:20.703675 15516 raft_consensus.cc:2368] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:20.703789 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.705171 15589 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:20.714450 15435 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:20.720981 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.722249 15437 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:20.724366 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.726039 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.737059 15436 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:20.737246 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.738365 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.727247 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.740089 15513 raft_consensus.cc:2393] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.740777 17835 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:20.727687 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.728948 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.739212 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:20.727644 17945 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:20.741053 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.744108 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.745842 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.747323 15509 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:20.749168 17448 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:20.749732 15436 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:20.751057 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.751264 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:20.766710 15583 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:20.756951 15435 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:20.752247 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.760181 15518 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.763512 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.776394 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.776400 15439 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.778033 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.777272 15556 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.779311 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.780117 15516 raft_consensus.cc:2368] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:20.781242 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.776477 15512 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:20.784739 15556 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.786964 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:20.788532 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:20.751924 17709 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:20.789273 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.786948 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.794521 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.795831 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.796584 15435 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:20.789947 15556 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.799923 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.801730 15556 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.802963 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.799979 15512 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.806140 15512 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:20.800859 15518 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:05:20.787937 17691 raft_consensus.cc:2764] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:20.811832 15516 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:20.798432 17900 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:20.818480 15516 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:20.818576 17483 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:20.824295 17483 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:20.825219 17483 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.797127 17709 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:20.779219 17448 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:05:20.797847 17825 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:20.806769 17896 raft_consensus.cc:2764] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:20.821702 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:20.821759 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.800263 17905 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:20.835639 17905 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.835920 17900 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:20.836412 17905 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:20.837306 17900 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.840905 17825 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:20.842257 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.842129 17825 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:20.843732 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.845479 15440 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:20.846864 15440 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:20.849692 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:20.850334 17904 consensus_meta.cc:287] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
I20260709 13:05:20.851217 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.817836 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.817277 15509 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:20.823303 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:20.805910 17944 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:20.861876 17712 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.865084 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:20.860700 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:20.850781 17904 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:20.874708 15441 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:20.865940 15442 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:20.877413 15441 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:20.877278 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.871479 15406 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:20.860533 15516 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.869582 17944 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:20.863407 17712 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.859357 15512 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:20.917052 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:20.923290 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.936297 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.887917 15435 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.961077 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:20.965127 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 165905us
I20260709 13:05:20.966794 15591 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:20.886917 17911 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:20.964779 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56005.2us
I20260709 13:05:20.964285 15442 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:20.933132 17946 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:05:20.996718 15439 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:20.998518 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:20.998710 15510 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:20.907822 17928 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:20.995594 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:21.000443 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 681265us
I20260709 13:05:21.003098 15516 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:20.916337 17896 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:20.932318 17904 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:20.968313 17911 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.010042 15435 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:21.012612 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:20.962890 17709 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:21.028180 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.002774 17928 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.010104 17913 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.039523 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.034144 15516 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
W20260709 13:05:21.035959 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.018877 17939 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:21.042742 15515 raft_consensus.cc:2410] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:21.050932 15516 pending_rounds.cc:85] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:21.025792 17935 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:21.025918 17911 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.025602 17896 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:21.053532 15516 pending_rounds.cc:107] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:05:21.055027 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.039048 15337 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 4 to 7, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:21.039145 17709 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.038057 17928 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:21.096160 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 81115.4us
I20260709 13:05:21.063839 15516 raft_consensus.cc:2889] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:21.102768 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 123820us
I20260709 13:05:21.099298 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:21.104120 16180 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:21.076506 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.070457 15511 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:21.103120 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.111385 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.052788 17939 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.120744 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.073284 17935 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:21.130918 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.057708 17933 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:21.111521 17686 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.616s	user 0.014s	sys 0.000s
I20260709 13:05:21.134797 17686 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.136358 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:21.141124 15592 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:21.144467 15588 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:21.146464 17859 consensus_meta.cc:287] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.003s
I20260709 13:05:21.140589 16182 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:21.119401 17939 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:21.158171 15588 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:21.162714 15587 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:21.166160 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.168257 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:21.173640 15511 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:21.173643 16182 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:05:21.169621 17952 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:05:21.174422 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.136590 17913 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:21.181959 15436 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:21.177106 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.184049 15588 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:21.188321 15509 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.194326 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:21.195006 15555 leader_election.cc:336] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.907s (SENT)
I20260709 13:05:21.195225 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:21.201788 17955 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:05:21.204913 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.206102 15588 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:21.208169 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.186776 17873 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.218623 17873 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.219933 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.220782 15516 raft_consensus.cc:2368] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:21.214668 15590 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:21.208173 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.207499 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.216910 17686 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:21.214517 17935 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.287448 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:21.299954 15407 connection.cc:256] RPC call timeout handler was delayed by -2.6030596839999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
I20260709 13:05:21.268244 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.303566 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:21.303653 15588 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:21.269080 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.255304 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.302582 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.304067 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.263739 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.271018 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:21.307816 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:21.307361 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 112394us
I20260709 13:05:21.308890 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:21.309998 15443 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:21.311797 16180 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 2: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:21.311962 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:21.260466 17905 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.317981 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:21.318811 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.319465 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:21.326762 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.327239 15516 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.328120 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.328889 15514 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.329164 15443 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:21.300426 17859 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:21.330464 17859 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.330799 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.332722 17859 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:21.321297 15518 raft_consensus.cc:2393] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.223917 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.197913 17944 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:21.326107 17915 raft_consensus.cc:2764] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:21.335027 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.340148 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:21.344182 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.146s (SENT)
I20260709 13:05:21.221091 17873 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:21.251304 17727 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:21.349123 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.354234 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.377017 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.380506 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.387840 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.391284 15511 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.392233 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.393471 15510 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.392755 17911 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.396075 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.401491 15435 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:21.405409 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.352516 17727 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:21.187327 17896 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:21.430164 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.431449 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.431965 15510 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.431836 15435 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:21.434648 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.431023 15515 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
W20260709 13:05:21.445794 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.403890 17915 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:21.450042 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.450788 15437 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:21.451889 15435 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:21.516705 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.551648 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.553663 17727 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.555001 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:21.555380 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:21.442308 17709 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:05:21.555958 15439 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:21.557051 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:21.554971 17727 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.558689 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.558854 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.557130 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.559943 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:21.560648 17971 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:05:21.560772 15442 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:21.554973 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.447651 17933 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:21.568841 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.569345 17933 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.571314 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.573064 15443 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 3: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:21.580435 17905 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:21.350385 17913 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:21.561107 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:21.560777 15441 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:21.585156 15438 raft_consensus.cc:2410] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:21.593022 17815 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:21.593763 17815 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:21.596371 17815 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:21.599093 17939 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.601852 17939 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:21.608099 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.609704 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.610450 17835 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:21.609124 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.469583 17915 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:21.763969 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.645172 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:21.718945 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.627151 15442 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:21.618549 15592 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:21.767920 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.777923 15511 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:21.643373 15555 leader_election.cc:336] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.818s (SENT)
I20260709 13:05:21.766008 15586 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:21.779261 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:21.776942 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.617054 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.772420 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.758846 15513 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:21.781217 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:21.669024 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.783732 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:21.783583 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.782691 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.789402 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.790365 15513 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:21.790421 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.791494 15513 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:21.792138 15513 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:21.782553 15510 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.744207 17841 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.791379 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.786254 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:21.793288 15439 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:21.787525 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.795630 15511 raft_consensus.cc:2393] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.765781 17809 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:21.666234 17937 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:21.798252 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.802397 15518 raft_consensus.cc:2410] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:21.782624 17974 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:21.721000 17943 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:05:21.801584 17969 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:21.798979 17841 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:21.793275 17835 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:21.808740 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 165423us
I20260709 13:05:21.804064 15513 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.811110 17968 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:05:21.815336 17893 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:21.815632 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.816303 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.799516 17937 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:21.829660 15407 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:21.834949 15516 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.834993 15515 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:21.817993 17928 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.000s
I20260709 13:05:21.829694 17974 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:21.811806 17815 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:05:21.833983 17893 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:21.836652 15513 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.851171 15518 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:21.852506 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:21.853616 15518 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:21.831651 17911 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:21.855399 15511 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:21.856675 15511 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:21.858596 15555 leader_election.cc:336] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.861s (SENT)
I20260709 13:05:21.857924 15511 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.864686 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.863277 15511 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:21.866961 15517 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:21.868072 15518 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.869784 17937 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.870904 15517 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:21.860167 17969 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:21.873656 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:21.875942 15517 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:21.875166 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.879293 15516 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:21.853258 17835 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:21.889864 17893 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:21.852859 17928 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.891666 17893 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:21.894512 17975 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:05:21.879047 17969 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.898610 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:21.899125 15517 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.906481 15517 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.878925 17968 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:05:21.898038 17712 raft_consensus.cc:2764] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:21.912964 17969 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.913261 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:21.915694 17915 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:21.916766 15511 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:21.919585 15511 pending_rounds.cc:85] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:21.902849 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:21.921144 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:21.903486 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.925297 17928 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:21.926084 17928 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.926472 17928 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:21.928588 17928 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:21.917290 17972 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.069s	user 0.001s	sys 0.001s
I20260709 13:05:21.895871 17937 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.936952 17974 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:21.940339 17815 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.960342 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:21.961050 15588 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.894537 15513 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:21.963244 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.964299 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.899510 15518 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.952188 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.951184 15511 pending_rounds.cc:107] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:21.965826 15511 raft_consensus.cc:2889] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:21.966686 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:21.919127 15517 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:05:21.952664 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:21.969998 15591 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:21.954246 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.955334 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:05:21.972796 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.972892 16180 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:21.973315 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.955595 16146 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:21.978505 15517 pending_rounds.cc:85] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:21.978951 15517 pending_rounds.cc:107] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:05:21.979259 15517 raft_consensus.cc:2889] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:21.984704 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:21.985273 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:21.985440 15592 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.986999 15440 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:21.958967 17709 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.991847 17709 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:21.994342 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.994824 17709 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:22.004088 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:22.007773 15440 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:22.009790 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.013562 16180 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:05:22.030961 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:21.998799 17974 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.999018 17894 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:22.044737 15513 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:21.989672 17906 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:05:22.045063 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.044888 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 89417.9us
I20260709 13:05:22.045651 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:22.064648 15438 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:05:22.065240 15435 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:22.066838 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.071565 15441 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:22.072408 15440 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:22.078012 15512 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:22.080413 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79407.5us
I20260709 13:05:22.085211 15583 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.085075 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:22.091832 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:22.086176 15440 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:22.090380 15443 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:22.094559 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:22.074062 16174 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:22.098671 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.099716 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.073567 17934 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.104887 15513 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:22.101343 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.105428 15587 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:22.107055 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:22.108623 15517 raft_consensus.cc:2393] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 3: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:22.086268 17483 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.109519 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.112569 15517 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:22.112429 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:22.104173 15512 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:22.111840 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.115257 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.118556 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.123071 15592 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:22.122903 15591 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:22.122991 15588 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:22.124351 15514 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:22.125103 15518 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:05:22.125466 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.125504 15518 pending_rounds.cc:85] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 3
I20260709 13:05:22.126464 15518 pending_rounds.cc:107] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:05:22.126752 15518 raft_consensus.cc:2889] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:22.127743 15516 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:22.127806 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:22.128561 15512 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.109104 17933 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.131858 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.077247 17906 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.136473 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:22.137789 17906 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:22.135079 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:22.139181 17915 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.137044 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:22.145429 15406 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:22.151335 15440 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:05:22.151338 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:22.149238 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:22.167735 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:22.169528 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:22.133188 17841 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:22.151105 17934 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:22.118278 17483 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.182487 17483 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:22.150599 17939 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:05:22.175463 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.175952 17870 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.176496 17943 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:22.178459 17977 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:05:22.178172 17969 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.145373 17933 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:21.443403 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:22.179922 15337 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.153316 17940 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.152369 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:22.173478 17934 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.186074 17983 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.191946 15515 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:22.164252 17912 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:22.174516 17979 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.193002 17964 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:22.201078 17974 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.223534 15439 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:22.223872 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:22.217659 17934 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.228734 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:22.217618 17912 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:22.201066 17939 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.206033 17943 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:22.218706 16174 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:22.237942 17912 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:22.226619 17906 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:05:22.235193 17483 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:05:22.308350 15436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1603) took 1551 ms (client timeout 2038 ms). Trace:
W20260709 13:05:22.311507 15436 rpcz_store.cc:269] 0709 13:05:20.757359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.780534 (+ 23175us) service_pool.cc:224] Handling call
0709 13:05:22.308123 (+1527589us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400120cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:22.308243 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823001856}
I20260709 13:05:22.309098 17943 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:22.243305 17448 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 13:05:22.312958 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.315915 17939 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:22.316507 17982 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:05:22.317916 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 249) took 1370 ms. Trace:
I20260709 13:05:22.318384 15583 rpcz_store.cc:276] 0709 13:05:20.947629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.947858 (+   229us) service_pool.cc:224] Handling call
0709 13:05:20.948317 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.085904 (+1137587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.317638 (+231734us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540015f4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:22.317849 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2614097152}
I20260709 13:05:22.227032 17974 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:22.321550 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 75896.9us
I20260709 13:05:22.322453 15440 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
W20260709 13:05:22.323824 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.346856 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.261s (SENT)
W20260709 13:05:22.352927 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 258410us
W20260709 13:05:22.351320 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 166662us
W20260709 13:05:22.354954 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 203725us
W20260709 13:05:22.326252 17978 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.172s	user 0.001s	sys 0.001s
I20260709 13:05:22.357421 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:22.358050 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.356294 15556 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:22.363366 15437 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:22.267102 17986 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:05:22.374249 17974 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:22.374902 17974 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:22.375773 17933 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:22.374034 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:22.380004 17987 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:22.381064 17870 raft_consensus.cc:2764] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:05:22.381940 17870 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:22.383985 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1810) took 1177 ms. Trace:
I20260709 13:05:22.385251 17815 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.379254 17943 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.386277 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:22.340142 17900 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:05:22.387805 17987 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.388217 17987 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:22.388574 17987 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.389539 17969 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:22.390480 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:22.391201 15590 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
W20260709 13:05:22.394798 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.395081 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.406309 17893 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:05:22.406636 17924 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.407814 17928 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:22.410413 17928 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:22.375451 17974 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.411482 16180 raft_consensus.cc:2410] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:22.412650 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:22.414999 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 59213.9us
I20260709 13:05:22.384433 15584 rpcz_store.cc:276] 0709 13:05:21.206555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.209572 (+  3017us) service_pool.cc:224] Handling call
0709 13:05:21.434761 (+225189us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5800104a98. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32eee 0000000000375939 00007fcf80ca61e0 00007fcf80d6f0c4 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:05:21.434930 (+   169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:21.435473 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:21.435501 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:21.940973 (+505472us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b2c00033248. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:05:22.004109 (+ 63136us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.172748 (+168639us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:22.173078 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.173772 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.173861 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:22.383765 (+209904us) raft_consensus.cc:1685] finished
0709 13:05:22.383787 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:22.383915 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29191,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":575,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":7414,"spinlock_wait_cycles":84699008,"thread_start_us":70570,"threads_started":1,"wal-append.queue_time_us":183350}
I20260709 13:05:22.422523 15512 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:22.422729 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:22.429171 15406 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:22.435742 15555 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.040s (SENT)
I20260709 13:05:22.414422 17906 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.436470 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:22.436666 17979 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:22.440778 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 84583.8us
I20260709 13:05:22.441468 17905 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:22.441089 15337 catalog_manager.cc:5697] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 2, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:22.445041 17928 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:22.445035 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:22.448907 17974 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:22.481468 15337 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 2 to 3, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.436376 17448 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.483726 17809 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:22.483929 17448 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.436859 17875 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:05:22.471942 17906 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:22.488907 17928 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:22.436491 17835 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:05:22.460709 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.490195 17906 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:22.489969 17928 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.490821 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:22.491040 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.491801 17937 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:22.491961 15556 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:22.492246 17937 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.484019 17905 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:22.493409 17974 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:22.492702 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47774.3us
I20260709 13:05:22.493986 17905 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.498894 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.499688 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.499883 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.500325 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:22.500473 15517 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:22.501286 15509 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:22.493986 17974 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:22.502517 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:22.503371 17974 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:22.505281 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:22.505939 15510 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:22.490844 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.513332 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:22.515122 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:22.515853 15592 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:22.519141 16180 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:05:22.530599 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.487278 17448 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:22.536878 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:22.538995 15436 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:05:22.543197 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 172369us
I20260709 13:05:22.548491 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:22.548691 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:22.550802 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.149s (SENT)
I20260709 13:05:22.550940 15586 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:22.537897 15438 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:22.471668 17727 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:22.492746 17937 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:22.747555 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.630995 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 51664.8us
W20260709 13:05:22.648788 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.756513 15510 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:22.852358 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.898082 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.898937 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.510983 17979 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:22.821883 15337 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 4 to 7, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.930871 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:22.517560 17906 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.659946 17964 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:22.539508 17896 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.369s
W20260709 13:05:22.908885 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 358105us
I20260709 13:05:22.625296 17448 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.284s
I20260709 13:05:22.873610 17987 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:22.789043 17709 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.766906 18001 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.177s
I20260709 13:05:22.675477 15592 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:22.658557 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 108696us
I20260709 13:05:22.936115 15434 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:22.937039 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:22.987975 15589 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:05:22.842773 17934 consensus_meta.cc:287] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.001s
I20260709 13:05:22.930800 15337 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 4 to 5, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 5 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.911782 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:22.958560 17906 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:05:22.729661 17992 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:05:22.994982 15337 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:23.019028 15337 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:05:23.019732 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 126098us
W20260709 13:05:22.994691 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:23.023078 17912 consensus_meta.cc:287] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.000s
I20260709 13:05:22.982777 17686 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:23.024232 17686 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.024658 17686 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:23.016461 17709 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.030151 15337 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 4 to 6, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:05:23.032701 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:23.013386 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.027407 17709 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:22.996495 17906 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.709074 17875 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.349s
I20260709 13:05:23.038039 17987 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:23.282447 15555 leader_election.cc:336] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.500s (SENT)
I20260709 13:05:23.295710 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:23.037699 15337 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 2, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:22.982390 18000 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.039690 17870 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.994045 17911 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.226688 15516 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.013s
W20260709 13:05:23.300366 15516 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.006s	sys 0.015s
I20260709 13:05:23.060001 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:23.271659 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:23.270954 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 714675us
I20260709 13:05:23.304001 15517 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:23.271296 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:23.153292 17896 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:22.958812 17964 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.279747 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:23.307194 17911 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.307910 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:23.308854 17870 raft_consensus.cc:697] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:23.044855 17979 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.017855 17934 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.284250 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:23.317939 15337 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 2, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:23.054593 17994 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.321745 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50582.9us
I20260709 13:05:23.290006 17448 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:23.329282 15583 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:23.358734 15591 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:23.331171 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.341713 15442 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.343688 15337 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 3 to 7, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:23.328776 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:23.085855 17912 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.047654 17809 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.293s
W20260709 13:05:23.362673 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.321240 17924 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:23.321043 17964 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:23.364846 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:23.337646 17875 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:23.336714 17900 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:23.336447 17727 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.375326 18004 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
I20260709 13:05:23.360958 17448 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.376636 18010 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:23.377014 18002 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.379619 17912 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:23.380172 15338 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 210) took 8457 ms. Trace:
I20260709 13:05:23.357961 17994 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.390884 16181 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:05:23.428738 15434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1598) took 2785 ms (client timeout 1689 ms). Trace:
W20260709 13:05:23.429461 15434 rpcz_store.cc:269] 0709 13:05:20.643459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.655452 (+ 11993us) service_pool.cc:224] Handling call
0709 13:05:23.428362 (+2772910us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b540033fc54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:23.428566 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5117518720}
I20260709 13:05:23.334342 18000 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.384493 17991 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.316771 17937 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.412180 17448 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:23.414407 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet 952f15e68b0745e5a8ca26a3b527cab0 with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46586
I20260709 13:05:23.407685 16174 raft_consensus.cc:2393] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:23.395241 17875 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:23.464367 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.339498 17896 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.386785 17924 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.531085 15590 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:05:23.518656 18004 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:05:23.399179 17727 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.537294 17934 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:23.401547 17900 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.404958 18002 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.402712 18010 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:23.551504 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 269102us
W20260709 13:05:23.553238 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.507s (SENT) [suppressed 38 similar messages]
I20260709 13:05:23.555398 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:23.567091 15482 connection.cc:256] RPC call timeout handler was delayed by -2.3004615419999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 13:05:23.567657 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2851615419999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 13:05:23.403810 15338 rpcz_store.cc:276] 0709 13:05:14.826488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.826704 (+   216us) service_pool.cc:224] Handling call
0709 13:05:15.076859 (+250155us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400002490. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c330b2 00007fcf81baca89 00007fcf81b44da6 00007fcf81b16088 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc
0709 13:05:23.246763 (+8169904us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:17.355592 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:17.372694 (+ 17102us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:17.372741 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:05:17.372763 (+    22us) tablet.cc:662] Decoding operations
0709 13:05:17.374047 (+  1284us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:17.374127 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:17.374158 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:05:17.375442 (+  1284us) tablet.cc:701] Row locks acquired
0709 13:05:17.375459 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:05:17.403517 (+ 28058us) write_op.cc:270] Start()
0709 13:05:17.464023 (+ 60506us) write_op.cc:276] Timestamp: P: 1783602317393051 usec, L: 0
0709 13:05:17.464071 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:05:17.809329 (+345258us) log.cc:844] Serialized 4796 byte log entry
0709 13:05:18.015133 (+205804us) op_driver.cc:464] REPLICATION: finished
0709 13:05:18.702716 (+687583us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b1800131860. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:18.703031 (+   315us) write_op.cc:301] APPLY: starting
0709 13:05:18.713828 (+ 10797us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:18.831904 (+118076us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:18.831950 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:18.839123 (+  7173us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:19.168133 (+329010us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:05:19.178427 (+ 10294us) write_op.cc:312] APPLY: finished
0709 13:05:19.213977 (+ 35550us) log.cc:844] Serialized 89 byte log entry
0709 13:05:19.614514 (+400537us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:19.697193 (+ 82679us) write_op.cc:454] Released schema lock
0709 13:05:19.697289 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:19.697975 (+   686us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:19.698009 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35616,"reported_tablets":34,"spinlock_wait_cycles":31638400,"child_traces":[["op",{"apply.queue_time_us":438614,"apply.run_cpu_time_us":63253,"apply.run_wall_time_us":994930,"num_ops":12,"prepare.queue_time_us":880043,"prepare.run_cpu_time_us":20749,"prepare.run_wall_time_us":662515,"raft.queue_time_us":1277,"raft.run_cpu_time_us":44717,"raft.run_wall_time_us":425625,"replication_time_us":533483,"spinlock_wait_cycles":90083712,"thread_start_us":1056322,"threads_started":5,"wal-append.queue_time_us":634142,"wal-append.run_cpu_time_us":6771,"wal-append.run_wall_time_us":2070000}]]}
W20260709 13:05:23.568001 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2851615419999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:05:23.572016 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2662615419999383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 13:05:23.572366 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2662615419999383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 13:05:23.572522 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 231661us
W20260709 13:05:23.572763 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2473615420000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:05:23.574292 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 216284us
W20260709 13:05:23.574765 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:23.573108 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2473615420000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:05:23.575673 15482 connection.cc:256] RPC call timeout handler was delayed by -2.17626154200002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:05:23.576020 15482 connection.cc:256] RPC call timeout handler was delayed by -2.163661542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:05:23.576352 15482 connection.cc:256] RPC call timeout handler was delayed by -2.163661542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:05:23.576670 15482 connection.cc:256] RPC call timeout handler was delayed by -2.1123615420000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 13:05:23.576988 15482 connection.cc:256] RPC call timeout handler was delayed by -2.1078615420000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:05:23.577163 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 257334us
W20260709 13:05:23.577795 15482 connection.cc:256] RPC call timeout handler was delayed by -2.1078615420000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:05:23.578238 15482 connection.cc:256] RPC call timeout handler was delayed by -2.1024615420000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 13:05:23.580075 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0988615420000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:05:23.580559 15482 connection.cc:256] RPC call timeout handler was delayed by -2.093461542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:05:23.580920 15482 connection.cc:256] RPC call timeout handler was delayed by -2.093461542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:05:23.582501 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0781615419999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:05:23.582839 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0754615419999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 13:05:23.583168 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0754615419999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 13:05:23.583484 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0547615419999374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:05:23.583828 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0529615419999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:05:23.584156 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0529615419999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 13:05:23.584379 16145 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:23.585608 17988 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:23.586079 17988 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.586455 17988 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:23.593349 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1828) took 1641 ms. Trace:
I20260709 13:05:23.594630 17994 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:23.593875 15585 rpcz_store.cc:276] 0709 13:05:21.951853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.997708 (+ 45855us) service_pool.cc:224] Handling call
0709 13:05:21.998100 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.114336 (+116236us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:22.414793 (+300457us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.741675 (+326882us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.881196 (+139521us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.881410 (+   214us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:22.892344 (+ 10934us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.892599 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.892694 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.374555 (+481861us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:23.593081 (+218526us) raft_consensus.cc:1685] finished
0709 13:05:23.593107 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.593272 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12270,"prepare.queue_time_us":57139,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":1039,"raft.queue_time_us":74871,"raft.run_cpu_time_us":587,"raft.run_wall_time_us":87133,"spinlock_wait_cycles":30882176,"thread_start_us":657744,"threads_started":3,"wal-append.queue_time_us":721295}
W20260709 13:05:23.596107 18009 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:05:23.596318 16174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52918 (request call id 287) took 1079 ms. Trace:
I20260709 13:05:23.596771 18002 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:23.534544 17870 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.566501 17875 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.600587 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1840) took 1087 ms. Trace:
I20260709 13:05:23.622504 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:23.632220 15590 rpcz_store.cc:276] 0709 13:05:22.512804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.512969 (+   165us) service_pool.cc:224] Handling call
0709 13:05:23.600311 (+1087342us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540028b4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:23.600479 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338048256}
I20260709 13:05:23.578706 17809 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.584471 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0295615420000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 13:05:23.652989 17727 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:23.653399 16180 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.656464 18000 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:23.659065 17896 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:23.659193 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1666) took 1151 ms. Trace:
W20260709 13:05:23.662932 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0295615420000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:05:23.699401 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0277615420000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:05:23.699925 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0277615420000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:05:23.700233 15482 connection.cc:256] RPC call timeout handler was delayed by -2.023261542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:05:23.700641 15482 connection.cc:256] RPC call timeout handler was delayed by -2.023261542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:05:23.700956 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0034615419999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:05:23.701269 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0034615419999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:05:23.701548 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9980615419999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 13:05:23.701844 15482 connection.cc:256] RPC call timeout handler was delayed by -1.950361541999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 13:05:23.702169 15482 connection.cc:256] RPC call timeout handler was delayed by -1.950361541999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 13:05:23.702901 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9332615419999684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 13:05:23.697732 15437 rpcz_store.cc:276] 0709 13:05:22.508267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.517425 (+  9158us) service_pool.cc:224] Handling call
0709 13:05:22.552108 (+ 34683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.728336 (+176228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.728383 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.982975 (+254592us) log.cc:844] Serialized 26 byte log entry
0709 13:05:23.572123 (+589148us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:23.572173 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.572259 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.658925 (+ 86666us) raft_consensus.cc:1685] finished
0709 13:05:23.658949 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.659117 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175633,"raft.queue_time_us":176043,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":450235,"threads_started":1,"wal-append.queue_time_us":627995}
W20260709 13:05:23.703203 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9332615419999684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 13:05:23.704589 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8918615420000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:05:23.704963 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8792615419999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 13:05:23.705317 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8729615419999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 13:05:23.705672 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8486615419999453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 13:05:23.706127 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8486615419999453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 13:05:23.706466 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8414615419999336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 13:05:23.706811 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8009615419999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:05:23.707093 15482 connection.cc:256] RPC call timeout handler was delayed by -1.6092615420000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2398s for a response
W20260709 13:05:23.707362 15482 connection.cc:256] RPC call timeout handler was delayed by -1.6092615420000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2398s for a response
W20260709 13:05:23.707638 15482 connection.cc:256] RPC call timeout handler was delayed by -1.2663615420000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2779s for a response
W20260709 13:05:23.707880 15482 connection.cc:256] RPC call timeout handler was delayed by -1.2663615420000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2779s for a response
W20260709 13:05:23.688161 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 305077us
I20260709 13:05:23.656468 17900 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:23.684242 18010 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:23.627256 17994 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.633100 18002 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.697208 17686 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.005s
W20260709 13:05:23.684963 17906 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.003s
W20260709 13:05:23.755333 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 202161us
I20260709 13:05:23.713900 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:23.743515 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:23.773510 15435 raft_consensus.cc:606] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:23.774104 15435 raft_consensus.cc:614] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:23.774204 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 60354.3us
W20260709 13:05:23.771164 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62412.8us
I20260709 13:05:23.776240 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:23.785243 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69352.7us
W20260709 13:05:23.792297 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 155928us
I20260709 13:05:23.624297 16174 rpcz_store.cc:276] 0709 13:05:22.516645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.528422 (+ 11777us) service_pool.cc:224] Handling call
0709 13:05:23.596004 (+1067582us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54007102d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:23.596226 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101583104}
I20260709 13:05:23.685650 17809 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.714972 18021 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:23.798588 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.785315 17900 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.817425 15555 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.527s (SENT)
W20260709 13:05:23.824793 15555 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.708s (SENT)
I20260709 13:05:23.785316 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:05:23.824975 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.817487 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:23.825839 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.713s (SENT)
W20260709 13:05:23.846560 15555 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.727s (SENT)
I20260709 13:05:23.847164 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:23.822458 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:23.751175 17994 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.829387 15435 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:05:23.831689 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.835860 17974 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:23.815671 18021 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.838142 17809 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:23.751092 17686 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.839804 17900 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.812846 17924 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:23.841531 18044 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:23.842717 18035 tablet_replica.cc:333] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:05:23.792639 18040 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.788683 17893 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.797672 17896 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:23.751242 18002 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.771611 17906 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.805341 17937 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:23.865901 15555 leader_election.cc:336] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.772s (SENT)
I20260709 13:05:23.883421 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:23.843459 18012 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.535s	user 0.000s	sys 0.008s
W20260709 13:05:23.874498 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 87735us
I20260709 13:05:23.871085 18027 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.864866 16175 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:23.885995 15555 leader_election.cc:336] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.822s (SENT)
I20260709 13:05:23.891331 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:23.892315 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:23.897909 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:23.898176 15590 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:23.874846 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 81700.3us
I20260709 13:05:23.900558 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:23.903580 15592 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:23.902477 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 290217us
I20260709 13:05:23.907932 17900 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:23.885848 17893 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:23.866858 17974 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:23.917862 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 100449us
I20260709 13:05:23.918931 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:23.941610 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:23.948647 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.893002 17905 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:23.917763 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:24.008890 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 91249.8us
I20260709 13:05:24.010079 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:24.011492 15442 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:24.013518 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:23.912693 18000 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:24.003230 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 117264us
W20260709 13:05:24.022763 15555 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.921s (SENT)
I20260709 13:05:24.023407 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:24.003317 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:24.006342 15590 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
W20260709 13:05:23.957568 18043 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:05:23.886184 17896 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:23.882043 18040 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:23.977867 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.045922 15438 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:24.046193 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1667) took 1537 ms. Trace:
I20260709 13:05:24.046947 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 268) took 1257 ms. Trace:
I20260709 13:05:24.052476 15434 raft_consensus.cc:606] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:23.911017 17893 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:24.025851 16146 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:24.031821 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:23.955700 17937 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:23.917307 17979 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:05:24.047384 15586 rpcz_store.cc:276] 0709 13:05:22.789444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.834482 (+ 45038us) service_pool.cc:224] Handling call
0709 13:05:23.315303 (+480821us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b5800104a98. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:05:23.315511 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:23.407179 (+ 91668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:23.407228 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:23.407300 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:23.407361 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.046671 (+639310us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b54001c1454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:24.046732 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.046888 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317551744}
I20260709 13:05:24.058909 16177 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:23.957938 17900 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:05:24.015384 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:24.046825 15439 rpcz_store.cc:276] 0709 13:05:22.508612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.509848 (+  1236us) service_pool.cc:224] Handling call
0709 13:05:22.510337 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.548968 (+ 38631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.549000 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.579890 (+ 30890us) log.cc:844] Serialized 26 byte log entry
0709 13:05:23.273512 (+693622us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:23.273564 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.273647 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.842685 (+569038us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:24.030798 (+188113us) raft_consensus.cc:1685] finished
0709 13:05:24.030829 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.046107 (+ 15278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44519,"raft.queue_time_us":127178,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":52509,"spinlock_wait_cycles":15133952,"thread_start_us":400962,"threads_started":1,"wal-append.queue_time_us":674880}
I20260709 13:05:24.023607 17999 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:24.007238 18022 raft_consensus.cc:2764] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:05:24.059983 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1837) took 1548 ms. Trace:
I20260709 13:05:24.092484 15584 rpcz_store.cc:276] 0709 13:05:22.511839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.513584 (+  1745us) service_pool.cc:224] Handling call
0709 13:05:23.330532 (+816948us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b5800104a98. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:05:23.330843 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:23.564262 (+233419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:23.564300 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:23.564359 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:23.564409 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.059630 (+495221us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001decd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:24.059709 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.059895 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662784640}
W20260709 13:05:24.072469 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.081578 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 66279.6us
W20260709 13:05:24.094828 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.095176 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:24.042797 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:24.096778 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.097488 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.042430 18052 raft_consensus.cc:2764] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:05:24.068935 17985 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:24.088157 17924 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:24.108019 17986 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:24.131973 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 109268us
W20260709 13:05:24.132066 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 117689us
I20260709 13:05:24.100376 17905 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:24.155097 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 236338us
I20260709 13:05:24.181933 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:24.180835 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 85787.4us
I20260709 13:05:24.184405 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.184332 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.092166 17809 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:05:24.186595 15439 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
W20260709 13:05:24.213838 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50421.7us
I20260709 13:05:24.213927 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.193487 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.216102 15442 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:24.129266 18060 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.197619 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:24.220721 15518 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:24.200570 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:24.201740 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.205078 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:24.232059 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79213us
I20260709 13:05:24.206298 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:24.206890 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:24.209546 15513 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:24.211089 15511 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:24.196822 15592 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:24.234725 17979 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:24.133329 18052 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:24.133154 17985 raft_consensus.cc:697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:24.215257 15439 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:24.214789 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:24.131867 18044 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:24.227455 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:24.227937 15441 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:24.269202 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:24.227522 15436 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:24.133672 18022 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:24.213842 18000 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:24.232321 15512 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:05:24.223026 17964 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.829s	user 0.010s	sys 0.006s
I20260709 13:05:24.215481 17686 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:24.236680 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 120182us
I20260709 13:05:24.245918 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:24.269984 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:24.281603 17991 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.231680 17994 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:24.236361 18002 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:24.302357 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 87675.1us
I20260709 13:05:24.182267 17905 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.304322 15591 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:05:24.307299 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.326586 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56018.1us
I20260709 13:05:24.341831 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.325975 18022 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.347349 18022 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:24.342634 17991 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.327132 18021 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:24.356007 15439 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:24.358057 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:24.364322 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:24.255936 18048 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:24.278374 18000 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:24.371165 15441 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:24.373349 15518 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:24.374446 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:24.325515 17906 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:24.235378 17979 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:24.354785 17686 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.389734 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 152096us
I20260709 13:05:24.395268 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:24.404429 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 62646.1us
I20260709 13:05:24.361901 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:24.405920 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:24.379561 18000 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.362356 18040 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:24.421366 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 366627us
I20260709 13:05:24.230700 18060 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.325163 17964 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.438541 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:24.392678 17911 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:24.391165 17974 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:24.399199 18021 raft_consensus.cc:2764] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:05:24.399931 18002 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:24.444783 18011 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.873s	user 0.002s	sys 0.015s
W20260709 13:05:24.472075 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.481856 15441 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:24.440464 17991 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:24.406191 17686 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.459848 18022 raft_consensus.cc:2764] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 13:05:24.500825 18010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.004s	sys 0.009s
I20260709 13:05:24.472675 18065 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.480477 18002 raft_consensus.cc:697] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:24.521703 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48273.6us
I20260709 13:05:24.523144 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.493418 17896 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:24.490962 18021 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:24.508603 18051 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.331s	user 0.000s	sys 0.002s
I20260709 13:05:24.404925 17985 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:24.510700 18010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.009s
I20260709 13:05:24.421690 18044 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:24.537840 18016 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.190s	user 0.002s	sys 0.009s
I20260709 13:05:24.538126 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:24.546819 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1665) took 2038 ms. Trace:
I20260709 13:05:24.548516 15442 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:24.521373 17991 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:24.548790 15443 rpcz_store.cc:276] 0709 13:05:22.507938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.509612 (+  1674us) service_pool.cc:224] Handling call
0709 13:05:22.538780 (+ 29168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.548386 (+  9606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.548429 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.637661 (+ 89232us) log.cc:844] Serialized 26 byte log entry
0709 13:05:23.120425 (+482764us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:23.120474 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.120576 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.925405 (+804829us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:24.535771 (+610366us) raft_consensus.cc:1685] finished
0709 13:05:24.535805 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.546695 (+ 10890us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19270,"raft.queue_time_us":86367,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":21507,"spinlock_wait_cycles":14880128,"thread_start_us":380147,"threads_started":1,"wal-append.queue_time_us":590521}
I20260709 13:05:24.562469 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:24.563524 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.564232 15443 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:24.565690 15443 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:24.572264 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:24.572711 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 49320.4us
I20260709 13:05:24.575778 18063 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:24.576578 18063 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:24.577128 15442 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:24.577073 18074 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:24.577752 18063 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:24.579711 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 92524.6us
I20260709 13:05:24.580650 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:24.581676 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:24.535526 17896 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.538599 18068 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:24.537900 18057 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.557921 18021 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:24.613432 15435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.019s	sys 0.029s
W20260709 13:05:24.615846 15435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.019s	sys 0.029s
W20260709 13:05:24.624440 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.628482 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.616747 15484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.004s	sys 0.014s
W20260709 13:05:24.630074 15484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.004s	sys 0.014s
W20260709 13:05:24.631069 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.559561 18022 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:05:24.614691 18053 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.305s	user 0.000s	sys 0.002s
I20260709 13:05:24.587703 18079 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:05:24.660679 18079 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:05:24.662824 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 80872.6us
I20260709 13:05:24.614327 17905 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:24.665059 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:24.655761 18047 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
I20260709 13:05:24.525317 18065 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.612360 17991 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:05:24.610509 17896 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.666807 18010 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:24.693077 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1664) took 2175 ms. Trace:
I20260709 13:05:24.695988 15440 rpcz_store.cc:276] 0709 13:05:22.507525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.508807 (+  1282us) service_pool.cc:224] Handling call
0709 13:05:22.509224 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.726137 (+216913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.726180 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.928369 (+202189us) log.cc:844] Serialized 26 byte log entry
0709 13:05:23.229059 (+300690us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:23.229133 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.229242 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:24.278054 (+1048812us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:24.673330 (+395276us) raft_consensus.cc:1685] finished
0709 13:05:24.673363 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.682795 (+  9432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212076,"raft.queue_time_us":217574,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"spinlock_wait_cycles":15676672,"thread_start_us":300155,"threads_started":1,"wal-append.queue_time_us":378140}
I20260709 13:05:24.676466 18022 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:24.703408 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 339170us
W20260709 13:05:24.695506 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 117398us
I20260709 13:05:24.704968 15556 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:24.706790 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:24.707453 17988 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 1.121s	user 0.017s	sys 0.000s
I20260709 13:05:24.615247 18057 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.695053 17964 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:24.700531 18010 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:24.714146 18029 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:24.704224 18022 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:24.654158 18002 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:24.715209 17727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.007s	sys 0.011s
W20260709 13:05:24.712244 18027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.009s	sys 0.021s
I20260709 13:05:24.617093 18068 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.714197 18081 raft_consensus.cc:3055] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:05:24.796595 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80421.7us
I20260709 13:05:24.712595 18075 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:24.714689 17905 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:24.809126 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:24.706887 18066 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.255s
I20260709 13:05:24.749704 17686 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:24.806967 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 140687us
W20260709 13:05:24.804476 17727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.008s	sys 0.011s
I20260709 13:05:24.799922 18010 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:24.772753 18091 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:24.808879 18027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.009s	sys 0.022s
I20260709 13:05:24.829767 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:24.833186 18087 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:05:24.834643 18082 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:05:24.836048 18080 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:05:24.806389 18081 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:24.844096 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 127627us
I20260709 13:05:24.812960 17905 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.749426 17988 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:24.860509 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51452.8us
I20260709 13:05:24.717931 18021 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.802129 18029 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:24.828653 17709 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:24.839282 17483 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
W20260709 13:05:24.964227 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 145574us
I20260709 13:05:25.129356 15592 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
W20260709 13:05:25.300370 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 428409us
I20260709 13:05:24.942682 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:25.301901 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:25.153302 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44656 (request call id 25) took 1332 ms. Trace:
W20260709 13:05:24.954375 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.945523 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:25.306586 15512 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
W20260709 13:05:25.298928 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.311739 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.928846 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.313002 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.314462 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:24.874074 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:25.300097 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:25.326568 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:25.305087 15434 rpcz_store.cc:276] 0709 13:05:23.820699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.822243 (+  1544us) service_pool.cc:224] Handling call
0709 13:05:25.153102 (+1330859us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54003ee754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd51853 00007fcf80d1f60a 00007fcf7a2a57d4 00007fcf7a2a5762 00007fcf7a2a5691 00007fcf7a2a560c 00007fcf7a2a48c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:25.153224 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469920128}
I20260709 13:05:25.332134 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1854) took 1088 ms. Trace:
I20260709 13:05:25.333070 15592 rpcz_store.cc:276] 0709 13:05:24.244208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.245532 (+  1324us) service_pool.cc:224] Handling call
0709 13:05:25.331753 (+1086221us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54000569d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:25.332006 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895457664}
I20260709 13:05:25.324491 15512 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:24.925279 18093 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:05:24.919289 17999 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.004s
I20260709 13:05:24.863296 17905 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:25.131631 16175 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 1.214s	user 0.016s	sys 0.000s
W20260709 13:05:25.357807 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57809.4us
W20260709 13:05:25.152330 18000 consensus_meta.cc:287] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.006s
W20260709 13:05:25.340714 18052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.016s	sys 0.011s
I20260709 13:05:25.341187 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:25.343186 15341 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 6, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:24.919195 18084 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:05:25.347352 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 366941us
I20260709 13:05:25.367069 15341 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 6, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.368290 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1861) took 1086 ms. Trace:
I20260709 13:05:25.351300 15511 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:24.930586 18099 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:24.939934 17896 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:25.356251 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 490839us
W20260709 13:05:25.200389 18069 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.756s	user 0.004s	sys 0.004s
I20260709 13:05:25.352245 18064 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:24.941341 17979 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:25.005286 17900 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:25.360061 17999 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:24.902704 18090 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:25.262852 18091 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:25.025713 18065 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:25.208262 18079 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:25.424932 17964 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.425486 18079 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:25.425617 17964 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.427749 17875 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.428427 17875 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:24.916303 17988 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:25.366284 17809 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:25.430943 17875 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:25.148872 18057 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:25.369357 15341 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 5, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 5 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.368780 15583 rpcz_store.cc:276] 0709 13:05:24.281630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.284854 (+  3224us) service_pool.cc:224] Handling call
0709 13:05:24.337340 (+ 52486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.355502 (+ 18162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.355581 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.356141 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:05:24.692239 (+336098us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:24.692295 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.692386 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.368049 (+675663us) raft_consensus.cc:1685] finished
0709 13:05:25.368074 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.368217 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17599,"raft.queue_time_us":156952,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":19154,"thread_start_us":335734,"threads_started":1,"wal-append.queue_time_us":445354}
W20260709 13:05:25.372633 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 466452us
I20260709 13:05:24.860013 18092 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.523s
I20260709 13:05:24.928284 18068 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:25.378501 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52052.6us
I20260709 13:05:25.379446 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:25.465358 15434 raft_consensus.cc:606] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:25.465862 15434 raft_consensus.cc:614] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:25.373334 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 202) took 6563 ms. Trace:
I20260709 13:05:25.368742 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:25.370834 18052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.016s	sys 0.011s
I20260709 13:05:25.383021 18029 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:25.357627 18097 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:25.119418 18010 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:24.900267 17727 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:24.863454 18022 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.460668 17809 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:25.410616 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:25.466712 15337 rpcz_store.cc:276] 0709 13:05:18.796008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.804943 (+  8935us) service_pool.cc:224] Handling call
0709 13:05:19.457857 (+652914us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5400002490. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c330b2 00007fcf81baca89 00007fcf81b44da6 00007fcf81b16088 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc
0709 13:05:25.358992 (+5901135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:23.894153 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:23.907210 (+ 13057us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:23.907274 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:05:23.907292 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:23.908623 (+  1331us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:23.908717 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:23.908752 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:05:23.909967 (+  1215us) tablet.cc:701] Row locks acquired
0709 13:05:23.910015 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:05:23.910214 (+   199us) write_op.cc:270] Start()
0709 13:05:23.910382 (+   168us) write_op.cc:276] Timestamp: P: 1783602323910139 usec, L: 0
0709 13:05:23.910398 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:05:23.920258 (+  9860us) log.cc:844] Serialized 4780 byte log entry
0709 13:05:24.653828 (+733570us) op_driver.cc:464] REPLICATION: finished
0709 13:05:24.819728 (+165900us) write_op.cc:301] APPLY: starting
0709 13:05:24.831064 (+ 11336us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:24.935781 (+104717us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:24.935940 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:24.937573 (+  1633us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:24.937930 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:05:24.937981 (+    51us) write_op.cc:312] APPLY: finished
0709 13:05:24.938370 (+   389us) log.cc:844] Serialized 89 byte log entry
0709 13:05:24.938711 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:24.938883 (+   172us) write_op.cc:454] Released schema lock
0709 13:05:24.938952 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:25.022665 (+ 83713us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:25.025687 (+  3022us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2383115,"reported_tablets":32,"spinlock_wait_cycles":5275904,"child_traces":[["op",{"apply.queue_time_us":143085,"apply.run_cpu_time_us":6927,"apply.run_wall_time_us":146834,"num_ops":12,"prepare.queue_time_us":328135,"prepare.run_cpu_time_us":32185,"prepare.run_wall_time_us":162426,"raft.queue_time_us":275185,"raft.run_cpu_time_us":12650,"raft.run_wall_time_us":149995,"replication_time_us":699319,"thread_start_us":350401,"threads_started":4,"wal-append.queue_time_us":261216}]]}
I20260709 13:05:25.410881 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:25.330377 17709 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:25.513487 17709 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:25.373641 18095 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:25.412122 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:25.413445 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:25.364857 16175 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:25.412806 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:25.020376 18081 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.409956 17900 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:25.388712 18118 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:24.865553 17686 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.488s
I20260709 13:05:25.431896 17997 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:25.434574 18066 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:25.435562 15441 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:25.442852 15341 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 4, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.444792 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:25.557529 15341 catalog_manager.cc:5697] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 4, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.450915 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:25.559381 15341 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:25.560673 15517 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:25.389590 18035 raft_consensus.cc:2243] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.469517 15407 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:25.567416 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 97982.5us
W20260709 13:05:25.474922 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106249us
I20260709 13:05:25.478713 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:25.424744 17924 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.374866 18000 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:25.495379 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:25.501296 17964 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:25.352911 18060 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:25.444258 18099 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:25.503091 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 135419us
W20260709 13:05:25.584506 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 100318us
I20260709 13:05:25.519392 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:25.586054 15443 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:25.585439 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:25.473896 18052 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:25.489094 17906 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:25.552810 18079 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:25.547700 18101 consensus_queue.cc:1059] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:05:25.504504 17727 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.548712 18118 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:25.550158 18010 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:25.541064 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:25.571880 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:25.534340 16175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 407) took 3017 ms (client timeout 2774 ms). Trace:
I20260709 13:05:25.534698 18040 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:25.581662 18035 raft_consensus.cc:2272] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.584197 18060 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:25.464308 18064 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:25.554184 18022 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.488334 18097 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:25.592747 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:25.578083 17924 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.574378 17815 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.675894 17815 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.604534 18045 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.596493 18000 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:25.597322 18021 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:25.601564 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60615.8us
W20260709 13:05:25.615949 15555 connection.cc:256] RPC call timeout handler was delayed by -1.7856535560000566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 13:05:25.570200 17999 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:05:25.688944 15555 connection.cc:256] RPC call timeout handler was delayed by -1.561553556000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:05:25.689574 15555 connection.cc:256] RPC call timeout handler was delayed by -1.4741352960000995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:05:25.690016 15555 connection.cc:256] RPC call timeout handler was delayed by -1.425653556000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:05:25.690557 15555 connection.cc:256] RPC call timeout handler was delayed by -1.425653556000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:05:25.672021 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 86677.2us
W20260709 13:05:25.672693 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 47901.7us
I20260709 13:05:25.673672 17900 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:25.675163 18102 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:05:25.683008 17815 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:25.683488 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 90893.7us
I20260709 13:05:25.697245 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:25.698963 15517 raft_consensus.cc:3055] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:25.699473 15517 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:25.700213 15437 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:25.700377 15517 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:25.668828 18040 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:25.703838 18040 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:25.703945 15592 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:25.704943 17875 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:25.706969 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:25.709395 15555 connection.cc:256] RPC call timeout handler was delayed by -1.4130535560001363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:05:25.710604 15555 connection.cc:256] RPC call timeout handler was delayed by -1.386835296000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:05:25.711203 15555 connection.cc:256] RPC call timeout handler was delayed by -1.376935296000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:05:25.713336 15555 connection.cc:256] RPC call timeout handler was delayed by -1.2266352960000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 13:05:25.713780 15555 connection.cc:256] RPC call timeout handler was delayed by -1.1762352960000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 13:05:25.714237 15555 connection.cc:256] RPC call timeout handler was delayed by -1.0484352960000933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.225s for a response
I20260709 13:05:25.624563 18092 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:05:25.720024 18052 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:25.605607 16175 rpcz_store.cc:269] 0709 13:05:22.513567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.518063 (+  4496us) service_pool.cc:224] Handling call
0709 13:05:23.778835 (+1260772us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800004598. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32eee 0000000000375939 00007fcf80ca61e0 00007fcf80d6f0c4 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:05:25.530924 (+1752089us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30525312}
I20260709 13:05:25.608469 18066 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:25.585377 18099 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.722599 16182 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:25.718300 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 140968us
I20260709 13:05:25.677436 18060 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:25.726384 18124 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:25.726984 18060 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:25.718369 18064 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:25.729749 15436 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:25.708104 18104 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:25.554728 18091 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:25.733320 17911 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:25.736162 18118 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.742430 17815 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.734872 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:25.749270 17924 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:25.746208 18092 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:25.750958 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:25.751528 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:25.752904 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:25.753881 16182 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:25.758584 15517 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.599247 17809 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.761850 18040 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:25.762562 18040 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:25.891222 15517 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:05:26.114526 15517 pending_rounds.cc:85] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
W20260709 13:05:25.812094 15555 leader_election.cc:336] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.670s (SENT)
I20260709 13:05:26.116122 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:26.117348 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:26.117429 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 305409us
W20260709 13:05:26.118170 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 425739us
I20260709 13:05:26.118129 15442 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:25.826258 18001 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:26.119411 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:25.801543 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:26.120455 15437 raft_consensus.cc:606] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:26.120654 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:26.120970 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:25.777263 16146 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:26.121681 15442 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:25.803771 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.122198 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:26.127679 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 350508us
I20260709 13:05:25.834318 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:26.129274 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:26.129632 15586 raft_consensus.cc:1813] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Handling vote request from an unknown peer 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:26.130368 15586 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:05:26.132843 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:26.133633 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.686354 18045 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.847718 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:25.764097 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:25.802811 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68057.8us
I20260709 13:05:26.120946 15437 raft_consensus.cc:614] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:26.114992 15517 pending_rounds.cc:107] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:05:26.128922 15592 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:25.731477 18104 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.840162 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1684) took 1437 ms. Trace:
I20260709 13:05:26.124181 15591 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:26.170739 15517 raft_consensus.cc:2889] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:26.171231 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:26.172742 15588 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:26.140234 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:26.173978 15443 rpcz_store.cc:276] 0709 13:05:24.403321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.567419 (+164098us) service_pool.cc:224] Handling call
0709 13:05:24.567792 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.593663 (+1025871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.839761 (+246098us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000a5354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:25.840065 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341303808}
I20260709 13:05:26.178382 15585 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:25.896374 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:25.922087 18126 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:05:26.183673 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:26.185705 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:26.185809 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:26.190017 15585 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:26.190989 15443 raft_consensus.cc:2376] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6. Re-sending same reply.
I20260709 13:05:25.763767 17727 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:26.192824 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:26.194068 15435 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:26.198221 15482 leader_election.cc:400] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4.
I20260709 13:05:26.198694 15482 leader_election.cc:403] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:26.199956 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.202543 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:26.203778 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:26.202760 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:26.169529 18066 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:26.207788 15516 raft_consensus.cc:2376] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8. Re-sending same reply.
I20260709 13:05:26.204355 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:26.216051 15591 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:26.172765 17875 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:26.180138 18045 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.188750 17924 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:26.086550 18060 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.179960 18104 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:26.193331 18101 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.119441 18001 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:26.241856 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:26.219533 15407 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b97fcd3d908482fadc6fa54e513304d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:26.241856 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:26.250785 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 75659.4us
I20260709 13:05:26.204608 17911 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:26.252528 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:26.199532 17964 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:26.252305 17911 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:26.254266 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 131334us
W20260709 13:05:26.218438 18125 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.508s	user 0.002s	sys 0.000s
I20260709 13:05:26.262713 15482 leader_election.cc:400] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5.
I20260709 13:05:26.255475 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:26.265215 15583 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:26.214241 18083 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:26.266476 18083 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:26.267082 18083 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:26.267864 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:26.256464 18101 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.270925 18101 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:26.255995 15435 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:26.219133 18002 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.257234 18001 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:26.224102 18066 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.271986 18002 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.273984 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:26.274298 18002 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:26.261792 18110 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:26.275200 18110 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.275744 18110 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:26.277035 18122 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.683s	user 0.003s	sys 0.000s
I20260709 13:05:26.282058 17727 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.282958 17727 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.286453 17727 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:26.308779 15442 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:26.218926 18021 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:05:26.326411 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.879694 18097 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.344343 18062 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:26.345201 18062 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:26.348428 18052 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:26.349082 18052 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:26.349753 18052 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:26.343036 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 69127us
I20260709 13:05:26.351526 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:26.361017 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 242635us
W20260709 13:05:26.352634 18022 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.002s
I20260709 13:05:26.399853 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:26.400225 17911 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:26.401492 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:26.404485 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 274640us
W20260709 13:05:26.406136 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.874s (SENT)
W20260709 13:05:26.354298 18118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.048s	sys 0.084s
W20260709 13:05:26.413693 18118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.048s	sys 0.084s
I20260709 13:05:26.410408 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:26.415007 18118 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:26.415473 18118 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:26.416051 18118 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:26.417074 15555 leader_election.cc:336] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.885s (SENT)
I20260709 13:05:26.422828 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.425895 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:26.429339 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.052s (SENT)
W20260709 13:05:26.439693 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.070s (SENT)
I20260709 13:05:26.366109 18097 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:26.336093 17964 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:26.453992 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1696) took 1043 ms. Trace:
I20260709 13:05:26.447899 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:26.442137 18066 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:26.454519 15440 rpcz_store.cc:276] 0709 13:05:25.410829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.410954 (+   125us) service_pool.cc:224] Handling call
0709 13:05:25.411311 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:25.427903 (+ 16592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.427937 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:25.428641 (+   704us) log.cc:844] Serialized 52 byte log entry
0709 13:05:25.532970 (+104329us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:25.565873 (+ 32903us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.566134 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.566226 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.453690 (+887464us) raft_consensus.cc:1685] finished
0709 13:05:26.453714 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.453906 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15972,"prepare.queue_time_us":30037,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":21253,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":305,"spinlock_wait_cycles":3916672,"thread_start_us":103836,"threads_started":1,"wal-append.queue_time_us":165724}
I20260709 13:05:26.420271 18002 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:26.355185 18083 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.410132 18101 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:26.437704 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:26.511530 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 73898.3us
I20260709 13:05:26.512746 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.422039 18064 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:26.505842 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44698.6us
I20260709 13:05:26.441468 18022 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.509713 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:26.515995 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.423051 18092 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:05:26.467275 18091 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.525532 15518 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:26.511263 18066 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:26.530215 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.084s (SENT)
I20260709 13:05:26.511059 18002 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:26.448772 18001 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.512895 18101 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:26.517241 18062 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:26.543781 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.250s (SENT)
W20260709 13:05:26.542016 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 337874us
I20260709 13:05:26.550734 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:26.558182 15555 leader_election.cc:336] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.487s (SENT)
W20260709 13:05:26.561825 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:26.562855 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.567688 18142 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:26.568792 18142 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:26.572516 15441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.000s	sys 0.021s
W20260709 13:05:26.573138 15441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.000s	sys 0.022s
I20260709 13:05:26.534752 18064 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.574276 18062 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:26.574914 18062 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:26.575700 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:26.550194 18002 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.550750 18101 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:26.586295 15511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.010s	sys 0.011s
I20260709 13:05:26.557981 17896 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:26.587077 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1704) took 1169 ms. Trace:
W20260709 13:05:26.588956 15511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.011s	sys 0.012s
W20260709 13:05:26.585753 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 279214us
I20260709 13:05:26.579998 17924 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:26.591486 18095 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:05:26.604509 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.593289 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1695) took 1182 ms. Trace:
I20260709 13:05:26.654754 15436 rpcz_store.cc:276] 0709 13:05:25.410501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.410640 (+   139us) service_pool.cc:224] Handling call
0709 13:05:26.593028 (+1182388us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54002251d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:26.593201 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504714624}
I20260709 13:05:26.648937 15441 rpcz_store.cc:276] 0709 13:05:25.416800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.554857 (+138057us) service_pool.cc:224] Handling call
0709 13:05:25.555212 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.555468 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:25.865007 (+309539us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.582538 (+717531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:26.582601 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:26.582664 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.582873 (+   209us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.586181 (+  3308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15557,"prepare.queue_time_us":38643,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":11814,"thread_start_us":997693,"threads_started":2,"wal-append.queue_time_us":707625}
I20260709 13:05:26.683157 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1889) took 1235 ms. Trace:
I20260709 13:05:26.604698 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:26.689405 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:26.734593 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 176089us
I20260709 13:05:26.578264 18062 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:26.593125 18137 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:05:26.745040 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 235557us
W20260709 13:05:26.704057 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 188155us
I20260709 13:05:26.745946 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.746436 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.642450 18095 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:05:26.713313 18133 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:05:26.715508 18083 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:26.687676 18060 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:26.687212 18050 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:26.701953 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:26.766909 15441 raft_consensus.cc:606] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.767426 15441 raft_consensus.cc:614] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:26.696811 18140 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:26.733094 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:26.589174 18035 ts_tablet_manager.cc:1916] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:26.741989 15511 rpcz_store.cc:276] 0709 13:05:25.448299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.450994 (+  2695us) service_pool.cc:224] Handling call
0709 13:05:25.486757 (+ 35763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.487068 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:25.531279 (+ 44211us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.682660 (+1151381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:26.682730 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:26.682782 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.682867 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.683051 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109646,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":1164396,"threads_started":2,"wal-append.queue_time_us":1043608}
I20260709 13:05:26.749467 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:26.727768 18138 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:05:26.749539 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:26.755154 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60266.4us
I20260709 13:05:26.791900 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:05:26.759079 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 106135us
W20260709 13:05:26.759820 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.794257 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:26.768654 15436 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:26.796423 18060 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:26.797063 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47671.7us
I20260709 13:05:26.797565 18060 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:26.798033 18060 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:26.798439 18060 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:26.798873 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:26.800328 18143 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:05:26.801707 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 288) took 1025 ms. Trace:
I20260709 13:05:26.802134 15590 rpcz_store.cc:276] 0709 13:05:25.776539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.776800 (+   261us) service_pool.cc:224] Handling call
0709 13:05:25.777207 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.799878 (+ 22671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.799927 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:26.138693 (+338766us) log.cc:844] Serialized 26 byte log entry
0709 13:05:26.527730 (+389037us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:26.527799 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.527921 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.801444 (+273523us) raft_consensus.cc:1685] finished
0709 13:05:26.801468 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.801629 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22150,"raft.queue_time_us":22924,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":3311,"spinlock_wait_cycles":4352,"thread_start_us":319485,"threads_started":1,"wal-append.queue_time_us":467161}
I20260709 13:05:26.731967 18162 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:05:26.804577 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:26.805354 15516 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:26.806445 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:26.807197 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1699) took 1394 ms. Trace:
I20260709 13:05:26.807850 18001 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:26.808537 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.808753 18001 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:26.809526 18001 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:26.810027 18001 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:26.807699 15439 rpcz_store.cc:276] 0709 13:05:25.412750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.412895 (+   145us) service_pool.cc:224] Handling call
0709 13:05:25.413316 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.434231 (+ 20915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.434268 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:25.434833 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.834466 (+399633us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:25.834510 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.834619 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.806967 (+972348us) raft_consensus.cc:1685] finished
0709 13:05:26.806993 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.807132 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37813,"raft.queue_time_us":21689,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":23064,"thread_start_us":399118,"threads_started":1,"wal-append.queue_time_us":968544}
I20260709 13:05:26.807199 15516 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:26.760814 17964 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:26.816190 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 297) took 1409 ms. Trace:
I20260709 13:05:26.772558 17896 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.755534 18165 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:26.816936 16177 rpcz_store.cc:276] 0709 13:05:25.406918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.407389 (+   471us) service_pool.cc:224] Handling call
0709 13:05:25.434319 (+ 26930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.515336 (+ 81017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.515388 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:25.515457 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:25.515521 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.815675 (+1300154us) spinlock_profiling.cc:243] Waited 80.7 ms on lock 0x7b5400682254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:26.815781 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.816071 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185585536}
I20260709 13:05:26.819744 18165 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:26.821902 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 217318us
I20260709 13:05:26.824095 17896 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.824853 18165 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:26.824637 18118 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.826756 17896 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:26.840860 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 94494.2us
W20260709 13:05:26.845518 18110 consensus_meta.cc:287] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.004s
I20260709 13:05:26.846060 18110 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:26.847770 18001 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.826943 18118 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:26.852604 18118 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:26.842733 18161 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:05:26.853467 18161 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:26.853583 18110 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:26.854017 18161 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:26.855042 18161 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.856702 18161 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:26.819422 18146 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:26.853374 18118 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:26.858561 18118 consensus_queue.cc:1243] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:26.857967 18146 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:26.859413 18146 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.859064 18002 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.851351 17924 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:26.863933 18163 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:26.864476 18163 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:26.865022 18002 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:26.865610 17905 consensus_meta.cc:287] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.491s	user 0.016s	sys 0.001s
I20260709 13:05:26.865408 18163 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.866070 17905 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:26.836055 18045 consensus_meta.cc:287] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.000s
I20260709 13:05:26.867439 15584 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:26.867281 18045 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.814206 18095 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:26.875875 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:26.882267 15407 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:26.884027 15407 raft_consensus.cc:2686] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:05:26.873318 18021 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.002s
W20260709 13:05:26.873553 18052 consensus_meta.cc:287] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.523s	user 0.013s	sys 0.002s
W20260709 13:05:26.891032 15510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34302 (request call id 384) took 1944 ms (client timeout 2074 ms). Trace:
W20260709 13:05:26.905856 15510 rpcz_store.cc:269] 0709 13:05:24.942263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.942399 (+   136us) service_pool.cc:224] Handling call
0709 13:05:26.885982 (+1943583us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54002030d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:26.886185 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737129856}
W20260709 13:05:26.892884 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 82568.9us
I20260709 13:05:26.907660 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.875059 18095 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:26.888916 18160 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:26.934010 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:26.935070 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49194.9us
I20260709 13:05:26.936276 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:26.923581 18002 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:26.953158 17905 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:26.934654 18173 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:26.955001 18173 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:26.955592 18173 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:26.909840 18021 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4.
I20260709 13:05:26.916841 18052 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:26.963523 18144 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:26.922020 18045 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:26.971344 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:26.972128 15510 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
W20260709 13:05:26.961410 18099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.008s	sys 0.003s
I20260709 13:05:26.978904 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:26.988737 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 112981us
I20260709 13:05:26.922446 18022 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:05:26.991232 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 172891us
I20260709 13:05:26.970455 17964 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:26.970942 18160 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:27.005496 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:26.981915 18099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.009s	sys 0.003s
I20260709 13:05:27.012171 18179 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:27.014693 15482 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40670 dropped due to backpressure: service queue is full with 50 items
I20260709 13:05:27.019253 18097 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:27.020358 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:27.022980 18180 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:05:27.024248 18164 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:05:27.025193 15556 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:27.028928 18052 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.028842 18165 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.032248 18160 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.039043 17964 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:27.039358 18097 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:27.039098 18148 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 13:05:27.044940 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:27.046003 15515 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:27.046305 18040 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.048520 18146 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:27.050331 18129 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.331s	user 0.000s	sys 0.004s
I20260709 13:05:27.086544 15511 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:27.087411 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1884) took 1747 ms. Trace:
I20260709 13:05:27.087617 18146 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.087965 15512 rpcz_store.cc:276] 0709 13:05:25.340127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.361263 (+ 21136us) service_pool.cc:224] Handling call
0709 13:05:25.361809 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.406020 (+ 44211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.406064 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:25.414623 (+  8559us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.563118 (+148495us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:25.563174 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.563259 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.049418 (+1486159us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:27.087097 (+ 37679us) raft_consensus.cc:1685] finished
0709 13:05:27.087121 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.087342 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56335,"raft.queue_time_us":44157,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":25898,"spinlock_wait_cycles":185222528,"thread_start_us":71356,"threads_started":1,"wal-append.queue_time_us":253696}
I20260709 13:05:27.090078 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:27.083860 18174 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:27.091755 18174 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:27.087448 18165 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.092834 18174 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.069407 18097 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:27.096114 18097 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.097097 18064 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.097431 18097 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:27.035238 18179 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:27.063799 18104 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.004s
I20260709 13:05:27.033372 15483 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40676 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1563)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34302 (request call id 394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1912)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1913)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1914)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1545)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1559)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1587)
I20260709 13:05:27.091306 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:27.094848 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.102995 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.104768 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.104647 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:27.067989 18095 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:27.106669 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 61833.9us
I20260709 13:05:27.068531 17964 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.000968 18151 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:05:27.109391 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:27.115455 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:27.116190 15436 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.103942 18179 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:27.120240 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.158188 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.108850 18142 consensus_meta.cc:287] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.003s
W20260709 13:05:27.161448 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 52108.4us
I20260709 13:05:27.164337 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:27.108398 18095 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.166836 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:27.112958 18040 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.111011 17964 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:27.173857 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:27.174599 15434 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:27.180513 15436 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:27.163311 18174 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:27.168326 18180 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:27.165755 17911 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:27.196026 18182 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:27.174831 18095 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:27.180856 18148 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:05:27.178078 18142 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.197058 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:27.222970 15509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 1897) took 1761 ms (client timeout 1520 ms). Trace:
W20260709 13:05:27.253490 15509 rpcz_store.cc:269] 0709 13:05:25.461598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.478229 (+ 16631us) service_pool.cc:224] Handling call
0709 13:05:27.222570 (+1744341us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54002a1054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:27.222831 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445707520}
I20260709 13:05:27.224864 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1906) took 1006 ms. Trace:
I20260709 13:05:27.254854 15518 rpcz_store.cc:276] 0709 13:05:26.219170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.219373 (+   203us) service_pool.cc:224] Handling call
0709 13:05:26.219732 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.540720 (+320988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.224474 (+683754us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54000ec254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:27.224771 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702677248}
I20260709 13:05:27.256487 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.257375 15518 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:27.258569 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.226068 18079 raft_consensus.cc:3055] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:27.230172 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.234743 18163 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:27.237524 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1878) took 1036 ms. Trace:
I20260709 13:05:27.106124 18104 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.213312 17911 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.259335 15518 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:27.281430 18173 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.283350 15439 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:27.284543 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.285537 15509 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:27.286903 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.288484 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.292884 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.295698 18173 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.276985 15585 rpcz_store.cc:276] 0709 13:05:26.201435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.202006 (+   571us) service_pool.cc:224] Handling call
0709 13:05:26.202285 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.272869 (+ 70584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:26.272906 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:26.272953 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:26.272991 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.237115 (+964124us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b5400055fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:27.237200 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.237423 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161857792}
I20260709 13:05:27.276494 18079 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:27.301826 18060 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.004s
I20260709 13:05:27.308995 18060 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.032277 18045 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:05:27.320184 18079 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.311455 18060 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.326224 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.277904 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.213270 15434 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:05:27.340167 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.342403 15518 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:27.348585 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45550.4us
I20260709 13:05:27.349149 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.209583 18146 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:27.354261 16146 leader_election.cc:336] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.901s (SENT)
I20260709 13:05:27.354987 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:27.252930 18182 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:27.336293 17911 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.368811 16146 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:27.369998 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.371842 18183 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.386595 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.363046 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.390661 15518 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:27.364985 18146 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.401600 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.404831 15518 raft_consensus.cc:2410] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:27.400418 18079 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:27.407696 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.408233 18179 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:27.388294 18145 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:27.421882 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.423146 15518 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:27.434864 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.436244 15516 raft_consensus.cc:2410] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:27.439564 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:27.434973 17979 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.450493 18179 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:27.450867 17911 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.453923 17911 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.430377 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.426151 18145 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:05:27.445538 18101 consensus_meta.cc:287] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.795s	user 0.013s	sys 0.002s
I20260709 13:05:27.474459 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.481046 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:27.481859 15434 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:27.484163 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.488902 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.465961 17979 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.496622 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:27.498174 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.499291 15518 raft_consensus.cc:2410] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:27.484978 18042 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:27.502940 15434 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:05:27.509364 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.509778 16146 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:27.477757 18101 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.462409 18182 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.527421 16175 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:27.512061 18104 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:27.520382 18140 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:27.569195 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:27.577963 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:27.573367 18029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.834s	user 0.032s	sys 0.047s
I20260709 13:05:27.510998 18042 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:27.618310 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.620975 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:27.621737 15516 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:27.624907 16180 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:27.626947 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.628188 15518 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:27.576190 18140 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:05:27.618296 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.587412 18173 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:27.524379 18145 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.648583 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:27.586966 18029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.848s	user 0.032s	sys 0.048s
I20260709 13:05:27.578687 18146 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:27.626133 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 128554us
I20260709 13:05:27.633955 18045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47410 (request call id 7) took 3762 ms. Trace:
I20260709 13:05:27.661747 18191 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:27.670125 18193 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:05:27.672281 18197 ts_tablet_manager.cc:933] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:05:27.676787 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:27.678956 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.686884 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.693727 18095 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.695621 18184 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:27.696287 18184 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.697741 18042 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:27.698287 18186 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.521s	user 0.004s	sys 0.000s
I20260709 13:05:27.698498 18184 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:27.699463 17979 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.701686 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:27.702402 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.702867 18101 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.703706 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.711163 18095 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:27.717722 15516 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:27.654323 18173 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.731691 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:27.735158 15516 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:27.689128 18191 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.662210 18140 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.748659 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.748934 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:27.749919 15518 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:27.754844 15515 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:27.757501 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.758169 15515 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:27.759656 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:27.760972 15514 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 1873) took 3557 ms (client timeout 1647 ms). Trace:
W20260709 13:05:27.761528 15514 rpcz_store.cc:269] 0709 13:05:24.199324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.205918 (+  6594us) service_pool.cc:224] Handling call
0709 13:05:27.756419 (+3550501us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54003778d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:27.756605 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4382847872}
I20260709 13:05:27.766645 15514 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:27.768365 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1913) took 1015 ms. Trace:
I20260709 13:05:27.768898 15514 rpcz_store.cc:276] 0709 13:05:26.752779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.765821 (+1013042us) service_pool.cc:224] Handling call
0709 13:05:27.766356 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.768089 (+  1733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.768296 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14208}
I20260709 13:05:27.771073 15516 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:05:27.772881 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:27.773244 15514 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:27.774166 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1914) took 1021 ms. Trace:
I20260709 13:05:27.775027 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 391) took 1241 ms. Trace:
I20260709 13:05:27.775274 15514 rpcz_store.cc:276] 0709 13:05:26.753029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.771028 (+1017999us) service_pool.cc:224] Handling call
0709 13:05:27.771445 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.773816 (+  2371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.774091 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:27.775458 15517 rpcz_store.cc:276] 0709 13:05:26.533990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.817341 (+283351us) service_pool.cc:224] Handling call
0709 13:05:26.817712 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.967434 (+149722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:26.967485 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:26.967569 (+    84us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:26.967616 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.774771 (+807155us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540036a1d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:27.774841 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.774956 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343772928}
I20260709 13:05:27.768142 17809 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:27.785398 18127 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 2.041s	user 0.010s	sys 0.006s
I20260709 13:05:27.785791 17809 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.789009 17809 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:27.781036 18146 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:27.798717 18146 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:27.791910 18173 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.795579 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.801787 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1911) took 1056 ms. Trace:
I20260709 13:05:27.805476 15511 rpcz_store.cc:276] 0709 13:05:26.745823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.823151 (+ 77328us) service_pool.cc:224] Handling call
0709 13:05:26.823633 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.087074 (+263441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.801405 (+714331us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400295754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:27.801704 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604112640}
I20260709 13:05:27.806988 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 392) took 1015 ms. Trace:
I20260709 13:05:27.807612 15516 rpcz_store.cc:276] 0709 13:05:26.792063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.777098 (+985035us) service_pool.cc:224] Handling call
0709 13:05:27.806222 (+ 29124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.806500 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.806540 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:27.806602 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:27.806649 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.806726 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.806880 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:27.811990 15512 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:05:27.800827 18174 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.008s
I20260709 13:05:27.817740 15509 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:27.822130 15511 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:05:27.822856 15511 pending_rounds.cc:85] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:27.823180 15511 pending_rounds.cc:107] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:05:27.823791 15511 raft_consensus.cc:2889] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:27.811566 18196 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.665707 18045 rpcz_store.cc:276] 0709 13:05:23.826617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.826950 (+   333us) service_pool.cc:224] Handling call
0709 13:05:23.886594 (+ 59644us) log.cc:844] Serialized 506 byte log entry
0709 13:05:25.115497 (+1228903us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54001da220. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd0142 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354 000000000038f199 00007fcf78c6a475
0709 13:05:25.122223 (+  6726us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b54001da220. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd7b26 00007fcf7bcd149a 00007fcf7bcd0714 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354
0709 13:05:25.126002 (+  3779us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b180016ab00. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:27.589016 (+2463014us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349853,"raft.queue_time_us":276137,"raft.run_cpu_time_us":15640,"raft.run_wall_time_us":2126765,"spinlock_wait_cycles":55408128,"thread_start_us":691369,"threads_started":2,"wal-append.queue_time_us":315458,"wal-append.run_cpu_time_us":2385,"wal-append.run_wall_time_us":1043309}
W20260709 13:05:27.830248 15555 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.507s (SENT)
W20260709 13:05:27.833604 18195 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.108s	user 0.004s	sys 0.000s
I20260709 13:05:27.833858 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 390) took 1309 ms. Trace:
I20260709 13:05:27.834038 15516 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:05:27.836369 18173 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:27.818630 18001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.005s	sys 0.025s
I20260709 13:05:27.847330 15513 rpcz_store.cc:276] 0709 13:05:26.524110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.524426 (+   316us) service_pool.cc:224] Handling call
0709 13:05:26.524903 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.546377 (+ 21474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:26.546424 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:26.546488 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:26.546547 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.833546 (+1286999us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5400212854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:27.833605 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.833785 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48353024}
W20260709 13:05:27.858676 18001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.006s	sys 0.025s
I20260709 13:05:27.876157 18081 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:27.845652 18196 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:27.860558 18173 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:27.886138 18173 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:27.887071 18022 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.887781 18022 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.889045 15517 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:27.889405 15517 pending_rounds.cc:85] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 1
I20260709 13:05:27.889674 15517 pending_rounds.cc:107] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:27.889927 15517 raft_consensus.cc:2889] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:27.891573 17964 consensus_meta.cc:287] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.003s
I20260709 13:05:27.892096 17964 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:27.894225 17964 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:27.896937 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.898404 15516 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:27.899993 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.906694 15516 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:27.847958 18146 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:27.925705 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:27.948858 15585 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:27.950513 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:27.955075 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:27.960537 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:27.929283 18206 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:05:27.968115 15516 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:27.970595 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.972092 15516 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:27.977006 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:27.977331 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:27.977828 15588 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:27.978652 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:27.867970 18163 consensus_meta.cc:287] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.002s
I20260709 13:05:27.980191 15510 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:05:27.981281 15513 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:05:27.985476 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:27.986740 15589 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:27.988920 15588 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:27.991003 15591 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:27.991122 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:27.856158 18197 tablet_copy_client.cc:323] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:05:27.993144 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1912) took 1240 ms. Trace:
I20260709 13:05:27.961526 17686 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.993553 15515 rpcz_store.cc:276] 0709 13:05:26.752529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.765919 (+1013390us) service_pool.cc:224] Handling call
0709 13:05:27.766290 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.770076 (+  3786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.770111 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.773162 (+  3051us) log.cc:844] Serialized 26 byte log entry
0709 13:05:27.967294 (+194132us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:27.967363 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.967485 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.992873 (+ 25388us) raft_consensus.cc:1685] finished
0709 13:05:27.992896 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.993063 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3014,"raft.queue_time_us":1171,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":2600,"thread_start_us":157139,"threads_started":1,"wal-append.queue_time_us":190341}
I20260709 13:05:27.958947 18092 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:28.000857 15515 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:28.001897 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 157130us
I20260709 13:05:27.928464 17709 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:05:27.963964 18035 ts_tablet_manager.cc:1929] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
W20260709 13:05:28.005237 15555 leader_election.cc:336] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.889s (SENT)
I20260709 13:05:28.005879 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:28.007944 18092 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:28.006740 17686 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:28.020731 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.994019 18196 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:28.027719 17686 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:28.024494 17900 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:28.030591 15556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.006s	sys 0.019s
W20260709 13:05:28.030951 15556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.006s	sys 0.019s
I20260709 13:05:28.032754 15586 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:28.027864 15584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1863) took 2277 ms (client timeout 2221 ms). Trace:
W20260709 13:05:28.033334 15584 rpcz_store.cc:269] 0709 13:05:25.750853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.751129 (+   276us) service_pool.cc:224] Handling call
0709 13:05:28.027634 (+2276505us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002486d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:28.027780 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2564080384}
I20260709 13:05:28.033910 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1585) took 1047 ms. Trace:
W20260709 13:05:28.031275 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 853983us
I20260709 13:05:28.034288 15511 rpcz_store.cc:276] 0709 13:05:26.986798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.844222 (+857424us) service_pool.cc:224] Handling call
0709 13:05:27.863906 (+ 19684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.864443 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.864488 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.865180 (+   692us) log.cc:844] Serialized 26 byte log entry
0709 13:05:27.987843 (+122663us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:27.988157 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:05:27.988907 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.989328 (+   421us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:28.033652 (+ 44324us) raft_consensus.cc:1685] finished
0709 13:05:28.033676 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.033848 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":371,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":41,"raft.queue_time_us":2160,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":5108,"thread_start_us":59618,"threads_started":1,"wal-append.queue_time_us":59260}
I20260709 13:05:27.046799 15482 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40670 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1563)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34302 (request call id 394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1912)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1913)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1914)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1545)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1559)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1587)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 395)
I20260709 13:05:28.042877 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.043114 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:27.994994 18191 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:28.044001 15435 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:28.043996 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.045991 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.049674 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.051404 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.051736 15585 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:28.052244 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.053365 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.052285 15591 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:28.055908 18146 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:28.056571 18146 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.059558 15556 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:28.072184 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 393) took 1255 ms. Trace:
I20260709 13:05:28.024464 18035 log.cc:1199] T 952f15e68b0745e5a8ca26a3b527cab0 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/952f15e68b0745e5a8ca26a3b527cab0
I20260709 13:05:28.087237 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.089805 15514 rpcz_store.cc:276] 0709 13:05:26.817077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.778833 (+961756us) service_pool.cc:224] Handling call
0709 13:05:27.787008 (+  8175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.787432 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.787469 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.788027 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:05:27.967820 (+179793us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:27.967880 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.967976 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:28.071766 (+103790us) raft_consensus.cc:1685] finished
0709 13:05:28.071814 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.072077 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5067,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":179423,"threads_started":1,"wal-append.queue_time_us":267942}
W20260709 13:05:28.193828 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.143178 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 137965us
I20260709 13:05:28.187654 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.142825 15440 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:28.177165 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.141857 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.202674 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.095669 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:28.142340 15516 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:28.198293 15588 raft_consensus.cc:2410] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:28.201882 15436 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 7. Ops: [5.7-5.7]
I20260709 13:05:28.203995 15443 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:28.206315 15592 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:28.151048 15515 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:28.207655 15438 raft_consensus.cc:2368] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:28.212061 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:28.208369 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.101s (SENT)
I20260709 13:05:28.213512 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:28.209930 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.208729 15515 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:28.215621 15515 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.217785 15589 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:28.218444 15438 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:28.220474 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.221328 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.221724 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.228685 15437 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:28.229218 15443 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:28.230614 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.232357 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.234601 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.236282 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:28.244482 15482 connection.cc:256] RPC call timeout handler was delayed by -3.0012568859999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
I20260709 13:05:28.226418 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.247598 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:28.128674 18209 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:05:28.252573 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:28.094208 17686 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:28.253921 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.254166 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.254662 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.255875 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.261639 15439 raft_consensus.cc:2410] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:28.256289 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.256376 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:28.140532 18207 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:05:28.263200 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54870.3us
I20260709 13:05:28.264582 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:28.269193 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:28.276153 15586 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:28.280197 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:28.281198 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:28.283465 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.286935 15439 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:28.288288 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.306027 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:28.306650 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.306730 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.307523 15513 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 2.
I20260709 13:05:28.289667 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.308981 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.129597 18092 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:28.293440 15436 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:28.311822 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.312829 15436 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:28.282408 18165 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:28.227164 18170 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.289525 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.154675 17809 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 13:05:28.294981 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.326735 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.260171 18065 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:28.315433 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:28.319885 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.280575 18196 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:28.328533 15585 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:28.344022 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.345062 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.349433 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:28.352334 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:28.357610 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:28.357893 15439 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:28.281250 18081 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:05:28.365422 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.307802 18174 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:28.372357 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.377897 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.378669 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:28.382668 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.384861 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:28.372195 18056 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:28.372807 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.368891 17809 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:28.357250 18065 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:28.373698 18196 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:28.308241 18146 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:28.324187 18165 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:28.375639 18092 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:28.403244 15591 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:28.408828 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.409878 15514 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
W20260709 13:05:28.411871 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.411790 15440 raft_consensus.cc:1217] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[6.4-8.5]   Dedup: 8.5->[]
I20260709 13:05:28.412503 15440 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:05:28.416003 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.417201 15513 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:28.359932 18170 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.389370 15585 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:28.421325 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.422013 15585 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:28.399915 18065 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:28.393435 17809 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:28.404599 18165 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:28.418524 18146 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:28.419440 18035 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46586 (request call id 72) took 5100 ms. Trace:
I20260709 13:05:28.441457 15591 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:28.422737 17686 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:28.462327 15585 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:05:28.445394 18146 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:28.503084 18217 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:05:28.504732 18210 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.539s	user 0.002s	sys 0.000s
W20260709 13:05:28.505153 18218 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:05:28.508541 18168 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 1.673s	user 0.006s	sys 0.000s
W20260709 13:05:28.520619 18219 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
W20260709 13:05:28.560105 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.428814 15509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1549) took 1517 ms (client timeout 1919 ms). Trace:
W20260709 13:05:28.567384 15509 rpcz_store.cc:269] 0709 13:05:26.911219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.292534 (+381315us) service_pool.cc:224] Handling call
0709 13:05:28.428538 (+1136004us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54003f61d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:28.428723 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172347264}
W20260709 13:05:28.568948 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 299690us
I20260709 13:05:28.430552 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.572862 15513 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:28.411137 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:27.797855 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:28.577690 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.577749 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:28.580534 15510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1567) took 1643 ms (client timeout 1507 ms). Trace:
W20260709 13:05:28.581182 15510 rpcz_store.cc:269] 0709 13:05:26.937480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.972849 (+ 35369us) service_pool.cc:224] Handling call
0709 13:05:28.580032 (+1607183us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b54002e2a54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:28.580317 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2299340160}
I20260709 13:05:28.584918 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1545) took 1674 ms. Trace:
I20260709 13:05:28.585675 15518 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:28.585636 15517 rpcz_store.cc:276] 0709 13:05:26.909991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.783715 (+873724us) service_pool.cc:224] Handling call
0709 13:05:27.812550 (+ 28835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.890415 (+ 77865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.584197 (+693782us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b5400213254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:28.584639 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175046528}
I20260709 13:05:28.574872 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:28.589650 15513 raft_consensus.cc:3055] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:28.590410 15518 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:28.594771 15512 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:05:28.657178 15512 pending_rounds.cc:85] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 4
I20260709 13:05:28.657567 15512 pending_rounds.cc:107] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:05:28.657935 15512 raft_consensus.cc:2889] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:28.658830 17875 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.596318 15442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 246) took 2476 ms (client timeout 1901 ms). Trace:
I20260709 13:05:28.600822 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.603972 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:28.659760 15442 rpcz_store.cc:269] 0709 13:05:26.119594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.138002 (+ 18408us) service_pool.cc:224] Handling call
0709 13:05:28.595738 (+2457736us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400069d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:28.596029 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271668608}
I20260709 13:05:28.661988 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.606045 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.665285 15585 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:28.616277 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.667023 15592 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:28.604312 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.628500 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.629172 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.669723 15585 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:28.634797 15511 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:28.626897 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.580353 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.570797 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.640611 17686 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:28.652510 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.478082 17809 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:28.653379 17815 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:28.688392 15516 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:28.664261 15590 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:28.665352 15584 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:28.611652 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.662019 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1561) took 1747 ms. Trace:
I20260709 13:05:28.624815 16175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 304) took 1523 ms. Trace:
I20260709 13:05:28.633148 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:28.675966 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.698166 16177 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:28.699774 16175 rpcz_store.cc:276] 0709 13:05:27.101536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.103029 (+  1493us) service_pool.cc:224] Handling call
0709 13:05:27.110676 (+  7647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.552365 (+441689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.623918 (+1071553us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54005f0fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:28.624432 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925273856}
I20260709 13:05:28.697032 15512 rpcz_store.cc:276] 0709 13:05:26.914843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.813388 (+898545us) service_pool.cc:224] Handling call
0709 13:05:28.593654 (+780266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:28.658639 (+ 64985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.661730 (+  3091us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54002e2a50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:28.661954 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793167616}
I20260709 13:05:28.676925 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.704407 15585 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:28.678540 15406 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40676 dropped due to backpressure: service queue is full with 50 items [suppressed 36 similar messages]
I20260709 13:05:28.680775 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:28.687068 17809 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:28.507782 18124 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:28.647164 17709 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.688745 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:28.656450 15513 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:28.660010 17875 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.721458 15341 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 106) took 8147 ms. Trace:
I20260709 13:05:28.448881 18035 rpcz_store.cc:276] 0709 13:05:23.336412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.401175 (+ 64763us) service_pool.cc:224] Handling call
0709 13:05:23.842272 (+441097us) ts_tablet_manager.cc:1151] Deleting tablet 952f15e68b0745e5a8ca26a3b527cab0
0709 13:05:23.842382 (+   110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:05:27.431424 (+3589042us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:27.946211 (+514787us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:28.403320 (+457109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1181627,"tablet-delete.queue_time_us":318805,"thread_start_us":233823,"threads_started":1}
I20260709 13:05:28.731115 18046 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:28.688431 17815 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:28.809535 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 151425us
I20260709 13:05:28.817503 15586 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:28.836383 18170 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:28.835932 15513 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.838563 15513 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:05:28.828675 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 150348us
I20260709 13:05:28.845422 18046 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.499630 18146 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:28.854883 17875 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:28.861790 18147 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.863159 17912 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.862943 18147 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:28.864187 17912 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.864933 16182 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 7. Ops: []
I20260709 13:05:28.866591 18147 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:28.866995 16178 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:28.867785 17709 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.869652 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:28.871187 18079 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.871567 18124 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:28.867230 17912 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:28.872437 18079 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:28.873423 18124 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.875136 18124 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:28.868439 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:28.867405 18147 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:28.828760 18172 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:28.867040 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:28.880023 18056 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:28.884471 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 532042us
I20260709 13:05:28.810700 15341 rpcz_store.cc:276] 0709 13:05:20.573750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.574678 (+   928us) service_pool.cc:224] Handling call
0709 13:05:28.720947 (+8146269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:26.364706 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:26.401942 (+ 37236us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:26.401982 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:05:26.402003 (+    21us) tablet.cc:662] Decoding operations
0709 13:05:26.402892 (+   889us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:26.402967 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:26.402998 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:05:26.532790 (+129792us) tablet.cc:701] Row locks acquired
0709 13:05:26.539758 (+  6968us) write_op.cc:260] PREPARE: finished
0709 13:05:26.559592 (+ 19834us) write_op.cc:270] Start()
0709 13:05:26.565287 (+  5695us) write_op.cc:276] Timestamp: P: 1783602326556792 usec, L: 0
0709 13:05:26.579893 (+ 14606us) op_driver.cc:348] REPLICATION: starting
0709 13:05:26.711338 (+131445us) log.cc:844] Serialized 2448 byte log entry
0709 13:05:27.050042 (+338704us) op_driver.cc:464] REPLICATION: finished
0709 13:05:27.513149 (+463107us) write_op.cc:301] APPLY: starting
0709 13:05:27.520062 (+  6913us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:27.545220 (+ 25158us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:27.573237 (+ 28017us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:27.680754 (+107517us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:27.735680 (+ 54926us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:05:27.735742 (+    62us) write_op.cc:312] APPLY: finished
0709 13:05:27.741939 (+  6197us) log.cc:844] Serialized 53 byte log entry
0709 13:05:27.755410 (+ 13471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:27.755860 (+   450us) write_op.cc:454] Released schema lock
0709 13:05:27.760792 (+  4932us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:27.783065 (+ 22273us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:27.789534 (+  6469us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":453234,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":449899,"apply.run_cpu_time_us":5346,"apply.run_wall_time_us":274875,"num_ops":6,"prepare.queue_time_us":593860,"prepare.run_cpu_time_us":28855,"prepare.run_wall_time_us":412118,"raft.queue_time_us":170762,"raft.run_cpu_time_us":39194,"raft.run_wall_time_us":429628,"replication_time_us":469959,"thread_start_us":903390,"threads_started":4,"wal-append.queue_time_us":165108,"wal-append.run_cpu_time_us":29598,"wal-append.run_wall_time_us":1963940}]]}
I20260709 13:05:28.854887 18146 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:28.896746 17815 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.898409 17709 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:28.859164 18081 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:28.900424 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet 952f15e68b0745e5a8ca26a3b527cab0 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
W20260709 13:05:28.905709 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 514541us
I20260709 13:05:28.908793 15482 leader_election.cc:400] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:28.911109 18092 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:28.913934 15515 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:28.916363 16178 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:28.918509 18022 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:28.922668 18079 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:28.953604 15482 leader_election.cc:403] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:28.957669 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:28.961165 15326 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 61020.7us
I20260709 13:05:28.956899 18056 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.964468 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:28.977407 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 68984.5us
I20260709 13:05:28.974094 18147 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:28.993156 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 193897us
I20260709 13:05:28.995790 17911 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:28.997746 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:28.998696 15516 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:05:28.982798 18079 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:29.012809 18147 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:29.013249 18056 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:29.013832 18165 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.008s
I20260709 13:05:28.966975 18172 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.985662 18092 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:29.022631 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:29.043742 18110 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:29.044386 18066 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.044697 18110 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:29.045162 18066 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:29.046717 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:29.047879 18234 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:29.048835 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:29.051448 18160 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:29.052080 18160 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.052640 18160 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:29.053846 17896 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:29.054189 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:29.051975 17900 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.054396 17896 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:29.056325 17896 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:29.056576 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 112202us
I20260709 13:05:29.059041 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:29.060359 15442 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:29.061858 18056 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:29.063124 18056 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:29.063323 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:29.063601 18056 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:29.064230 15437 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:29.065091 18056 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.065668 18000 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:29.048610 18234 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:28.991797 18081 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.067050 18056 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:29.085506 15592 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:29.052304 15337 catalog_manager.cc:5697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:29.088704 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 131201us
I20260709 13:05:29.088100 15586 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:29.099186 15514 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:29.103642 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44768.5us
I20260709 13:05:29.033568 18165 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.120491 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:29.121650 18165 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:29.122572 18163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.008s	sys 0.018s
I20260709 13:05:29.122237 18000 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:29.123003 18163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.009s	sys 0.018s
I20260709 13:05:29.101982 18110 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:29.123881 18000 consensus_queue.cc:1059] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.124239 18062 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:29.125488 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:29.126456 17964 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:29.126803 17997 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:29.126950 17964 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:29.127374 17997 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:29.128867 18239 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:29.125428 18000 consensus_queue.cc:1059] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:29.128413 17964 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.113673 15588 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:29.128772 17997 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.129559 18239 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:29.130477 17997 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.130934 17964 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:29.128414 18245 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:29.131673 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.133170 18092 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:29.139873 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 93356.2us
I20260709 13:05:29.141225 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:29.113291 18234 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:29.148916 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 45056.6us
I20260709 13:05:29.149677 17896 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.151575 17900 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:29.157352 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:29.130968 18239 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.172797 17709 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.173714 17709 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:29.174736 18081 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:29.175873 18152 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:29.176306 17709 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:29.176620 18152 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:29.177567 17709 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:29.179061 18152 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:29.182492 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.182188 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:29.188860 15588 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:05:29.195658 15512 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:29.198887 15437 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:29.199705 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:29.200444 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 59430.8us
I20260709 13:05:29.202971 18062 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:29.203842 17964 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.107602 18066 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:29.206578 18066 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:29.207870 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.207753 18234 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:29.208914 18066 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:29.209363 18066 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:29.209219 18191 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:05:29.210047 17896 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:29.203761 17686 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.210476 18066 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.211639 18165 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:29.212694 18165 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:29.213107 18165 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:29.214347 18165 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:29.202199 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:29.224634 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
W20260709 13:05:29.233803 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.242650 17809 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.510s	user 0.014s	sys 0.000s
W20260709 13:05:29.250401 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53981.8us
I20260709 13:05:29.253975 18231 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.265439 18046 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:29.267081 17815 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:29.183768 17912 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:05:29.268971 17912 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:29.269609 17912 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:29.272586 17875 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:29.272485 18081 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.273993 18172 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:29.276130 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.274307 15337 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:29.301471 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 07d5db06e4ec455f8b7755416957114a: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:29.302350 15337 catalog_manager.cc:5697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 6, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 6 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:29.304395 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:29.249337 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:29.307404 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 58334.7us
I20260709 13:05:29.310521 18046 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:29.311030 18046 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.311429 18046 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:29.323289 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:29.323592 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:29.310624 15437 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:05:29.283941 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.280328 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 55772.8us
I20260709 13:05:29.361009 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:29.383471 15515 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:29.386108 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:29.284221 18147 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:29.384122 15515 pending_rounds.cc:85] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 6
I20260709 13:05:29.395629 15515 pending_rounds.cc:107] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:29.396001 15515 raft_consensus.cc:2889] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:29.389976 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 52384.4us
I20260709 13:05:29.267113 18165 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:29.279752 18247 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:29.278985 17875 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:29.401691 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.271112 17912 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:05:29.390638 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 207836us
W20260709 13:05:29.407891 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53110us
I20260709 13:05:29.409140 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:29.402813 15513 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:05:29.381853 17896 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:29.422952 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:29.287799 18160 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:29.424466 17875 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.328857 17686 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 13:05:29.394829 18147 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:29.422452 15513 pending_rounds.cc:85] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 6
I20260709 13:05:29.442314 15513 pending_rounds.cc:107] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:29.423182 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:29.400691 15337 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:29.443235 15513 raft_consensus.cc:2889] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:29.405766 18247 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:29.452047 18162 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:05:29.454226 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:29.455485 18247 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.429817 17896 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.457257 18247 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.457495 17896 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:29.461164 15337 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 6 to 7, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.465863 18062 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:29.467053 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:29.468984 15443 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:29.471388 18146 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:29.472707 18249 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:05:29.472882 18146 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:29.473459 18146 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:29.474598 18146 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.478374 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:29.486303 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 401) took 1305 ms. Trace:
I20260709 13:05:29.487002 15515 rpcz_store.cc:276] 0709 13:05:28.146096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.150642 (+  4546us) service_pool.cc:224] Handling call
0709 13:05:28.150915 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:28.913436 (+762521us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b58008441d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd4dfe7 00007fcf7bd4f7de 00007fcf7bd59b49 00007fcf7bd5a416 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4
0709 13:05:29.444565 (+531129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.451426 (+  6861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515709824}
I20260709 13:05:29.496924 15337 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.505682 17809 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:29.495034 18046 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:29.538162 18191 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:29.538782 18191 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:29.538950 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.514195 17686 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:29.554185 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 352156us
I20260709 13:05:29.518522 17900 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:05:29.543108 18191 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:29.598140 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.595888 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.597105 18046 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:29.557297 15337 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.677913 18056 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:29.678769 18163 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:29.679476 18163 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.681599 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:29.682412 18163 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:29.548573 18254 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:05:29.596223 18146 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.596045 18155 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:05:29.718879 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 240604us
I20260709 13:05:29.595503 18241 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.163s
I20260709 13:05:29.595705 18105 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.198s
W20260709 13:05:29.723479 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.563144 16177 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:29.751276 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:29.678812 18056 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:29.739598 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 436638us
W20260709 13:05:29.730386 18239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.065s	sys 0.112s
W20260709 13:05:29.764052 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.765390 15337 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 8, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.621376 18147 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.558869 18234 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:29.711896 18081 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:29.715248 18163 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.732626 18254 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:29.760571 18239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.065s	sys 0.113s
I20260709 13:05:29.559667 17686 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.775599 18254 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:29.785844 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:29.784498 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:29.789961 15337 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 8, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.806041 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:29.777099 18234 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.813652 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:29.815905 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 64743.9us
I20260709 13:05:29.817299 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:29.808115 15337 catalog_manager.cc:5697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 6, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.818390 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:29.783500 18163 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:29.824649 18253 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:05:29.826016 18257 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:05:29.820636 15555 leader_election.cc:336] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.752s (SENT)
I20260709 13:05:29.831984 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:29.830562 18231 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.576s	user 0.014s	sys 0.000s
I20260709 13:05:29.835745 15337 catalog_manager.cc:5697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 4, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.846560 15591 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:29.819861 18081 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.849169 15407 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:29.866189 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.852295 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 344189us
W20260709 13:05:29.868741 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 83113.3us
W20260709 13:05:29.863019 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.871316 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66566.9us
I20260709 13:05:29.849068 18231 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:29.927347 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.937939 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86509.8us
W20260709 13:05:29.938741 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.874029 18056 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:29.873009 18230 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:29.940378 18257 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:29.872345 18266 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.935066 18191 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.946740 15337 catalog_manager.cc:5697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 4, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.853268 18155 consensus_queue.cc:1059] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
W20260709 13:05:29.959559 15555 leader_election.cc:336] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.754s (SENT)
I20260709 13:05:29.846611 18254 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:29.971949 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:29.993543 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:30.021589 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 187892us
I20260709 13:05:29.968704 15337 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 3, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 3 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:30.031388 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:30.030941 15337 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 5, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 5 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:05:30.032370 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 64933.5us
I20260709 13:05:30.033154 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:30.033260 15337 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.035431 18191 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.035140 15337 catalog_manager.cc:5697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:30.039158 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 97301.5us
I20260709 13:05:29.951464 18263 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:05:30.029984 18230 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:29.966213 18255 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 13:05:30.060467 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.985535 18266 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:30.069063 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.079845 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 132413us
I20260709 13:05:30.051954 18163 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.063490 18191 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:30.086546 18191 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.086977 18191 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.088342 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:30.089399 18081 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.090178 18000 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:30.070119 18264 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:30.092311 18247 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.635s	user 0.015s	sys 0.001s
I20260709 13:05:30.092904 18155 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:30.092461 18264 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:30.068286 18269 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:30.051122 18165 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:30.093364 18155 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:30.053256 17964 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:30.111658 17964 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:30.112195 15555 leader_election.cc:336] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.777s (SENT)
I20260709 13:05:30.112799 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:30.112912 17964 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.096915 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:30.093252 18256 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 13:05:30.114137 15555 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.919s (SENT)
I20260709 13:05:30.114558 17911 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:30.115048 17911 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:30.065292 17686 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:30.115913 18274 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:30.060818 18234 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:30.098176 18269 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.099433 18066 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:30.106905 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 73798.8us
W20260709 13:05:30.115226 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.948s (SENT)
I20260709 13:05:30.129825 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:30.115983 17911 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.139377 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:30.071923 18266 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.124572 18269 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.154960 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.172775 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:30.176432 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.179836 15509 raft_consensus.cc:2410] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:05:30.184084 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:30.187676 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:30.190862 15513 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:05:30.191331 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.190465 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:30.184927 17896 consensus_meta.cc:287] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.727s	user 0.016s	sys 0.000s
I20260709 13:05:30.195740 15518 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:30.154834 18165 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.184016 17911 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:30.170794 18146 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:30.204789 15510 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:30.190984 17964 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:30.189788 18062 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:30.180075 18230 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:30.211170 15437 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:30.213485 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 98282.4us
I20260709 13:05:30.206884 18265 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:30.214571 15443 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:30.209059 18231 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:30.207782 18259 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.278s	user 0.000s	sys 0.002s
I20260709 13:05:30.220551 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:30.222951 15555 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.070s (SENT)
I20260709 13:05:30.224938 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:30.218420 18230 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.229262 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:30.239459 15442 raft_consensus.cc:2410] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:30.242492 15510 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:30.243790 15511 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:30.220778 18000 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:30.203701 17896 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:30.285552 15518 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:30.282720 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:30.210863 17964 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:30.298554 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 73003.4us
I20260709 13:05:30.300976 15509 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.302088 15586 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:30.220984 18146 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.303313 15406 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:30.253048 18268 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.222223 18231 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.284794 18269 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:30.331442 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.332124 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.311096 18279 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:30.311480 18276 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:30.312458 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:30.313819 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 94087.9us
I20260709 13:05:30.317795 18155 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.321722 17964 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:30.322209 18263 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:30.328498 18230 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:30.228296 18062 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:30.302034 18275 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:30.364405 15452 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 5b97fcd3d908482fadc6fa54e513304d from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:05:30.365381 15452 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 5b97fcd3d908482fadc6fa54e513304d from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-5b97fcd3d908482fadc6fa54e513304d
I20260709 13:05:30.368378 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:30.368805 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:30.368945 15439 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:30.370138 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:30.370815 15436 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:30.370931 15441 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:30.311388 17809 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:30.375845 17809 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.348888 18191 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.378373 18191 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.380129 15440 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:30.339572 18255 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:05:30.308843 18264 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:30.370143 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:30.355737 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.384924 15435 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
W20260709 13:05:30.387126 15555 leader_election.cc:336] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.108s (SENT)
I20260709 13:05:30.356166 15443 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:30.358677 18263 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:30.343585 18269 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.360047 18155 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.361737 18146 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.428210 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:30.358291 18271 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:05:30.368945 18280 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:30.440405 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.441926 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:30.444813 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.447600 15518 raft_consensus.cc:2410] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:30.442843 15442 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
W20260709 13:05:30.453274 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66219.1us
I20260709 13:05:30.419785 18276 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.431749 18263 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.457187 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:30.457592 15514 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:30.458423 15443 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.465852 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:30.345619 18268 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:30.473974 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.481108 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:30.479732 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 176513us
I20260709 13:05:30.491609 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.482734 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:30.492815 15518 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
W20260709 13:05:30.494939 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.455722 18247 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:30.499264 15555 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.181s (SENT)
I20260709 13:05:30.499801 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:30.506295 15509 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:30.496150 17912 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:05:30.504606 18256 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:05:30.513706 17912 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.490782 18165 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.521106 18268 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:30.515249 18256 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:30.522069 18269 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.522382 18256 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:30.522761 17686 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:30.523340 18247 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:30.523849 17964 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.523574 18256 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.523929 17896 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:30.526136 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.527029 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.533309 15518 raft_consensus.cc:2393] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:30.536252 15514 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:30.535990 15515 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:30.539362 15443 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:30.539819 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:30.543924 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.481180 18239 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:05:30.542671 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:30.551460 15514 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.464351 18276 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.554574 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.559653 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:30.559842 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69454.6us
I20260709 13:05:30.566402 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:30.566812 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:30.586627 18262 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.762s	user 0.002s	sys 0.002s
I20260709 13:05:30.573370 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:30.582858 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.587283 18231 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:30.537284 18062 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:30.566370 15452 tablet_copy_source_session.cc:215] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:30.607843 15591 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:30.616339 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:30.620018 15592 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:30.607118 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:30.611924 15518 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:30.632241 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:30.637023 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:30.638552 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:30.552610 18265 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:30.658414 15518 raft_consensus.cc:2410] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:30.590142 17911 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.655761 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.633423 18000 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:30.637238 17912 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:30.658030 18247 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.654575 17809 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:30.677264 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.683315 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 420) took 1218 ms. Trace:
I20260709 13:05:30.688884 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:30.683264 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.683523 17912 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:30.679062 17911 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:30.688061 15512 rpcz_store.cc:276] 0709 13:05:29.464852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.465043 (+   191us) service_pool.cc:224] Handling call
0709 13:05:29.465472 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.469943 (+  4471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.469986 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.470737 (+   751us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.764682 (+293945us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:29.764749 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.764865 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.585965 (+821100us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:30.682884 (+ 96919us) raft_consensus.cc:1685] finished
0709 13:05:30.682917 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.683207 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3962,"raft.queue_time_us":6765,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":4493696,"thread_start_us":293470,"threads_started":1,"wal-append.queue_time_us":350580}
I20260709 13:05:30.694254 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:30.667331 18066 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.711066 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.661659 18265 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:30.672559 18257 raft_consensus.cc:3055] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:30.716500 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 83151.5us
W20260709 13:05:30.704685 15407 consensus_peers.cc:597] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1915fdd81d344a749443e48f07a1fef8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.717233 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.673105 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:30.718336 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:30.716950 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.721086 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.722293 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.722198 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:30.723810 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.719094 15583 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:30.715281 18066 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.731309 18066 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:30.732669 15510 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:30.720633 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:30.741153 17809 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:30.741544 15586 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:30.742103 17912 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:30.751577 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.720530 18265 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:30.758512 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:30.732838 17815 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:30.720608 18257 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:30.774359 15514 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:30.781739 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:30.777302 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.756428 18062 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:30.802893 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:30.803375 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:30.772876 17815 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:30.834857 18295 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 13:05:30.980957 18276 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:30.915294 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:30.809369 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:30.809134 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:30.841571 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:30.825995 15512 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:05:30.929924 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 131687us
I20260709 13:05:30.801959 15513 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
W20260709 13:05:30.930289 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.929044 15515 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:30.916195 18239 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:05:30.875366 15587 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:30.787240 17964 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:30.995693 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:30.998368 15591 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.992719 15515 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:30.841741 18294 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.174s	user 0.000s	sys 0.002s
W20260709 13:05:30.972811 18301 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:30.834800 16176 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:05:30.809859 18247 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:30.991526 18254 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.991976 17911 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:31.026958 16146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.007s	sys 0.020s
I20260709 13:05:31.027812 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:31.033411 16146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.007s	sys 0.020s
W20260709 13:05:31.033896 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 539558us
I20260709 13:05:30.910626 15590 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:05:31.020799 17900 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:31.050681 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 279304us
I20260709 13:05:31.062695 15515 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.067813 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:31.072484 18305 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:05:31.075682 18147 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:31.077060 18155 consensus_meta.cc:287] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.007s
I20260709 13:05:30.912168 18257 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.080087 15515 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.808422 18000 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.045189 18276 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:31.103250 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.123195 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:31.102034 17900 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:31.144335 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.149868 15587 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:31.153861 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:31.155680 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:31.158010 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 95072.4us
I20260709 13:05:31.133319 18247 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:31.096508 18307 consensus_queue.cc:1059] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
W20260709 13:05:31.178025 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.180650 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 116434us
I20260709 13:05:31.183800 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:31.184768 15443 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:31.191956 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:31.167106 18155 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:31.194412 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.169638 18160 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:31.179100 18289 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:31.202211 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 99110.3us
I20260709 13:05:31.203203 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:31.203974 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.256088 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:31.258747 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:31.259397 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 56253.7us
I20260709 13:05:31.260363 15515 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:31.261436 15515 pending_rounds.cc:85] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:31.261740 15515 pending_rounds.cc:107] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:31.263476 15443 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:31.263770 15515 raft_consensus.cc:2889] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:31.295974 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:31.296237 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 119297us
I20260709 13:05:31.299438 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:31.260686 17900 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:31.208451 18226 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:31.258292 18247 consensus_queue.cc:1059] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:05:31.307130 15443 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:31.264362 18298 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:31.311164 18152 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:31.305910 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:31.266531 18318 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:31.314777 15407 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:31.313503 18066 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:05:31.319689 18314 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.139s	user 0.000s	sys 0.002s
W20260709 13:05:31.321849 18304 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.219s	user 0.000s	sys 0.002s
W20260709 13:05:31.322693 15555 connection.cc:256] RPC call timeout handler was delayed by -1.5170700580000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:05:31.327579 18247 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.337687 15591 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:31.294726 18308 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:05:31.260810 18309 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:05:31.317679 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:31.340914 15555 connection.cc:256] RPC call timeout handler was delayed by -1.4954700580000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 13:05:31.336833 18276 raft_consensus.cc:3055] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:05:31.342155 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 79489.2us
I20260709 13:05:31.344554 15443 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:31.347011 15555 connection.cc:256] RPC call timeout handler was delayed by -1.4756700579999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
I20260709 13:05:31.312173 18162 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:05:31.347038 15440 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:31.329084 18298 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:31.364516 18298 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.368036 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:31.305428 18239 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:05:31.370728 15440 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:31.352543 18256 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:31.354400 18257 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:31.354417 15555 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.611s (SENT)
I20260709 13:05:31.337488 18318 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:31.373596 18265 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.003s
I20260709 13:05:31.379561 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.347182 18187 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:31.393949 15516 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:05:31.394377 15516 pending_rounds.cc:85] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 3
I20260709 13:05:31.394590 15516 pending_rounds.cc:107] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:05:31.381621 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:31.348767 18276 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:31.387683 18265 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:31.385481 18318 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:31.349099 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 46026.7us
I20260709 13:05:31.394816 15516 raft_consensus.cc:2889] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:31.395408 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:31.396711 18308 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:31.401932 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.393252 18165 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:31.404529 18187 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:31.409580 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.421446 15510 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:31.423684 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:31.429014 18319 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.429746 18319 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.431711 18308 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.432042 18303 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:31.432210 18308 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:31.432543 18303 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:31.433549 18303 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.434186 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:31.434935 18303 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.435663 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:31.435997 18187 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.437039 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.437948 18265 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:31.439357 15443 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:31.445557 15518 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 13:05:31.447952 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 134811us
I20260709 13:05:31.455843 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:31.446154 15518 pending_rounds.cc:85] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:31.459710 15518 pending_rounds.cc:107] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:05:31.461251 15518 raft_consensus.cc:2889] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:31.467386 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 57886.5us
W20260709 13:05:31.443624 18263 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.969s	user 0.009s	sys 0.008s
I20260709 13:05:31.443259 18247 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.491381 15437 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:05:31.462940 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:31.486424 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:31.459408 18162 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:31.461493 18152 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:31.489423 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 135125us
I20260709 13:05:31.414803 18276 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.465287 18165 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.495762 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:31.497967 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.458158 18160 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:05:31.460685 18147 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:05:31.488363 18231 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:31.479305 18066 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:05:31.504328 17900 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:31.499095 18162 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:31.500098 18152 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.552596 18152 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:31.553758 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:31.534708 18297 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:31.535393 18329 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:31.535986 18328 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.538280 18142 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:31.542464 18326 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:05:31.543704 18066 consensus_queue.cc:1243] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:05:31.548648 18197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b97fcd3d908482fadc6fa54e513304d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.527505 18226 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:05:31.493204 18263 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.497197 18247 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:31.565452 18165 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.526206 18276 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.568456 17900 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:31.556939 18162 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.563202 18322 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.646857 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.515213 16175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b"
dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:50800
W20260709 13:05:31.648880 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 129787us
W20260709 13:05:31.649370 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 151334us
I20260709 13:05:31.643518 18152 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:31.664626 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 166732us
I20260709 13:05:31.671870 15442 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:31.673710 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:31.627360 18297 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:31.640239 18337 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:31.629967 18142 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:31.687924 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:31.569065 18329 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:31.691274 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 196843us
I20260709 13:05:31.708724 15435 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:31.675961 17912 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:31.711062 18187 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.653822 17964 consensus_queue.cc:1059] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:05:31.687247 18245 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.685969 16175 raft_consensus.cc:606] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:31.745427 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 57597.9us
W20260709 13:05:31.759016 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.712440 18165 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:31.762341 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.765790 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:31.673086 18322 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.757611 18147 raft_consensus.cc:3055] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:31.710131 18308 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:31.791836 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:31.792474 18346 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.793128 18346 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.793828 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:31.780145 18147 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:31.711963 18187 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.797292 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:31.757217 18245 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:31.693954 18337 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:31.769610 17900 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:31.778927 18142 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:31.984236 15438 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:31.903492 18322 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:31.777529 18336 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:31.952550 18319 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:31.965144 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.856142 18162 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:31.987619 18231 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:31.988715 18245 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:31.988911 18257 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.852236 18147 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:31.989874 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:31.990432 18319 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:31.901829 18344 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:31.974316 18241 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:31.986479 18336 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:31.905393 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.985314 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 228353us
W20260709 13:05:31.853068 18340 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:05:31.990543 18308 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:31.955426 18331 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 13:05:31.804710 18247 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
W20260709 13:05:31.861675 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.855113 18346 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:31.994009 18092 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.017297 18256 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:32.018914 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:31.995572 18152 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:31.852046 18329 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.010538 18245 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.008859 18231 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:32.031478 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:32.031179 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:32.015704 18241 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:31.854736 18298 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:32.036402 15512 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:32.045389 15510 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:32.023190 17964 consensus_queue.cc:1175] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:05:32.047318 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:32.047497 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:32.049232 15406 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:32.046722 18346 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:32.052116 18231 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:32.053236 18338 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:05:32.054200 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:32.031925 18263 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.035188 17875 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:32.031277 18092 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.027191 18147 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.059588 15510 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:32.024211 18257 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.012168 18319 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.067277 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:32.057534 18349 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:32.047363 18303 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.612s	user 0.017s	sys 0.001s
I20260709 13:05:31.785560 18297 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.066311 18322 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:32.071414 15518 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:05:32.072245 18298 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.068693 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:32.092378 15518 pending_rounds.cc:85] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 3
I20260709 13:05:32.092553 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:32.092828 15518 pending_rounds.cc:107] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:05:32.066901 18276 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:32.087531 15513 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:32.093292 15518 raft_consensus.cc:2889] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:32.073221 18336 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.076794 18165 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:32.102102 18162 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:32.085513 16178 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:32.093802 18318 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.004s
I20260709 13:05:32.121552 18062 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.121330 18318 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.122119 18062 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.074908 17997 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:05:32.110860 18241 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:32.124552 18241 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:32.125031 18318 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:32.126010 18325 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.800s	user 0.002s	sys 0.000s
I20260709 13:05:32.097828 18263 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:32.112756 18337 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:32.117040 18257 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.079720 18346 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:32.127521 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:32.130681 18346 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:32.089978 18349 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:32.132125 18230 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:32.132629 18230 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:32.133381 18349 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:32.113664 18187 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.133798 18230 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.139820 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1623) took 1442 ms. Trace:
I20260709 13:05:32.140453 15516 rpcz_store.cc:276] 0709 13:05:30.697146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.742809 (+ 45663us) service_pool.cc:224] Handling call
0709 13:05:31.378321 (+635512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.438932 (+ 60611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.139442 (+700510us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54002e2f50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:32.139710 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460384128}
I20260709 13:05:32.141445 18319 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.148741 18266 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.149698 18266 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.128340 18337 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.127878 18263 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.155406 18263 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.155563 18337 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:32.131289 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:32.113960 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:32.162526 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48672.1us
I20260709 13:05:32.167214 15510 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:32.179620 18276 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:32.180095 18359 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.184927 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:32.129382 18092 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:32.188396 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 57200.5us
I20260709 13:05:32.188864 15510 raft_consensus.cc:2410] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:32.172389 18289 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:32.190716 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:32.190500 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:32.198112 15510 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:32.199747 15510 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:32.199875 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:32.200027 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:32.200661 15515 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:32.184131 18230 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.196384 18165 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:32.184403 18346 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:32.210198 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:32.210777 15513 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:32.210901 15406 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:32.197847 18289 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.212711 18360 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:32.199174 18092 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:32.220081 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:32.215126 18337 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.224949 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:32.221956 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:32.225626 18319 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:32.225441 17875 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:32.228143 18000 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:32.228662 17875 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.228744 18000 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.229162 17875 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:32.229257 18000 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:32.213384 18155 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:05:32.219736 18297 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:32.225535 18092 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.219851 18289 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:32.244357 18276 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.245990 18092 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:32.247773 18266 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.248342 18297 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:32.249398 18297 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.259073 15515 raft_consensus.cc:2410] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:05:32.215667 18346 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:32.330637 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 108767us
I20260709 13:05:32.331959 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:32.333572 18320 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:32.334268 18320 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.335210 18165 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.336923 18320 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.338780 18197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52916 (request call id 417) took 5089 ms. Trace:
I20260709 13:05:32.347420 18147 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:32.347604 18361 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:32.355122 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:32.365612 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:32.367326 18257 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.348344 18147 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.377460 15510 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:32.653471 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:32.548666 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.378363 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:32.636245 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1747) took 1704 ms. Trace:
I20260709 13:05:32.378728 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:32.661254 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:32.546072 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.462103 15515 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:32.423943 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1967) took 1870 ms. Trace:
I20260709 13:05:32.893915 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:32.921132 15586 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:32.906262 18062 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:32.905611 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 573748us
I20260709 13:05:32.907709 15435 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:32.909562 15518 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:32.871902 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1759) took 1489 ms. Trace:
I20260709 13:05:32.908102 15442 rpcz_store.cc:276] 0709 13:05:30.932084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.932245 (+   161us) service_pool.cc:224] Handling call
0709 13:05:30.978918 (+ 46673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.683839 (+704921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.635887 (+952048us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b5400031454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:32.636143 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592962944}
I20260709 13:05:32.908877 15441 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:32.916721 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.935870 15556 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:32.932525 15443 rpcz_store.cc:276] 0709 13:05:31.382969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.384984 (+  2015us) service_pool.cc:224] Handling call
0709 13:05:31.385271 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.443087 (+ 57816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.863397 (+1420310us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b5400120054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:32.871768 (+  8371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123831680}
I20260709 13:05:32.926573 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:32.368211 18000 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.385975 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:32.377985 18257 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.566114 18289 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.948443 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:32.944238 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:32.955250 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:32.945055 15592 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:32.956070 15587 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:32.945477 15512 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:32.957221 15512 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:32.953346 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:32.948005 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:32.959378 15589 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:32.955307 15585 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:32.843526 17875 consensus_meta.cc:287] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.002s
I20260709 13:05:32.502427 17815 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.963063 17875 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:32.964227 18230 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:32.964710 18230 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.965082 18230 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.965665 17875 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.849496 16178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 320) took 1371 ms. Trace:
I20260709 13:05:32.966822 17815 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.966542 16178 rpcz_store.cc:276] 0709 13:05:31.478050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.479301 (+  1251us) service_pool.cc:224] Handling call
0709 13:05:31.519482 (+ 40181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.120772 (+601290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.849043 (+728271us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400520154. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:32.849390 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274373504}
I20260709 13:05:32.966557 15583 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:32.510430 18266 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:32.970270 18266 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:32.387872 18336 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:32.973706 18266 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:32.981719 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:32.984681 15584 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:32.986685 18147 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:32.988464 15587 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:32.989104 18346 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:32.339418 18197 rpcz_store.cc:276] 0709 13:05:27.248891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.249103 (+   212us) service_pool.cc:224] Handling call
0709 13:05:27.672729 (+423626us) ts_tablet_manager.cc:934] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
0709 13:05:31.465013 (+3792284us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:32.139844 (+674831us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:32.140016 (+   172us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:32.337558 (+197542us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:32.338024 (+   466us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:32.338487 (+   463us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:32.338627 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":81519,"tablet-copy.queue_time_us":422367,"thread_start_us":405616,"threads_started":2}
I20260709 13:05:32.991242 18197 tablet_copy_client.cc:806] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:32.992142 18197 tablet_copy_client.cc:670] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:32.999250 18297 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:33.000340 18297 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.001717 18289 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.003014 18297 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:32.943950 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.015933 15518 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:05:33.006922 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
W20260709 13:05:33.016934 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.022673 15441 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:33.025193 15585 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:33.017379 15588 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:32.525240 18337 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.026194 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.029677 15586 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
W20260709 13:05:32.635311 18299 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.922s	user 0.000s	sys 0.010s
I20260709 13:05:33.028412 15435 raft_consensus.cc:606] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.031613 15435 raft_consensus.cc:614] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:32.915452 15517 rpcz_store.cc:276] 0709 13:05:30.553242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.584257 (+ 31015us) service_pool.cc:224] Handling call
0709 13:05:30.584750 (+   493us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:30.636001 (+ 51251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.636052 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:30.654513 (+ 18461us) log.cc:844] Serialized 52 byte log entry
0709 13:05:31.403471 (+748958us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b18003876a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:05:31.462272 (+ 58801us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:31.465157 (+  2885us) log.cc:844] Serialized 14 byte log entry
0709 13:05:32.183310 (+718153us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b18003876a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd61716 00007fcf7bd72287 00007fcf7bd72208
0709 13:05:32.423312 (+240002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.423484 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.423574 (+    90us) raft_consensus.cc:1685] finished
0709 13:05:32.423595 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.423841 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31969,"prepare.queue_time_us":2572,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":144549,"raft.run_cpu_time_us":772,"raft.run_wall_time_us":5263,"spinlock_wait_cycles":11929216,"thread_start_us":298328,"threads_started":2,"wal-append.queue_time_us":859247,"wal-append.run_cpu_time_us":3180,"wal-append.run_wall_time_us":1022436}
I20260709 13:05:32.367426 18361 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:33.035331 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.036688 15589 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:32.999374 18062 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.074456 18062 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:32.947363 18000 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.006134 18318 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.062315 15586 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:33.050657 18361 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.063212 15590 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:33.035807 18336 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:33.070971 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:33.071954 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:32.384456 18263 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.060585 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:32.913986 18365 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:33.028184 18165 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:33.051131 15512 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.049181 18337 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.097080 15585 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:33.105417 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.110227 15512 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:33.092289 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:33.108906 18336 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:33.096124 18318 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.132054 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1966) took 2573 ms. Trace:
I20260709 13:05:33.132710 15509 rpcz_store.cc:276] 0709 13:05:30.548482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.554095 (+  5613us) service_pool.cc:224] Handling call
0709 13:05:30.562668 (+  8573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.563125 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.563154 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.564466 (+  1312us) log.cc:844] Serialized 506 byte log entry
0709 13:05:30.605677 (+ 41211us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:30.605720 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.605796 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.634447 (+2028651us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:33.116687 (+482240us) raft_consensus.cc:1685] finished
0709 13:05:33.116738 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.121644 (+  4906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27595136,"thread_start_us":40628,"threads_started":1,"wal-append.queue_time_us":108389}
I20260709 13:05:33.136132 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:33.136929 15443 raft_consensus.cc:606] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.137302 15443 raft_consensus.cc:614] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:33.111522 18165 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.119812 18230 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.111073 18365 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.138921 18336 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:33.166782 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 215019us
I20260709 13:05:33.199070 18230 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:33.167076 18257 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.200001 18062 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:33.191169 18371 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:33.181121 18247 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.216138 15338 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 3, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:33.218024 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9178296553b44a3f82267d1278be3746"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:33.189826 18276 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:33.218717 15443 raft_consensus.cc:606] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.221205 15443 raft_consensus.cc:614] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:33.226935 18369 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 13:05:33.214474 18372 ts_tablet_manager.cc:933] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:05:33.235214 15512 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:05:33.236220 15512 pending_rounds.cc:85] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 3
I20260709 13:05:33.236950 15512 pending_rounds.cc:107] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:05:33.237658 15512 raft_consensus.cc:2889] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:33.236927 18263 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.254015 18346 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.229926 18276 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.220309 18247 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:33.265241 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 356647us
I20260709 13:05:33.263202 18062 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.262562 18257 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.264289 18337 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.296700 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:33.298317 15443 raft_consensus.cc:606] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.305817 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.306805 18365 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:33.308403 18368 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:05:33.308656 18276 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:33.296005 18318 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.311043 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:33.311962 15512 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.317356 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.318372 15509 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:33.319518 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:33.320540 15513 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:33.310813 18363 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.166s	user 0.001s	sys 0.001s
W20260709 13:05:33.338438 15555 leader_election.cc:336] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.706s (SENT)
I20260709 13:05:33.339331 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:33.339881 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.298233 18346 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:05:33.343907 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.297240 18062 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:33.351372 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 295941us
I20260709 13:05:33.301699 18257 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:33.355145 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.356590 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:33.359627 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:33.360281 15441 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.341558 18000 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.364022 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:33.340579 18165 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:33.365214 15434 raft_consensus.cc:606] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.341991 18267 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.365641 15434 raft_consensus.cc:614] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:33.358671 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.366308 15406 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:33.366703 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.368969 15443 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:33.370604 15512 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:33.371121 15435 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:33.343930 18360 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:33.372288 18000 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:33.379823 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.355378 18374 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:33.365074 18230 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:33.382121 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 43752.1us
I20260709 13:05:33.384891 15513 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:33.383080 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1990) took 1197 ms. Trace:
I20260709 13:05:33.366278 18191 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:33.387832 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 461438us
W20260709 13:05:33.395730 15555 leader_election.cc:336] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.726s (SENT)
I20260709 13:05:33.396381 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.387725 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:33.368670 17900 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:05:33.403195 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:33.405637 15441 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:33.406951 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:33.387151 18230 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:33.386066 15516 rpcz_store.cc:276] 0709 13:05:32.185508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.185644 (+   136us) service_pool.cc:224] Handling call
0709 13:05:32.199454 (+ 13810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:32.208834 (+  9380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.208868 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:32.209430 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:05:32.406491 (+197061us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:32.406559 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.406680 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:33.382819 (+976139us) raft_consensus.cc:1685] finished
0709 13:05:33.382844 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.382998 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6669,"raft.queue_time_us":9515,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":5730,"spinlock_wait_cycles":8192,"thread_start_us":169426,"threads_started":1,"wal-append.queue_time_us":889030}
I20260709 13:05:33.376433 18267 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.410683 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:33.400257 18318 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:33.414736 18377 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:33.420260 18377 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:33.413269 15338 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.420660 18377 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.408391 16174 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
W20260709 13:05:33.421866 16174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52918 (request call id 319) took 1944 ms (client timeout 1652 ms). Trace:
W20260709 13:05:33.422312 16174 rpcz_store.cc:269] 0709 13:05:31.477653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.482745 (+  5092us) service_pool.cc:224] Handling call
0709 13:05:32.385729 (+902984us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b5800004598. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:05:33.421739 (+1036010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7595264}
I20260709 13:05:33.381016 18360 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.424476 18062 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:33.425567 18360 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.383841 18339 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:05:33.401906 18191 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.412976 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:33.410286 18276 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:33.429246 15585 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:33.406869 18374 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:33.430025 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44122.1us
I20260709 13:05:33.430435 15591 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:33.427470 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.417178 18000 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:33.417870 18364 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.294s	user 0.001s	sys 0.002s
I20260709 13:05:33.442835 18360 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:33.442914 15555 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.728s (SENT)
I20260709 13:05:33.443894 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.414822 18230 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.449553 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.450260 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 1994) took 1211 ms. Trace:
I20260709 13:05:33.439945 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.426935 18378 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.443672 18360 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.451829 18378 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.453612 18360 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.454406 18378 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.439780 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.419083 18318 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:33.443110 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.442823 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.428691 18247 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.426854 17900 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:33.449734 18239 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:33.451212 15587 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:33.444340 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.450665 15511 rpcz_store.cc:276] 0709 13:05:32.239032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.239189 (+   157us) service_pool.cc:224] Handling call
0709 13:05:32.242163 (+  2974us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:32.242663 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.242701 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:32.243289 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:05:32.437184 (+193895us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:32.437251 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.437368 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:33.365919 (+928551us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:33.446891 (+ 80972us) raft_consensus.cc:1685] finished
0709 13:05:33.446909 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.450178 (+  3269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1525,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":19038592,"thread_start_us":193289,"threads_started":1,"wal-append.queue_time_us":835671}
I20260709 13:05:33.468266 15583 raft_consensus.cc:2368] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:33.468453 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.442091 15590 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:05:33.468950 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.469278 15585 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:33.469753 15588 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
W20260709 13:05:33.470678 15482 connection.cc:256] RPC call timeout handler was delayed by -2.4021415769999521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 13:05:33.471203 15482 connection.cc:256] RPC call timeout handler was delayed by -2.3337415769999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:05:33.471588 15482 connection.cc:256] RPC call timeout handler was delayed by -2.2500415769999336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 13:05:33.472644 18276 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.473294 18276 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.473762 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:33.427150 18366 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.320s	user 0.004s	sys 0.000s
I20260709 13:05:33.455389 18318 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:33.476608 18381 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:33.457013 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:33.478559 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:33.479759 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:33.479915 17875 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:33.480540 18239 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:33.481256 18255 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:33.457209 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.463438 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.468115 18247 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:33.455336 15586 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:33.480618 17875 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:33.426110 18257 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:33.461333 15338 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.483937 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:33.467193 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:33.485126 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 132733us
I20260709 13:05:33.498847 18309 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:33.500639 18393 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:33.501928 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 59086.2us
I20260709 13:05:33.507098 15338 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.510035 15338 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:05:33.511094 15555 leader_election.cc:336] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.849s (SENT)
I20260709 13:05:33.514154 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.521549 15589 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:33.464263 17900 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:05:33.531940 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 48091us
I20260709 13:05:33.531909 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:33.533479 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:33.463531 18267 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:33.535732 18336 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:33.536554 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:33.537426 18000 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:05:33.539424 18361 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.540694 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:33.542186 18361 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.535653 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:33.545433 16176 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:05:33.552114 15555 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.855s (SENT)
I20260709 13:05:33.552795 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.553583 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:33.526325 18374 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:33.554739 18374 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:33.555065 15516 raft_consensus.cc:2410] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:33.556121 18361 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:33.555985 18374 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.556846 18361 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.525717 18393 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:33.558669 18393 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:33.560025 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.561260 15516 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:33.564113 18276 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.488744 17875 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.568285 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.575142 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:33.568164 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 87405us
I20260709 13:05:33.464522 18062 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:05:33.576395 15512 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:33.578909 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.589684 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.529206 18255 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:33.592896 15509 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:33.591501 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 234950us
I20260709 13:05:33.593827 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:33.592110 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 234024us
I20260709 13:05:33.530470 18360 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:33.596549 15511 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:33.599005 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:33.579103 18239 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:33.613626 15338 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 5, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 5 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:33.634987 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.604003 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.638208 18379 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.638844 18379 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:33.640353 18389 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 13:05:33.641361 18379 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.641675 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.642738 15584 raft_consensus.cc:2410] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:33.644217 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:33.636379 15338 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.647786 18346 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:33.649168 15587 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:33.651605 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.651898 18230 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.652487 15516 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:33.653710 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.654692 18230 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:33.606676 15514 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:33.656219 15517 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:33.657383 17875 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.658103 18360 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:33.607120 18267 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:33.559428 18361 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.605443 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.674342 15518 raft_consensus.cc:2410] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:33.674559 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:33.608186 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.676837 15512 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.526501 18247 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:33.683900 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 197565us
I20260709 13:05:33.633697 15589 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:33.595060 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:33.649027 18318 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.648519 15338 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 5 to 6, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.600930 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.660143 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.689035 15510 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:33.663334 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:33.669132 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.679283 17815 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.680197 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.680971 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.658680 18360 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.710283 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.708060 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.711033 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:33.708066 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 207) took 7952 ms. Trace:
W20260709 13:05:33.712179 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 117225us
I20260709 13:05:33.712688 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.706053 15442 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:33.603099 16176 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:05:33.690589 15482 leader_election.cc:400] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:33.681365 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.698415 15516 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:33.698290 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.699059 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:33.717691 15517 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:33.702426 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.703289 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.704272 17815 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.704434 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.704490 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.719383 15583 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:33.719936 15510 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:33.720357 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.721872 15589 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:33.705291 17875 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.705335 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.699245 18267 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:33.706133 18377 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.727891 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:33.728664 15585 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:33.728905 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 176853us
I20260709 13:05:33.728991 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.708000 18255 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.709087 15441 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:33.729683 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.870s (SENT)
I20260709 13:05:33.709630 18247 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.714246 15587 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:33.669241 16174 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:33.716274 15482 leader_election.cc:403] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:33.697937 15434 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
W20260709 13:05:33.735011 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44577.9us
I20260709 13:05:33.719231 15592 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:33.722529 15590 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:33.710592 18361 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:33.736912 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.737233 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.738011 15518 raft_consensus.cc:2410] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:33.730808 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.733132 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.722841 15556 leader_election.cc:400] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:33.703392 15512 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:33.724802 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:33.739202 15556 leader_election.cc:403] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:33.738075 15515 raft_consensus.cc:2410] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:33.736444 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:33.739961 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.724901 18230 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:33.744345 15516 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:33.722494 18297 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:33.744141 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.742666 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:33.711756 15337 rpcz_store.cc:276] 0709 13:05:25.755273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.755703 (+   430us) service_pool.cc:224] Handling call
0709 13:05:33.707967 (+7952264us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:30.462183 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:30.463196 (+  1013us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:30.463270 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:05:30.463301 (+    31us) tablet.cc:662] Decoding operations
0709 13:05:30.554802 (+ 91501us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:30.554930 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:30.554974 (+    44us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:05:30.556994 (+  2020us) tablet.cc:701] Row locks acquired
0709 13:05:30.557070 (+    76us) write_op.cc:260] PREPARE: finished
0709 13:05:30.557333 (+   263us) write_op.cc:270] Start()
0709 13:05:30.557560 (+   227us) write_op.cc:276] Timestamp: P: 1783602330557239 usec, L: 0
0709 13:05:30.557592 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:05:30.558752 (+  1160us) log.cc:844] Serialized 6357 byte log entry
0709 13:05:30.914256 (+355504us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf78c4d0ac 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b
0709 13:05:31.570383 (+656127us) op_driver.cc:464] REPLICATION: finished
0709 13:05:31.640936 (+ 70553us) write_op.cc:301] APPLY: starting
0709 13:05:31.641052 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:31.641399 (+   347us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:31.641438 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:31.652902 (+ 11464us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:31.687312 (+ 34410us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:05:31.687403 (+    91us) write_op.cc:312] APPLY: finished
0709 13:05:31.763023 (+ 75620us) log.cc:844] Serialized 113 byte log entry
0709 13:05:31.776908 (+ 13885us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:31.784856 (+  7948us) write_op.cc:454] Released schema lock
0709 13:05:31.804978 (+ 20122us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:31.805574 (+   596us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:31.805615 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8017,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":69388,"apply.run_cpu_time_us":6041,"apply.run_wall_time_us":164576,"num_ops":16,"prepare.queue_time_us":246029,"prepare.run_cpu_time_us":36780,"prepare.run_wall_time_us":588142,"raft.queue_time_us":214494,"raft.run_cpu_time_us":11855,"raft.run_wall_time_us":74928,"replication_time_us":1012595,"spinlock_wait_cycles":4022016,"thread_start_us":808623,"threads_started":4,"wal-append.queue_time_us":557307,"wal-append.run_cpu_time_us":66524,"wal-append.run_wall_time_us":1673789}]]}
I20260709 13:05:33.752866 15585 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:33.753278 15516 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:05:33.753731 15516 pending_rounds.cc:85] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:33.753573 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.754048 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:33.754781 15515 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:33.755103 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:33.754097 15516 pending_rounds.cc:107] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:05:33.756122 15516 raft_consensus.cc:2889] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:33.756098 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.875s (SENT)
I20260709 13:05:33.756364 15512 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:33.757175 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:33.760664 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:33.732246 18372 tablet_copy_client.cc:323] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:05:33.737004 18361 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:33.741129 18247 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:33.747687 18297 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.747464 17875 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:33.774305 15512 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:33.771893 15515 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:33.767930 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 54570.5us
I20260709 13:05:33.729959 17912 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:05:33.777920 18360 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.773483 18361 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.749994 18276 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:33.747221 18339 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:33.747797 18336 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:33.748018 18000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47410 (request call id 8) took 4437 ms. Trace:
I20260709 13:05:33.795038 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.817065 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.818284 15441 raft_consensus.cc:2368] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:33.774797 18392 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:05:33.779670 18297 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.830886 17815 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:33.744809 18239 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.826589 18336 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:33.826891 15556 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:33.723990 17900 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:33.838531 15556 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.68:33529 timed out after 1.575s (SENT) [suppressed 10 similar messages]
I20260709 13:05:33.772305 18230 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:33.771901 18365 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:33.833739 18374 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:33.861073 18390 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:05:33.774442 18396 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.792778 18393 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:33.763887 18165 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:05:33.867776 18377 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.869567 18318 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:33.869720 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:33.782845 17875 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.871608 17875 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:33.871917 18230 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.854166 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:33.878054 18318 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.878959 18318 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:33.837971 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.767913 18375 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:33.844476 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.759286 18381 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:05:33.817816 18276 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.894680 18276 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.896021 18191 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:33.854074 18386 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:33.788245 18267 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:33.855724 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:33.835664 18346 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:05:33.833825 18336 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.903475 15509 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:33.889315 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.891338 15434 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:33.910605 16178 raft_consensus.cc:2376] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7. Re-sending same reply.
I20260709 13:05:33.972432 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.974084 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.976725 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.899118 18386 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:33.978350 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:33.977542 15440 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:34.023414 15434 raft_consensus.cc:2410] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:05:34.025420 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.036968 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:34.034379 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:34.036355 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.042662 15589 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
W20260709 13:05:34.064999 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.976620 18365 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:34.077544 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.078826 15586 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:34.019042 18255 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:34.025609 18377 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:34.098518 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 365077us
I20260709 13:05:34.138597 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:34.087095 18367 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:34.050297 18297 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:33.957907 18375 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:05:34.087510 18377 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.049750 18165 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:05:34.161402 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.166163 15435 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:34.083532 18365 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:34.140174 18409 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:34.136382 18255 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:34.164546 18377 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:34.259028 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.260180 15435 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:34.233978 18346 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:05:34.175774 18386 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:34.411875 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 328680us
I20260709 13:05:34.472664 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:34.515281 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 759135us
I20260709 13:05:34.456259 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.516067 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.519984 15441 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:34.495018 15438 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:34.516809 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:34.499922 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:33.828847 18000 rpcz_store.cc:276] 0709 13:05:29.305340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.305703 (+   363us) service_pool.cc:224] Handling call
0709 13:05:29.328162 (+ 22459us) log.cc:844] Serialized 506 byte log entry
0709 13:05:30.073029 (+744867us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b54004e0d20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd0142 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354 000000000038f199 00007fcf78c6a475
0709 13:05:33.737473 (+3664444us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33970,"raft.queue_time_us":95119,"raft.run_cpu_time_us":21327,"raft.run_wall_time_us":635358,"spinlock_wait_cycles":21972864,"thread_start_us":480037,"threads_started":2,"wal-append.queue_time_us":481363,"wal-append.run_cpu_time_us":3037,"wal-append.run_wall_time_us":1097909}
I20260709 13:05:34.356807 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:34.554934 15435 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:05:34.559499 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 202835us
I20260709 13:05:34.561110 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:34.559580 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.565899 15440 raft_consensus.cc:2410] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:05:34.567634 15517 consensus_meta.cc:287] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.009s
I20260709 13:05:34.568105 15517 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:34.570849 15585 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:34.572072 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.572913 15443 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:34.574075 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.574258 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.555830 18062 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:05:34.501930 17875 consensus_meta.cc:287] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.004s
I20260709 13:05:34.576241 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.576555 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:34.575440 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:34.462160 18398 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.628s	user 0.004s	sys 0.009s
I20260709 13:05:34.592595 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:34.594337 15442 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:34.558358 18381 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.595345 18318 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:34.595582 18381 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:34.597977 18381 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:34.587903 18336 consensus_meta.cc:287] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.000s
I20260709 13:05:34.604486 18336 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:34.609068 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:34.610162 18318 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.611846 18318 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:34.612529 18318 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.613581 18318 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:34.615453 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:34.617020 18337 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:34.617616 18337 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:34.618613 15452 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 1915fdd81d344a749443e48f07a1fef8 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:05:34.617063 15443 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:34.619328 15452 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 1915fdd81d344a749443e48f07a1fef8 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-1915fdd81d344a749443e48f07a1fef8
I20260709 13:05:34.615967 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:34.620566 15441 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:34.622645 18418 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:34.623251 18418 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:34.624147 18339 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:34.624544 18339 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:34.625779 18339 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:34.626415 18418 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:34.209924 18409 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.277123 18297 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:34.589862 18062 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:34.613049 18247 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:34.628433 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.627934 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:34.630599 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.616344 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.634553 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:34.627789 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:34.657671 15584 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:34.628825 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:34.658867 15589 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:34.650648 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.659435 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.660285 15585 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:34.660501 15440 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:34.661684 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:34.656070 15583 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:34.651674 15556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.025s	sys 0.039s
I20260709 13:05:34.652016 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:34.663607 15556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.026s	sys 0.039s
W20260709 13:05:34.665745 16148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.003s	sys 0.014s
W20260709 13:05:34.666210 16148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.003s	sys 0.014s
I20260709 13:05:34.668322 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:34.566403 18375 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:34.664072 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 596515us
I20260709 13:05:34.681228 15436 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:34.659830 15587 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:34.697253 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:34.698495 15440 raft_consensus.cc:2410] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:34.690912 15441 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:05:34.698854 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:34.627331 18339 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:34.706379 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:34.616200 18336 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:05:34.711248 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:34.665856 18276 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.006s
I20260709 13:05:34.648453 18255 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:34.618618 18337 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:34.738023 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:34.745059 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.733646 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:34.753000 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:34.753432 15583 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:34.738803 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:34.657914 18247 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:34.750106 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.737229 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:34.760949 15585 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:34.603650 18380 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:05:34.716235 15441 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:34.765900 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:34.761765 16181 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:34.737010 18147 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:34.772420 15442 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:34.764333 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:34.646358 17875 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:34.648721 18409 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:34.762773 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:34.769487 18257 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:34.769687 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:34.709698 18346 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:34.739362 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:34.768510 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:34.770316 15512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.020s
I20260709 13:05:34.706069 18191 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:34.759950 18382 raft_consensus.cc:993] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:34.734845 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:34.704816 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:34.735468 18361 consensus_meta.cc:287] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.955s	user 0.004s	sys 0.008s
I20260709 13:05:34.764091 18247 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:34.769974 18395 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:34.776611 18147 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.777180 18257 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.710433 18230 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:05:34.696151 18375 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:34.779780 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.765723 18276 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:34.786211 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1641) took 1187 ms. Trace:
I20260709 13:05:34.988168 15583 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
W20260709 13:05:34.987059 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 124203us
I20260709 13:05:34.819569 15437 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:34.808549 15439 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:34.815793 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:34.852795 18147 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:34.991897 18276 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:34.842046 16176 raft_consensus.cc:2410] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:05:34.990955 15583 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:05:34.809453 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:34.779165 15443 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
W20260709 13:05:35.008100 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 198740us
W20260709 13:05:35.008347 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 244178us
W20260709 13:05:35.008967 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 447919us
I20260709 13:05:35.009724 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:35.016028 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:35.016466 15516 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:35.016834 15509 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.017661 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:35.019399 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:35.024242 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 335587us
W20260709 13:05:34.852269 18374 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.994s	user 0.014s	sys 0.000s
W20260709 13:05:34.782223 15512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.011s	sys 0.020s
W20260709 13:05:34.984365 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 464828us
I20260709 13:05:34.894956 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:34.780088 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:35.059976 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:34.988478 15511 rpcz_store.cc:276] 0709 13:05:33.599260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.599408 (+   148us) service_pool.cc:224] Handling call
0709 13:05:33.599878 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.678410 (+ 78532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.678474 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.679222 (+   748us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.181460 (+502238us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:34.222945 (+ 41485us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.785751 (+562806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.785842 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.785898 (+    56us) raft_consensus.cc:1685] finished
0709 13:05:34.785914 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.786097 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41692,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":10639,"raft.queue_time_us":376147,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":14346,"spinlock_wait_cycles":114958976,"thread_start_us":649971,"threads_started":2,"wal-append.queue_time_us":893580}
I20260709 13:05:34.852563 15452 tablet_copy_source_session.cc:215] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:34.779965 18407 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:35.058686 15509 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
W20260709 13:05:35.053359 15513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.009s	sys 0.030s
I20260709 13:05:35.061311 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2026) took 1302 ms. Trace:
I20260709 13:05:35.022028 18360 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.064802 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:34.784408 18413 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.083746 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.071889 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62256us
W20260709 13:05:35.060285 15555 leader_election.cc:336] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.937s (SENT)
I20260709 13:05:34.852919 18421 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:34.785368 18336 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.862828 18257 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.071302 15589 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:34.796099 18241 raft_consensus.cc:1081] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:35.062090 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:34.810669 18255 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.388s
I20260709 13:05:34.810366 18361 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:34.812350 18191 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:35.005710 18410 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.204s
I20260709 13:05:35.025390 18297 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.242s
I20260709 13:05:34.842109 18000 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.433s
I20260709 13:05:34.862453 18062 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:35.436198 15513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.022s	sys 0.045s
I20260709 13:05:35.436800 15591 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:35.437399 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1642) took 1837 ms. Trace:
I20260709 13:05:35.438397 15513 rpcz_store.cc:276] 0709 13:05:33.599602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.676002 (+ 76400us) service_pool.cc:224] Handling call
0709 13:05:33.697543 (+ 21541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.714848 (+ 17305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.714883 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.728004 (+ 13121us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.989679 (+261675us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:34.521873 (+532194us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.436930 (+915057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.437043 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.437115 (+    72us) raft_consensus.cc:1685] finished
0709 13:05:35.437134 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.437315 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61895,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":105282,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":4851,"thread_start_us":1626389,"threads_started":3,"wal-append.queue_time_us":417852}
I20260709 13:05:35.027231 18346 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:35.441442 18346 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:35.206460 15435 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:35.444203 15510 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:34.842439 18365 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:35.446075 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:35.456218 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:35.258872 18403 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.395s	user 0.004s	sys 0.004s
W20260709 13:05:35.266086 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 276982us
W20260709 13:05:35.457224 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 392532us
W20260709 13:05:35.323419 16147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.002s	sys 0.030s
I20260709 13:05:35.456226 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:35.459067 15512 rpcz_store.cc:276] 0709 13:05:33.758938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.902665 (+143727us) service_pool.cc:224] Handling call
0709 13:05:34.034499 (+131834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.034759 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:34.064130 (+ 29371us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.060780 (+996650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.060843 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:35.060897 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.060966 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.061241 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15572,"prepare.queue_time_us":17142,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":398340,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":100,"thread_start_us":1009411,"threads_started":3,"wal-append.queue_time_us":542161}
I20260709 13:05:35.469202 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:35.295022 15518 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:05:35.307039 18197 tablet_copy_client.cc:538] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.484004 15515 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:35.479125 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:35.425623 18396 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.561s	user 0.011s	sys 0.006s
I20260709 13:05:35.205756 18276 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:35.470041 16147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.005s	sys 0.042s
I20260709 13:05:35.205897 18267 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.482941 18385 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.291728 18428 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.437608 18407 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:34.945914 18318 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:35.525440 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.533259 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.538214 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 55085.1us
I20260709 13:05:35.539100 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:35.530596 15584 consensus_meta.cc:287] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.826s	user 0.008s	sys 0.004s
I20260709 13:05:35.470114 18309 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:35.540416 15584 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:35.550537 15443 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:35.550802 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 490523us
I20260709 13:05:35.550952 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:35.551882 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:35.552234 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:35.553259 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:35.554512 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:35.537568 18105 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:05:35.458330 18336 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:35.493530 18276 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:35.513229 18374 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:35.504397 18396 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:35.532357 18420 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:35.512528 17875 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:35.467811 18413 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:35.506321 18432 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:35.456892 18421 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:35.563866 15555 leader_election.cc:336] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.000s (SENT)
I20260709 13:05:35.538677 18407 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:35.542852 18380 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:05:35.581825 15435 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:35.540959 18267 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:35.195221 18375 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:35.540382 18365 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:35.584021 18255 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:35.471848 18360 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:35.566349 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:35.664835 15584 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:35.588737 18276 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:35.621280 18425 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
W20260709 13:05:35.622166 18434 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:05:35.624910 18336 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:35.628353 18437 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:05:35.629787 18446 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:05:35.684670 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:35.685452 15584 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:35.637045 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1670) took 1139 ms. Trace:
I20260709 13:05:35.686652 15437 rpcz_store.cc:276] 0709 13:05:34.497760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.499475 (+  1715us) service_pool.cc:224] Handling call
0709 13:05:35.636612 (+1137137us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54002251d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:35.636901 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646908288}
I20260709 13:05:35.569808 18411 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:35.660691 18436 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:35.618515 18377 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.361s	user 0.021s	sys 0.000s
I20260709 13:05:35.663232 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:35.602676 18432 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:35.532819 18346 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:35.677539 15583 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.007s
I20260709 13:05:35.663959 18420 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:35.538137 18428 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:35.680271 15435 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:05:35.690955 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134359us
W20260709 13:05:35.715387 15555 leader_election.cc:336] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.100s (SENT)
I20260709 13:05:35.716176 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:35.719910 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:35.722258 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:35.726547 16145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.039s	sys 0.019s
I20260709 13:05:35.666826 18365 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:35.693094 18255 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:35.738147 18255 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:35.741573 18380 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:35.742154 18380 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.742547 18380 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.720008 18452 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:35.744288 18452 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:35.745307 18452 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:35.746843 18452 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:35.718291 18420 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:35.676782 18386 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:05:35.730055 15407 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:35.732307 15513 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:05:35.729259 16145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.039s	sys 0.019s
I20260709 13:05:35.764041 15584 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:35.692389 18337 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:35.699949 18432 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:35.772159 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:35.799980 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:35.800781 15586 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:35.801892 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86553.9us
I20260709 13:05:35.751323 18396 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:35.711911 18377 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:35.851368 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:35.872853 15584 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.766698 18361 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:35.703763 18436 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:35.866374 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1697) took 1817 ms. Trace:
W20260709 13:05:35.803370 15555 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.167s (SENT)
I20260709 13:05:35.886567 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1985) took 1187 ms. Trace:
I20260709 13:05:35.849177 18444 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:35.883404 15590 rpcz_store.cc:276] 0709 13:05:34.038216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.038343 (+   127us) service_pool.cc:224] Handling call
0709 13:05:34.076681 (+ 38338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.199739 (+123058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.199784 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.584320 (+384536us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.968685 (+384365us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:34.968745 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.968857 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.855292 (+886435us) raft_consensus.cc:1685] finished
0709 13:05:35.855321 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.855482 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":195813,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"thread_start_us":468844,"threads_started":2,"wal-append.queue_time_us":730978}
I20260709 13:05:35.865998 17875 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:35.796847 18337 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:35.873932 18420 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:35.873788 18433 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:35.933632 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:35.883581 18392 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:35.903077 18318 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:35.906946 15584 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:35.925711 18442 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.320s	user 0.001s	sys 0.001s
W20260709 13:05:35.938136 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 273258us
I20260709 13:05:35.909688 17875 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.940093 17900 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:35.941727 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 169789us
I20260709 13:05:35.945214 15584 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:35.946615 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:35.942950 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 139604us
W20260709 13:05:35.954883 15555 leader_election.cc:336] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.246s (SENT)
I20260709 13:05:35.954668 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1997) took 1166 ms. Trace:
I20260709 13:05:35.954491 15586 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:35.956241 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:35.957741 15584 rpcz_store.cc:276] 0709 13:05:34.788430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.944370 (+1155940us) service_pool.cc:224] Handling call
0709 13:05:35.944796 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.954352 (+  9556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.954603 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:35.954043 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:35.951278 17875 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.944754 18360 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:35.961210 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:35.962165 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:35.965263 15584 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:05:35.953497 18468 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:35.975008 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2018) took 2252 ms. Trace:
I20260709 13:05:35.975381 18413 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:35.966125 18421 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:35.975515 15515 rpcz_store.cc:276] 0709 13:05:33.722297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.775785 (+ 53488us) service_pool.cc:224] Handling call
0709 13:05:33.776135 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.489556 (+1713421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.974763 (+485207us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54002a1a54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:35.974941 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3927256320}
I20260709 13:05:35.965559 18454 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:35.938686 18433 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:35.980293 18395 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:35.981592 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1915fdd81d344a749443e48f07a1fef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.981716 18433 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:35.965400 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1998) took 1141 ms. Trace:
I20260709 13:05:35.983822 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:35.985854 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:35.959033 18165 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:35.953591 18267 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:35.962412 18458 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:05:35.964190 18318 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:35.991958 15588 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:35.984318 15586 rpcz_store.cc:276] 0709 13:05:34.823951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.958950 (+1134999us) service_pool.cc:224] Handling call
0709 13:05:35.959466 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.965017 (+  5551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.965043 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.965088 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:35.965117 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.965174 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.965336 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:36.008713 15407 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:36.010484 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.002352 18191 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:36.005820 18447 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:05:36.024307 18473 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.064064 18473 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.066812 18473 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:36.033818 18247 consensus_meta.cc:287] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.181s	user 0.014s	sys 0.000s
I20260709 13:05:36.076521 18247 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.028318 18337 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:36.077294 15517 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:36.033829 18377 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.078819 18247 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.003654 18446 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.079814 15518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:34302
I20260709 13:05:36.080120 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:36.080446 15518 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:36.080863 15518 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.081935 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1778) took 1373 ms. Trace:
I20260709 13:05:36.082660 15585 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:36.082329 15440 rpcz_store.cc:276] 0709 13:05:34.708266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.712496 (+  4230us) service_pool.cc:224] Handling call
0709 13:05:34.712962 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.440107 (+727145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.440158 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.440217 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:35.440288 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.081708 (+641420us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54002d1754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:36.081753 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.081874 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671560448}
I20260709 13:05:36.036998 18365 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.039378 18428 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.041349 18444 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:36.094116 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:36.046110 18297 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:36.094866 15515 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:36.094901 18297 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:36.096140 18297 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.046985 18374 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:36.096875 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:36.097316 18374 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:36.097568 15514 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:36.098237 18374 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.100461 15590 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:36.100979 15509 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:35.887331 15583 rpcz_store.cc:276] 0709 13:05:34.699049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.990216 (+291167us) service_pool.cc:224] Handling call
0709 13:05:34.990591 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.990835 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:35.700749 (+709914us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.885843 (+185094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.886112 (+   269us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:35.886197 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.886306 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.886477 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7472,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":177039,"threads_started":1}
I20260709 13:05:36.102303 15509 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:36.050016 18448 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:05:36.051024 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2037) took 1033 ms. Trace:
I20260709 13:05:36.105937 15513 rpcz_store.cc:276] 0709 13:05:35.017390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.440235 (+422845us) service_pool.cc:224] Handling call
0709 13:05:35.440604 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.761687 (+321083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.050709 (+289022us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400296654. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:36.050950 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669613440}
W20260709 13:05:36.052481 18451 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:05:36.052558 18436 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:36.054158 18464 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:36.056046 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2032) took 1040 ms. Trace:
I20260709 13:05:35.993296 18395 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:36.035465 18339 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.279s	user 0.012s	sys 0.002s
I20260709 13:05:36.064493 18165 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:36.007887 18318 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:36.007529 18257 consensus_meta.cc:287] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.002s
I20260709 13:05:36.068262 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 282) took 1452 ms. Trace:
I20260709 13:05:36.025723 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.069504 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:36.032958 18147 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.042s	user 0.012s	sys 0.005s
I20260709 13:05:36.071044 15592 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:36.071048 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:36.074584 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:36.068569 15586 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:36.135798 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:36.087983 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:36.136597 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:36.136722 15512 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:36.137367 15586 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:36.092319 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:35.993445 18413 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:05:36.116855 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 08f534c2cc884d65b268a74636da80eb: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:36.116598 15516 rpcz_store.cc:276] 0709 13:05:35.016103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.020814 (+  4711us) service_pool.cc:224] Handling call
0709 13:05:35.021173 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.072138 (+ 50965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.072191 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:35.072952 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 13:05:35.489755 (+416803us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:35.489834 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.489951 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.055791 (+565840us) raft_consensus.cc:1685] finished
0709 13:05:36.055824 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.055976 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67757,"raft.queue_time_us":73438,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":73678,"thread_start_us":199786,"threads_started":1,"wal-append.queue_time_us":836075}
I20260709 13:05:36.111039 18365 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:36.122936 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.089030 18385 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.557s	user 0.013s	sys 0.000s
I20260709 13:05:36.084127 18191 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.083230 18433 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:36.099479 18374 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.150197 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:36.118316 15518 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:36.109457 18393 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.057560 18380 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:36.118896 18460 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:36.159451 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 133673us
I20260709 13:05:36.185803 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:36.167287 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:36.129673 15436 rpcz_store.cc:276] 0709 13:05:34.615527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.696863 (+ 81336us) service_pool.cc:224] Handling call
0709 13:05:34.715211 (+ 18348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:34.749286 (+ 34075us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:35.011648 (+262362us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.471595 (+459947us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:35.535076 (+ 63481us) log.cc:844] Serialized 52 byte log entry
0709 13:05:35.535340 (+   264us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:35.535699 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.569187 (+ 33488us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.569480 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.569610 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.068035 (+498425us) raft_consensus.cc:1685] finished
0709 13:05:36.068057 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.068201 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18342,"prepare.queue_time_us":1025454,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":105339,"raft.run_cpu_time_us":624,"raft.run_wall_time_us":18155,"spinlock_wait_cycles":33664,"thread_start_us":511529,"threads_started":2,"wal-append.queue_time_us":809965}
I20260709 13:05:36.178961 15586 raft_consensus.cc:2410] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:36.124351 18444 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:36.128901 18318 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:36.127446 18381 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:36.186976 15482 leader_election.cc:400] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:36.209214 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.193048 15518 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:36.213505 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.216251 18475 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:36.166188 18385 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:36.166424 18428 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:36.215616 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.140223 18382 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:05:36.224366 15555 connection.cc:256] RPC call timeout handler was delayed by -3.4284903179999446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:05:36.127061 18407 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.141553 18257 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.157657 18241 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:05:36.229434 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:36.233942 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:36.211040 18452 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:36.150863 18147 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.192655 18255 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:36.225137 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 118153us
I20260709 13:05:36.217221 18436 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:36.216742 18361 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:36.229238 15555 connection.cc:256] RPC call timeout handler was delayed by -3.3825903179999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 13:05:36.167198 18365 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:36.256031 15555 connection.cc:256] RPC call timeout handler was delayed by -3.3627903179999521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:05:36.263103 15555 connection.cc:256] RPC call timeout handler was delayed by -3.2520903180000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:05:36.263667 15555 connection.cc:256] RPC call timeout handler was delayed by -3.1215903180000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
I20260709 13:05:36.257290 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:36.181325 18433 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:36.264356 15555 connection.cc:256] RPC call timeout handler was delayed by -2.9604903179999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 13:05:36.264714 15555 connection.cc:256] RPC call timeout handler was delayed by -2.7026325919999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 13:05:36.265012 15555 connection.cc:256] RPC call timeout handler was delayed by -2.4992325919999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 13:05:36.265286 15555 connection.cc:256] RPC call timeout handler was delayed by -2.4573903179999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2597s for a response
W20260709 13:05:36.265550 15555 connection.cc:256] RPC call timeout handler was delayed by -2.355232591999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:05:36.265825 15555 connection.cc:256] RPC call timeout handler was delayed by -2.2031325919999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 13:05:36.266089 15555 connection.cc:256] RPC call timeout handler was delayed by -2.1495903180000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2939s for a response
W20260709 13:05:36.266350 15555 connection.cc:256] RPC call timeout handler was delayed by -2.1383325919999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:05:36.266870 15555 connection.cc:256] RPC call timeout handler was delayed by -1.8525903180000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3269s for a response
I20260709 13:05:36.267163 18433 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.182356 18191 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:36.227960 18360 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:36.272009 18444 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.248068 18247 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:36.192673 18393 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.277426 18407 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:36.278159 15441 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:36.226212 18446 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:05:36.320137 18393 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:36.279572 18365 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:36.263863 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 194487us
I20260709 13:05:36.217509 18381 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:36.207033 18460 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:36.267174 15555 connection.cc:256] RPC call timeout handler was delayed by -1.2797325919999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31560000000000005s for a response
W20260709 13:05:36.269765 18276 consensus_meta.cc:287] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.003s
I20260709 13:05:36.231323 18475 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:36.362085 18247 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:36.281092 18428 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:36.287595 18339 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:36.434031 15588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1974) took 1808 ms (client timeout 1823 ms). Trace:
W20260709 13:05:36.465247 15591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 1999) took 1585 ms (client timeout 1776 ms). Trace:
I20260709 13:05:36.462729 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 276) took 1851 ms. Trace:
I20260709 13:05:36.452105 18147 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.438210 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1989) took 1726 ms. Trace:
W20260709 13:05:36.565752 15591 rpcz_store.cc:269] 0709 13:05:34.880244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.894495 (+ 14251us) service_pool.cc:224] Handling call
0709 13:05:36.465047 (+1570552us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400247cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:36.465178 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865564544}
W20260709 13:05:36.565702 15588 rpcz_store.cc:269] 0709 13:05:34.625332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.634218 (+  8886us) service_pool.cc:224] Handling call
0709 13:05:36.433639 (+1799421us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003da754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:36.433871 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176150912}
W20260709 13:05:36.420743 18478 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:36.415990 18257 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.415827 18393 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.576719 15517 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:36.568903 15589 rpcz_store.cc:276] 0709 13:05:34.711490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.458038 (+746548us) service_pool.cc:224] Handling call
0709 13:05:35.458563 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.656111 (+197548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.656144 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:35.656704 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:05:35.875269 (+218565us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:35.903376 (+ 28107us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.903749 (+   373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.053500 (+149751us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18003c4ae0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:36.435357 (+381857us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540024ac54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:36.435447 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.435520 (+    73us) raft_consensus.cc:1685] finished
0709 13:05:36.437867 (+  2347us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.438120 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49217,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":1387,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":42260,"spinlock_wait_cycles":458420864,"thread_start_us":163479,"threads_started":1,"wal-append.queue_time_us":286591}
I20260709 13:05:36.363833 18436 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:05:36.436794 15583 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:36.416425 18386 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.425719 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:36.593138 15442 raft_consensus.cc:2376] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6. Re-sending same reply.
I20260709 13:05:36.460918 18381 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:36.415197 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:36.475996 18318 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.470371 18297 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:36.416376 17875 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.702575 18452 raft_consensus.cc:697] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:36.415829 18475 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:36.406903 18191 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:36.419262 18197 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:05:36.467141 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 1983) took 1813 ms. Trace:
I20260709 13:05:36.376420 18276 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.374954 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.711035 15585 rpcz_store.cc:276] 0709 13:05:34.654116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.789397 (+135281us) service_pool.cc:224] Handling call
0709 13:05:34.846698 (+ 57301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.083025 (+1236327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.466839 (+383814us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400114754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:36.467066 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2841600768}
I20260709 13:05:36.684260 18473 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.405730 18460 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.415019 18000 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:36.412833 18462 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.676s	user 0.004s	sys 0.000s
W20260709 13:05:36.399775 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.410291 18432 consensus_meta.cc:287] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.006s
I20260709 13:05:36.374060 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:36.721836 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 352732us
I20260709 13:05:36.722731 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.420903 18430 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:36.398664 18247 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:36.417026 18455 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:36.291361 18433 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:36.553544 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.281008 17900 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:36.759651 18165 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:36.769461 17900 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:36.566740 15439 rpcz_store.cc:276] 0709 13:05:34.613207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.653296 (+ 40089us) service_pool.cc:224] Handling call
0709 13:05:34.808263 (+154967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.990385 (+182122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.462408 (+1472023us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540026b950. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:36.462629 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355371776}
W20260709 13:05:36.572947 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 445084us
W20260709 13:05:36.556128 18409 consensus_meta.cc:287] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.765s	user 0.005s	sys 0.012s
I20260709 13:05:36.777266 18409 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.778465 18375 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.778867 18276 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.515992 18426 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.779910 18426 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.721019 18000 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:36.601861 18393 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:36.794536 18000 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.796228 18393 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:36.796360 18000 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:36.670449 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 429132us
W20260709 13:05:36.713511 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 338635us
I20260709 13:05:36.321647 18361 consensus_queue.cc:1059] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.140s
W20260709 13:05:36.717939 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 302855us
I20260709 13:05:36.760298 16176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 331) took 1214 ms. Trace:
I20260709 13:05:36.800328 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:36.800690 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.802047 18318 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.802439 18486 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:36.802855 18318 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:36.803269 18318 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:36.803705 18318 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:36.804685 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:36.754006 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.725816 18432 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.766232 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2001) took 1576 ms. Trace:
I20260709 13:05:36.716826 18191 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:36.725270 18430 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:36.775072 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:36.714947 17875 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.556313 18428 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:36.782682 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.832207 18413 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.575511 18339 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.799526 18460 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:05:36.836126 18276 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.805418 18498 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:36.806731 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.708911 18463 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.890759 15437 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:36.813239 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:36.815078 15510 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:36.811892 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:36.834450 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 80534us
I20260709 13:05:36.834591 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:36.742607 18380 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:36.755474 18381 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:36.805794 18361 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:36.766837 18433 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:36.869513 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 64907.5us
I20260709 13:05:36.832245 15584 rpcz_store.cc:276] 0709 13:05:35.189734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.973506 (+783772us) service_pool.cc:224] Handling call
0709 13:05:35.973936 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:36.153109 (+179173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.153144 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:36.185027 (+ 31883us) log.cc:844] Serialized 52 byte log entry
0709 13:05:36.704663 (+519636us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:36.721706 (+ 17043us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.722016 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.722101 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.765939 (+ 43838us) raft_consensus.cc:1685] finished
0709 13:05:36.765962 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.766160 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9356,"prepare.queue_time_us":16755,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":7826,"raft.queue_time_us":104832,"raft.run_cpu_time_us":9424,"raft.run_wall_time_us":42780,"spinlock_wait_cycles":1310080,"thread_start_us":656982,"threads_started":2,"wal-append.queue_time_us":546526}
I20260709 13:05:36.907600 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:36.792997 18426 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.837077 18393 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.910192 18433 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:36.800349 16176 rpcz_store.cc:276] 0709 13:05:35.538648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.557830 (+ 19182us) service_pool.cc:224] Handling call
0709 13:05:35.655318 (+ 97488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.692769 (+ 37451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.692822 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:35.766003 (+ 73181us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.183733 (+417730us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:36.191098 (+  7365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.408240 (+217142us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54005f0fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:36.408308 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.712343 (+304035us) raft_consensus.cc:1685] finished
0709 13:05:36.712916 (+   573us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.724931 (+ 12015us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":381,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":12282,"spinlock_wait_cycles":43069312,"thread_start_us":344345,"threads_started":1,"wal-append.queue_time_us":478760}
I20260709 13:05:36.838851 18409 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.877446 18191 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:36.882356 18387 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:36.882479 15434 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:36.884536 18339 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:36.864327 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:36.884747 18432 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:36.803731 18486 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:05:36.873167 18461 consensus_queue.cc:1059] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:05:36.864742 18452 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.871847 18165 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:36.893790 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 59295us
I20260709 13:05:36.933679 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:36.889124 18498 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:36.928378 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:36.937784 16181 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.893716 15443 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
W20260709 13:05:36.895818 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 89291us
I20260709 13:05:36.902380 18361 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:36.899031 18411 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:36.894830 18463 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.902983 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:36.908197 18473 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:36.900588 18381 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.903892 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:36.977854 15441 raft_consensus.cc:606] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:36.917511 15437 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
W20260709 13:05:36.876438 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 93824.3us
I20260709 13:05:36.926609 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:36.979147 15589 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:36.979614 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:36.980280 15591 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.898416 18386 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:36.927909 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:36.927932 15592 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:36.982875 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:36.926330 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:36.926923 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:36.894644 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:36.985735 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 91168.4us
I20260709 13:05:36.986523 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.987447 15587 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:36.986995 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:36.876986 18428 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.942716 18486 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:36.947723 15516 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:36.970757 18255 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:36.951442 18394 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:36.952085 15513 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:36.958042 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:36.933173 18365 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.960676 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2007) took 1225 ms. Trace:
I20260709 13:05:37.014778 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:37.014897 15590 rpcz_store.cc:276] 0709 13:05:35.735329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.102068 (+366739us) service_pool.cc:224] Handling call
0709 13:05:36.102409 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.367304 (+264895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.367348 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.394352 (+ 27004us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.700983 (+306631us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:36.701026 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.701101 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.960422 (+259321us) raft_consensus.cc:1685] finished
0709 13:05:36.960449 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.960598 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146127,"raft.queue_time_us":133049,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":12919,"spinlock_wait_cycles":21248,"thread_start_us":316864,"threads_started":2,"wal-append.queue_time_us":263822}
I20260709 13:05:36.918795 17900 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:36.930153 18062 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:05:36.964032 18455 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.964365 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:36.965595 18361 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.939287 18339 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:36.968528 15512 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:36.969063 18411 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:36.971083 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:36.972122 15585 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:36.970482 15440 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:36.974375 16181 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:37.035192 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:37.035874 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 71615.1us
I20260709 13:05:36.932435 18461 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:36.930532 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:36.918179 18430 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:36.889642 18413 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.932910 18165 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:36.997901 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:36.999358 18360 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.060029 15556 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:37.000322 18409 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:37.060565 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:37.002588 18375 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:37.005275 18318 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.007941 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:37.008373 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:36.982226 18410 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:36.952193 18372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52916 (request call id 429) took 4064 ms. Trace:
I20260709 13:05:36.983382 18381 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.924624 18497 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:05:37.026959 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:37.113791 15590 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:37.024714 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:37.037216 17900 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:37.042614 15440 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:37.043905 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:37.044463 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.045810 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.060809 18480 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:37.046298 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.047226 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:37.048785 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:37.056509 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:37.057530 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86540.1us
I20260709 13:05:37.208427 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:37.032755 18374 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.847s	user 0.014s	sys 0.000s
I20260709 13:05:37.001295 18426 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:37.060921 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.062431 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.218291 15515 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:37.063966 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.020632 18309 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:37.064906 15589 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.068578 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:37.070145 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.061172 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:37.218910 15512 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:37.221392 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.071843 15592 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:05:37.072103 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49206.3us
I20260709 13:05:37.224650 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:37.065896 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
W20260709 13:05:37.225950 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 160201us
W20260709 13:05:37.226497 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 173690us
I20260709 13:05:37.074203 15510 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.083088 15591 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:37.041322 18411 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.059212 18394 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.092559 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:37.087363 16180 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:37.031025 18365 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.042265 18461 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:37.104389 18165 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:37.103933 18410 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.048427 18191 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.106088 18247 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.107100 15438 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:37.122773 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:36.995842 18486 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:37.057932 16176 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:37.202097 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:37.154453 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:37.087532 18430 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:37.182757 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.041442 18498 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.250492 18374 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:37.222903 18147 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:05:37.230077 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:37.223239 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.231218 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:37.304675 15589 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.238747 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:37.241746 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 180637us
I20260709 13:05:37.244251 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:37.246312 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:37.246996 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.246336 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:37.220295 18501 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.300s	user 0.000s	sys 0.007s
I20260709 13:05:37.252283 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:37.310355 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:37.264333 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:37.210932 17900 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:37.258324 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:37.222157 18426 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:37.271253 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.238951 18297 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:37.240406 18386 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:37.206847 15587 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:37.279852 18360 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:37.302332 15514 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:37.306686 15592 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:37.308470 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 261324us
I20260709 13:05:37.271095 18309 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:37.312582 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54411.7us
I20260709 13:05:37.318123 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.320079 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.321834 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:37.229856 15590 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:37.327078 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:37.095343 18372 rpcz_store.cc:276] 0709 13:05:32.887447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.887704 (+   257us) service_pool.cc:224] Handling call
0709 13:05:33.235995 (+348291us) ts_tablet_manager.cc:934] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
0709 13:05:35.769726 (+2533731us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:36.417933 (+648207us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:36.418082 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:36.903976 (+485894us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:36.943724 (+ 39748us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:36.952003 (+  8279us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:36.952093 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":135350,"tablet-copy.queue_time_us":263566,"thread_start_us":385500,"threads_started":2}
I20260709 13:05:37.330478 15510 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:37.345204 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:37.334914 15589 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:37.350440 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:37.340809 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:37.287853 18393 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:37.353003 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.354260 15509 raft_consensus.cc:2410] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:05:37.351209 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:37.355384 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:37.357466 15509 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:37.360052 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.361141 15510 raft_consensus.cc:2410] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 4 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:37.302330 18374 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.365592 15509 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:05:37.369454 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 128522us
I20260709 13:05:37.324635 18426 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.378741 15588 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.384349 15407 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:37.323516 18463 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:37.325687 18485 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:37.340888 18360 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:37.348472 18473 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:37.366230 18409 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:37.244690 18394 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.398257 15509 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:37.371723 18374 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:37.357728 18297 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:37.369765 18309 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:37.431324 18444 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:37.432236 18444 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:37.435236 18444 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.435853 18461 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.435336 18309 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.435272 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.445653 15512 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:37.393705 18393 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:37.405148 18498 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.408356 18485 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.415138 18463 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:37.407914 18360 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:37.471069 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:37.473605 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:37.413650 18511 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:37.506052 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:37.507817 15510 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:37.510187 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:37.520493 15588 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:37.522409 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.481562 18339 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.525128 18339 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.525852 18413 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:37.526638 18486 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.452982 17900 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.480530 18485 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.533154 18372 tablet_copy_client.cc:806] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:37.533886 18372 tablet_copy_client.cc:670] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:37.535202 18197 tablet_bootstrap.cc:700] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Time spent opening tablet: real 0.103s	user 0.000s	sys 0.002s
I20260709 13:05:37.535756 18297 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.426577 18395 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:05:37.540028 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.633235 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.634801 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.541507 18247 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:37.550592 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:37.560182 18394 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:37.516077 18463 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:37.637773 18463 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.563418 18475 raft_consensus.cc:3055] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:37.638921 18475 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:37.640275 18475 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.640815 18394 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:37.641650 18475 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.641404 18394 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.565395 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:37.405838 18512 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:05:37.643998 18512 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.644634 18512 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.647032 15512 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:05:37.569175 18386 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.574249 18165 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:37.577167 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:37.578717 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:37.580247 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:37.581969 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:37.583257 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:37.684537 15511 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:37.582046 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:37.588912 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.591244 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 224028us
W20260709 13:05:37.591646 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 345430us
I20260709 13:05:37.605154 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:37.617012 17875 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:37.617691 18433 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.707s	user 0.019s	sys 0.006s
I20260709 13:05:37.647517 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:37.695871 15438 raft_consensus.cc:606] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:37.696400 15438 raft_consensus.cc:614] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:37.643945 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:37.506929 18409 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:37.698899 18409 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.701462 18409 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:37.647526 15512 pending_rounds.cc:85] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 3
I20260709 13:05:37.682260 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:37.702606 15512 pending_rounds.cc:107] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:05:37.702934 15583 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:37.683370 15437 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:05:37.647331 18512 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:37.555312 18339 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:37.687480 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:37.692835 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:37.713194 15511 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:37.702947 15512 raft_consensus.cc:2889] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.643891 18394 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:37.681100 18428 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.003s
I20260709 13:05:37.713750 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:37.686388 18386 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:37.682260 18165 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:37.615065 18491 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:37.717533 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:37.739256 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:37.720521 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:37.829922 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 90636.4us
W20260709 13:05:37.810655 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 205625us
I20260709 13:05:37.812831 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 494) took 1087 ms. Trace:
I20260709 13:05:37.831080 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:37.814286 15555 leader_election.cc:400] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:37.694564 18486 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:37.925973 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 93802.7us
I20260709 13:05:37.927837 18394 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:37.833791 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:37.929143 18394 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:37.929528 18394 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:37.929409 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 95692.4us
I20260709 13:05:37.930685 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:37.930631 18394 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:37.932983 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:37.833429 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 94287.8us
I20260709 13:05:37.941124 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:37.879772 18409 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:37.891499 15511 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
W20260709 13:05:37.895716 18411 consensus_meta.cc:287] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
W20260709 13:05:37.900810 18426 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 13:05:37.705094 17875 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.817790 18428 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.724105 18432 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.185s
I20260709 13:05:37.809662 18410 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:37.814586 18413 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:37.831979 15514 rpcz_store.cc:276] 0709 13:05:36.725147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.754586 (+ 29439us) service_pool.cc:224] Handling call
0709 13:05:36.771979 (+ 17393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.325835 (+553856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.812534 (+486699us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b5400212354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:37.812747 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219050240}
W20260709 13:05:37.845297 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.932722 18394 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:37.737591 18455 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.965909 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
W20260709 13:05:37.969424 15407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.016s	sys 0.016s
I20260709 13:05:37.826705 18395 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:37.828500 18339 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:37.711377 18436 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.255s
I20260709 13:05:37.928040 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:37.703646 18433 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:37.934551 18519 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:37.958767 18494 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.030s	sys 0.150s
I20260709 13:05:37.999950 15440 raft_consensus.cc:606] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:38.000533 15440 raft_consensus.cc:614] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:37.990521 15407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.017s	sys 0.017s
I20260709 13:05:37.993115 15516 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.979336 18426 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:38.002574 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 618337us
I20260709 13:05:37.980664 15443 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:05:38.005668 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 77705.7us
I20260709 13:05:37.983136 18480 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:38.007860 15406 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:38.022384 15518 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:37.975981 18411 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.023813 15583 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:37.993218 18409 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:37.988770 17900 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:38.005033 18494 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.030s	sys 0.151s
I20260709 13:05:37.997678 18339 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:38.044122 15515 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:37.960774 18491 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.010286 18511 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:38.026526 18436 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:38.017007 18395 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:37.992445 18413 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.047750 18480 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:38.103555 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 59743us
I20260709 13:05:38.085000 18339 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.021885 18410 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:05:38.095609 18392 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:38.006362 18485 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:38.095065 18520 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:38.127213 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:38.118381 18360 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.006s
I20260709 13:05:38.101711 18411 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:38.096633 18380 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:38.066206 17900 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.139901 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2022) took 1213 ms. Trace:
I20260709 13:05:38.152753 15588 rpcz_store.cc:276] 0709 13:05:36.926547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.926674 (+   127us) service_pool.cc:224] Handling call
0709 13:05:38.139667 (+1212993us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400114c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:38.139818 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905170816}
I20260709 13:05:38.142922 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:38.136155 18392 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:38.124642 18409 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:38.110026 18498 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:05:38.142972 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 210089us
I20260709 13:05:38.004873 18519 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:38.172325 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:38.146934 18395 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:38.145615 18532 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.143658 18523 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.120002 18480 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.155839 18530 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.182543 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:38.158468 18497 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:38.147763 18521 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:05:38.169142 18392 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:38.185469 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 244453us
I20260709 13:05:38.150332 18360 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.186764 18520 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:38.176391 18395 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:38.209359 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:38.156138 18380 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:38.222231 16180 raft_consensus.cc:2368] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6.
I20260709 13:05:38.187194 17875 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:38.198659 18432 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.199249 18255 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.214164 18428 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:38.230368 15510 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:38.237836 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2032) took 1002 ms. Trace:
I20260709 13:05:38.216881 18409 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.221581 18395 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.219897 18433 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:38.246447 15482 leader_election.cc:400] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6.
I20260709 13:05:38.257167 15482 leader_election.cc:403] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:38.217727 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:38.227277 18374 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.003s
W20260709 13:05:38.245012 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 88287.8us
I20260709 13:05:38.241662 15587 rpcz_store.cc:276] 0709 13:05:37.235734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.728179 (+492445us) service_pool.cc:224] Handling call
0709 13:05:37.932051 (+203872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.932318 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:38.141407 (+209089us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.237370 (+ 95963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.237437 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:38.237501 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.237597 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.237766 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":300717,"threads_started":2}
I20260709 13:05:38.270040 18165 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.271641 18409 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.274075 18409 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:38.237385 18255 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:38.270249 18374 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:38.265513 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60417.5us
I20260709 13:05:38.279929 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:38.280634 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:38.158875 18511 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:38.283569 15516 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:38.276675 18393 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:38.286301 15438 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:38.286830 18372 tablet_copy_client.cc:538] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:05:38.292419 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.307723 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:38.309119 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:38.185025 18532 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:38.297338 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.185913 18523 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.326030 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.326550 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.328940 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:38.195385 18530 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.337030 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:38.296216 18428 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6.
I20260709 13:05:38.265087 18360 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:38.314615 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:38.261034 18491 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:38.342901 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:38.333366 18455 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:38.359287 18535 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:05:38.359159 18526 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:05:38.360977 18380 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:38.361392 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1802) took 1051 ms. Trace:
I20260709 13:05:38.322418 18471 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.305464 18433 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:38.331698 18410 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.366396 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1657) took 1320 ms. Trace:
W20260709 13:05:38.434767 18381 consensus_meta.cc:287] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.228s	user 0.016s	sys 0.012s
I20260709 13:05:38.339833 18393 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.318913 18409 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:05:38.407941 18519 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:38.407478 18530 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:38.377789 18527 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.229s	user 0.000s	sys 0.002s
I20260709 13:05:38.531723 18521 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:38.376468 18485 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:38.532577 18521 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:38.468870 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.534758 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:38.535305 18386 consensus_meta.cc:287] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.000s
I20260709 13:05:38.535977 18386 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.538524 18386 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:38.436463 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:38.478276 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.367867 15442 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:38.541002 18521 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:38.541545 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.481611 15515 rpcz_store.cc:276] 0709 13:05:37.045967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.225306 (+179339us) service_pool.cc:224] Handling call
0709 13:05:38.366109 (+1140803us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400213c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:38.366310 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685653376}
I20260709 13:05:38.377225 18413 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:38.482820 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:38.543828 15441 raft_consensus.cc:2368] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:38.544741 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:38.545395 15441 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.259809 18497 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:38.546748 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.385866 15434 rpcz_store.cc:276] 0709 13:05:37.309859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.705545 (+395686us) service_pool.cc:224] Handling call
0709 13:05:37.712052 (+  6507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.819124 (+107072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.819174 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.920021 (+100847us) log.cc:844] Serialized 26 byte log entry
0709 13:05:38.144714 (+224693us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:38.144781 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.144894 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.361126 (+216232us) raft_consensus.cc:1685] finished
0709 13:05:38.361153 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.361320 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148575,"raft.queue_time_us":116815,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":139,"thread_start_us":224126,"threads_started":1,"wal-append.queue_time_us":298349}
I20260709 13:05:38.547142 18497 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.548041 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:38.366081 18475 consensus_meta.cc:287] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.004s
I20260709 13:05:38.466255 18247 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:38.583892 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:38.491735 18062 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.493546 18365 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:38.493727 18498 raft_consensus.cc:993] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:38.495077 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:05:38.588851 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 93861.8us
W20260709 13:05:38.495728 18486 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.003s
I20260709 13:05:38.497268 18494 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.454949 18255 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:38.502480 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 180822us
I20260709 13:05:38.409472 18523 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:38.516804 18507 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.092s	user 0.006s	sys 0.006s
I20260709 13:05:38.517360 18553 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:38.502050 18410 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.525738 18395 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:38.459821 18339 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.384656 18540 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:38.481920 18529 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.363487 18532 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:38.541592 15516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 2056) took 1421 ms (client timeout 1763 ms). Trace:
I20260709 13:05:38.546141 18461 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:38.409662 18430 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 1.110s	user 0.007s	sys 0.007s
W20260709 13:05:38.548890 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.553800 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.523294 18372 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
W20260709 13:05:38.570192 18544 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.185s	user 0.001s	sys 0.002s
W20260709 13:05:38.572440 18548 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:05:38.582073 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.484931 18471 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:38.653041 15439 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:38.593364 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:38.595168 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 286118us
I20260709 13:05:38.503803 18381 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.627996 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.622254 15585 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:05:38.655243 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:38.609899 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:38.642378 15516 rpcz_store.cc:269] 0709 13:05:37.120180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.201648 (+ 81468us) service_pool.cc:224] Handling call
0709 13:05:38.541346 (+1339698us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54002a1554. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:38.541505 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647282432}
I20260709 13:05:38.598960 15436 raft_consensus.cc:2410] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:38.611910 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:38.656808 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:38.660676 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:38.611043 15441 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
W20260709 13:05:38.649534 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 53598.4us
W20260709 13:05:38.661459 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 328362us
W20260709 13:05:38.655315 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62094us
I20260709 13:05:38.664726 15407 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:38.656190 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:38.645145 15442 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:38.662917 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.597095 18365 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:38.597625 18394 raft_consensus.cc:1081] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:38.617453 18255 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:38.679931 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:38.730130 15584 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:38.667984 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:38.730429 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:38.668931 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.731361 15441 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:38.731752 15434 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:38.667984 15442 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:38.664153 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:38.674799 15591 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:38.647156 18428 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:38.709261 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53149.8us
I20260709 13:05:38.617645 18444 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:38.665220 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:38.673091 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:38.626091 18531 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:38.640497 18540 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:38.661087 18491 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:38.591778 18386 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:05:38.739497 15517 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:38.676313 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:38.643059 17900 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:38.592299 18247 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:38.587291 18062 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.647042 18463 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.615528 18494 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:38.632153 18402 consensus_queue.cc:1059] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:05:38.589015 18392 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.651506 18553 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:38.654107 18529 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.589754 18480 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:39.812373 15438 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:39.812985 18402 raft_consensus.cc:3055] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:39.813455 18402 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:39.813561 18062 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.813696 18480 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:39.814468 18480 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:39.584400 18436 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:05:38.825459 18197 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:05:39.830201 18436 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:39.831363 18436 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.832970 18436 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:39.816507 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1807) took 1329 ms. Trace:
I20260709 13:05:39.833566 15438 rpcz_store.cc:276] 0709 13:05:38.487462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.583997 (+ 96535us) service_pool.cc:224] Handling call
0709 13:05:39.816265 (+1232268us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002260d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:39.816429 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2660750080}
I20260709 13:05:39.485462 18530 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:38.759714 18375 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:38.757349 18455 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.836277 18375 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:39.836127 18455 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.836860 18375 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:38.760151 15588 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:05:39.839022 18375 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:39.839144 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2049) took 1144 ms. Trace:
I20260709 13:05:39.839588 15588 rpcz_store.cc:276] 0709 13:05:38.695054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.736775 (+ 41721us) service_pool.cc:224] Handling call
0709 13:05:38.737173 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.838838 (+1101665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.839070 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.839972 18530 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.841126 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:39.842047 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 1723) took 1019 ms. Trace:
I20260709 13:05:39.534226 18411 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:39.818152 18392 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:39.299794 15589 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.001s	sys 0.009s
W20260709 13:05:39.863921 15589 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.009s	sys 0.034s
W20260709 13:05:38.782958 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54528.6us
I20260709 13:05:38.672689 18519 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:39.819562 15437 raft_consensus.cc:2410] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:05:39.874202 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.822485 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:39.886162 16175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 442) took 1189 ms. Trace:
I20260709 13:05:39.886797 16175 rpcz_store.cc:276] 0709 13:05:38.697307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.726897 (+ 29590us) service_pool.cc:224] Handling call
0709 13:05:39.886050 (+1159153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.890328 18339 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:39.897226 18529 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:38.758322 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:38.741765 15586 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.662943 18532 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:39.565696 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:38.757894 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:39.900178 16181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 445) took 1143 ms. Trace:
I20260709 13:05:39.900807 16182 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 4: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:39.900684 16181 rpcz_store.cc:276] 0709 13:05:38.757373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.758076 (+   703us) service_pool.cc:224] Handling call
0709 13:05:39.900103 (+1142027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.901331 16182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 443) took 1165 ms. Trace:
I20260709 13:05:39.901723 16182 rpcz_store.cc:276] 0709 13:05:38.736433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.736702 (+   269us) service_pool.cc:224] Handling call
0709 13:05:39.901269 (+1164567us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:39.577171 18546 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 1.146s	user 0.003s	sys 0.000s
I20260709 13:05:39.652604 18165 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:39.907176 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1712) took 1397 ms. Trace:
I20260709 13:05:39.907733 15438 rpcz_store.cc:276] 0709 13:05:38.509915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.834874 (+1324959us) service_pool.cc:224] Handling call
0709 13:05:39.835278 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.906754 (+ 71476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.906789 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.906841 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:39.906881 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.906956 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.907105 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71025}
I20260709 13:05:39.590687 15442 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:39.909161 15586 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:39.909474 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1806) took 1422 ms. Trace:
I20260709 13:05:39.909873 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2045) took 1237 ms. Trace:
I20260709 13:05:39.909976 15442 rpcz_store.cc:276] 0709 13:05:38.487200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.570467 (+1083267us) service_pool.cc:224] Handling call
0709 13:05:39.590398 (+ 19931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.909169 (+318771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.909412 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.910466 15586 rpcz_store.cc:276] 0709 13:05:38.672195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.672327 (+   132us) service_pool.cc:224] Handling call
0709 13:05:39.909727 (+1237400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.742947 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:39.911605 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:39.912134 16178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 444) took 1169 ms. Trace:
I20260709 13:05:39.912490 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 1722) took 1109 ms. Trace:
W20260709 13:05:39.702828 16147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.000s	sys 0.035s
W20260709 13:05:39.913560 16147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.000s	sys 0.038s
I20260709 13:05:39.815897 18540 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:38.986768 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1794) took 2103 ms. Trace:
I20260709 13:05:39.438987 18471 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:39.822737 18494 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:39.485028 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 497) took 2646 ms. Trace:
I20260709 13:05:39.809438 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:39.916505 16180 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.916251 15518 rpcz_store.cc:276] 0709 13:05:36.838525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.838696 (+   171us) service_pool.cc:224] Handling call
0709 13:05:36.839044 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.022898 (+1183854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.484615 (+1461717us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400369cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:39.484947 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720966528}
I20260709 13:05:39.915786 15435 rpcz_store.cc:276] 0709 13:05:36.840534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.844172 (+  3638us) service_pool.cc:224] Handling call
0709 13:05:36.844589 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.865518 (+ 20929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.865546 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.877168 (+ 11622us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.242492 (+365324us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:37.242555 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.242667 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.515971 (+1273304us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:38.902248 (+386277us) raft_consensus.cc:1685] finished
0709 13:05:38.902283 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.943706 (+ 41423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42903296,"thread_start_us":323668,"threads_started":1,"wal-append.queue_time_us":431002}
I20260709 13:05:39.919809 15435 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:39.872519 18444 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:39.809463 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:39.912482 16178 rpcz_store.cc:276] 0709 13:05:38.742439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.742581 (+   142us) service_pool.cc:224] Handling call
0709 13:05:39.912069 (+1169488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.921422 16176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 440) took 1230 ms. Trace:
I20260709 13:05:39.921533 18444 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.921896 16176 rpcz_store.cc:276] 0709 13:05:38.690864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.727229 (+ 36365us) service_pool.cc:224] Handling call
0709 13:05:39.921344 (+1194115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66048}
I20260709 13:05:38.861943 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:39.922713 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1814) took 1284 ms. Trace:
I20260709 13:05:39.817999 18531 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:39.924599 15442 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:39.924737 18432 consensus_meta.cc:287] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.684s	user 0.013s	sys 0.002s
I20260709 13:05:39.925382 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1714) took 1414 ms. Trace:
I20260709 13:05:39.484189 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 369) took 1804 ms. Trace:
I20260709 13:05:39.867463 18571 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:39.925587 18531 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:39.923254 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2053) took 1187 ms. Trace:
I20260709 13:05:39.926308 18571 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.430569 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44656 (request call id 36) took 1503 ms. Trace:
I20260709 13:05:39.927268 15583 rpcz_store.cc:276] 0709 13:05:38.770708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.861571 (+ 90863us) service_pool.cc:224] Handling call
0709 13:05:39.923178 (+1061607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.927497 15440 rpcz_store.cc:276] 0709 13:05:37.927515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.965718 (+ 38203us) service_pool.cc:224] Handling call
0709 13:05:39.430182 (+1464464us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b540006a754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd51853 00007fcf80d1f60a 00007fcf7a2a57d4 00007fcf7a2a5762 00007fcf7a2a5691 00007fcf7a2a560c 00007fcf7a2a48c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:39.430411 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21701888}
I20260709 13:05:38.745085 18428 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:39.436290 18559 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.449s	user 0.001s	sys 0.000s
W20260709 13:05:39.805049 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 1.13981e+06us
I20260709 13:05:38.757647 18473 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:38.750864 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86772.7us
I20260709 13:05:39.439661 18410 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.945421 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:39.569576 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2065) took 1990 ms. Trace:
I20260709 13:05:39.946326 15510 rpcz_store.cc:276] 0709 13:05:37.579503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.583395 (+  3892us) service_pool.cc:224] Handling call
0709 13:05:37.583806 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.241544 (+657738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.569250 (+1327706us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400202bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:39.569492 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1486179200}
I20260709 13:05:39.815670 18463 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:39.846267 16148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.024s	sys 0.022s
W20260709 13:05:39.949651 16148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.024s	sys 0.022s
I20260709 13:05:39.950264 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:39.815673 18480 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.953301 18455 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:39.956436 18428 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.958001 16180 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:39.958606 16180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 446) took 1175 ms. Trace:
I20260709 13:05:39.958895 16180 rpcz_store.cc:276] 0709 13:05:38.782805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.782969 (+   164us) service_pool.cc:224] Handling call
0709 13:05:39.958541 (+1175572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.959808 18571 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.961154 18463 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.805233 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:39.962357 15584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2052) took 1265 ms (client timeout 1517 ms). Trace:
W20260709 13:05:39.962821 15584 rpcz_store.cc:269] 0709 13:05:38.697102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.733924 (+ 36822us) service_pool.cc:224] Handling call
0709 13:05:39.962153 (+1228229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.963956 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:39.964277 18374 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:39.964727 15584 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:39.827451 18247 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:39.818513 15517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 2054) took 2738 ms (client timeout 1892 ms). Trace:
W20260709 13:05:39.968019 15517 rpcz_store.cc:269] 0709 13:05:37.081188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.154025 (+ 72837us) service_pool.cc:224] Handling call
0709 13:05:39.818188 (+2664163us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400212d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:39.818368 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3340036480}
I20260709 13:05:39.853737 15588 rpcz_store.cc:276] 0709 13:05:38.823165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.840801 (+1017636us) service_pool.cc:224] Handling call
0709 13:05:39.841976 (+  1175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:39.969794 18461 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 1.315s	user 0.012s	sys 0.000s
I20260709 13:05:39.842796 18530 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.808123 18426 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.164443 18510 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.971083 18510 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:39.878531 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:39.975914 15516 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:05:39.977245 16174 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:39.979136 16174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 334) took 3204 ms. Trace:
I20260709 13:05:39.881196 18569 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:39.882277 16146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.000s	sys 0.004s
I20260709 13:05:39.884063 18577 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:39.979892 16146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.000s	sys 0.004s
I20260709 13:05:39.979997 18531 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.980669 18531 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.981498 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:39.983757 18558 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:39.163938 18543 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:39.255034 18318 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.975215 18510 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.894239 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2047) took 1204 ms. Trace:
I20260709 13:05:39.900046 18532 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:38.807163 15587 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:39.912895 15586 rpcz_store.cc:276] 0709 13:05:38.803058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.911357 (+1108299us) service_pool.cc:224] Handling call
0709 13:05:39.912430 (+  1073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.993808 15584 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:39.995451 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 372) took 1270 ms. Trace:
I20260709 13:05:39.995893 15586 rpcz_store.cc:276] 0709 13:05:38.725359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.994626 (+1269267us) service_pool.cc:224] Handling call
0709 13:05:39.994955 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.995141 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.995165 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.995206 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:39.995236 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.995285 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.995400 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.996428 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 373) took 1270 ms. Trace:
W20260709 13:05:39.996587 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46387us
I20260709 13:05:39.826011 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:39.820598 18553 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.928715 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:39.900264 15591 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:39.164106 18554 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:39.163679 18547 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:39.178301 18395 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:39.015473 18511 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:39.925971 15590 rpcz_store.cc:276] 0709 13:05:37.680119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.052858 (+372739us) service_pool.cc:224] Handling call
0709 13:05:38.053348 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.188193 (+134845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.188241 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.188301 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:38.188356 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.483799 (+1295443us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540016cbd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:39.483870 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.484089 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309392256}
I20260709 13:05:39.984438 18558 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:39.929333 18393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.295s	user 0.033s	sys 0.047s
W20260709 13:05:39.875003 18413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.257s	user 0.003s	sys 0.010s
I20260709 13:05:39.826105 18402 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:39.951234 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 508) took 1299 ms. Trace:
I20260709 13:05:39.952157 18339 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:39.952230 18392 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:39.979257 16177 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 3.
I20260709 13:05:39.568638 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2064) took 2051 ms. Trace:
I20260709 13:05:39.925428 18432 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:39.986817 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:39.988566 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50663.7us
I20260709 13:05:39.857735 18361 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.983268 18531 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.993472 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:39.946787 18381 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.856895 18411 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:40.130048 18197 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 13:05:40.179575 16182 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 4: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:05:40.180121 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 1726) took 1080 ms. Trace:
I20260709 13:05:40.148851 18540 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.180977 18392 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.181375 16178 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:40.182255 18197 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:40.182427 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.183001 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2039) took 1573 ms. Trace:
W20260709 13:05:40.070161 15557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.007s
I20260709 13:05:40.184072 18480 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:39.999104 18532 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.201303 18540 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:40.196839 18393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.563s	user 0.033s	sys 0.055s
I20260709 13:05:39.997524 15586 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:40.197432 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.197796 18509 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:40.202632 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1724) took 1137 ms. Trace:
I20260709 13:05:40.203490 18494 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:40.199435 15588 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:40.204231 18430 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.179761 18554 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:40.205080 18554 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:40.204725 18430 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.205667 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2051) took 1508 ms. Trace:
I20260709 13:05:40.206115 15588 rpcz_store.cc:276] 0709 13:05:38.696815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.969655 (+1272840us) service_pool.cc:224] Handling call
0709 13:05:39.970051 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.204368 (+234317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.205378 (+  1010us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540016c6d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:40.205600 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527053056}
W20260709 13:05:40.133888 18563 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 13:05:40.207955 18494 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:40.132509 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:39.985652 18519 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:39.945807 18523 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.207957 18430 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.207427 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:39.949203 17875 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:40.208985 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 76642.9us
I20260709 13:05:40.210659 15588 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:39.979918 18569 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:39.980154 18577 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.212500 15588 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:40.213192 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1725) took 1121 ms. Trace:
I20260709 13:05:39.992637 15585 rpcz_store.cc:276] 0709 13:05:38.689890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.693025 (+  3135us) service_pool.cc:224] Handling call
0709 13:05:38.743302 (+ 50277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.046668 (+303366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.046719 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:39.047752 (+  1033us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.893852 (+846100us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:39.893895 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.893973 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.894018 (+    45us) raft_consensus.cc:1685] finished
0709 13:05:39.894029 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.894176 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7550,"raft.queue_time_us":1062488,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":180,"thread_start_us":344036,"threads_started":2,"wal-append.queue_time_us":38939}
I20260709 13:05:40.200788 18411 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:39.994660 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2048) took 1301 ms. Trace:
I20260709 13:05:40.208997 18494 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.198760 18197 tablet_bootstrap.cc:492] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
W20260709 13:05:40.210026 16177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52910 (request call id 384) took 2729 ms (client timeout 1537 ms). Trace:
I20260709 13:05:40.203461 18402 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:40.124874 18562 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.316s	user 0.002s	sys 0.000s
I20260709 13:05:40.210906 17875 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.213591 15588 rpcz_store.cc:276] 0709 13:05:39.092121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.211753 (+1119632us) service_pool.cc:224] Handling call
0709 13:05:40.212148 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.212917 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.213130 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:40.196552 18413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.579s	user 0.003s	sys 0.018s
I20260709 13:05:40.209676 18523 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.210515 18511 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.204010 15583 raft_consensus.cc:2393] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:40.195465 15591 rpcz_store.cc:276] 0709 13:05:39.099801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.565264 (+465463us) service_pool.cc:224] Handling call
0709 13:05:40.180039 (+614775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.248080 18547 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:40.195976 15589 rpcz_store.cc:276] 0709 13:05:38.609981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.610112 (+   131us) service_pool.cc:224] Handling call
0709 13:05:38.610461 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.610857 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.610882 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.646978 (+ 36096us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.864699 (+1217721us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:39.864769 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.864894 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.182742 (+317848us) raft_consensus.cc:1685] finished
0709 13:05:40.182766 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.182934 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":523,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":1107032,"threads_started":1,"wal-append.queue_time_us":1234956}
W20260709 13:05:40.114444 18561 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.303s	user 0.003s	sys 0.001s
I20260709 13:05:40.249797 18392 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:40.249341 18547 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.250697 15590 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:05:40.250794 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2040) took 1640 ms. Trace:
I20260709 13:05:40.209173 18519 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:40.252563 18197 ts_tablet_manager.cc:1403] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 3.834s	user 0.043s	sys 0.068s
I20260709 13:05:40.251387 15592 rpcz_store.cc:276] 0709 13:05:38.610298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.610411 (+   113us) service_pool.cc:224] Handling call
0709 13:05:38.619039 (+  8628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.619710 (+   671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.619757 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.620427 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 13:05:38.943282 (+322855us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:38.943335 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.943431 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.113656 (+1170225us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:40.250470 (+136814us) raft_consensus.cc:1685] finished
0709 13:05:40.250494 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.250728 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1552,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":91217664,"thread_start_us":322293,"threads_started":1,"wal-append.queue_time_us":1190202}
I20260709 13:05:40.253515 17875 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:40.203064 15586 rpcz_store.cc:276] 0709 13:05:39.065320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.996858 (+931538us) service_pool.cc:224] Handling call
0709 13:05:39.997191 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.202294 (+205103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.202561 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.256628 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:40.195974 15557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.008s	sys 0.011s
I20260709 13:05:40.252530 18519 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:40.274587 18519 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.216416 18569 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.999580 16180 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:40.259430 18494 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.279639 18540 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:39.984987 18575 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.275s
I20260709 13:05:40.260581 18393 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:40.280733 18540 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.255892 18558 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:39.996784 15584 rpcz_store.cc:276] 0709 13:05:38.725700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.995606 (+1269906us) service_pool.cc:224] Handling call
0709 13:05:39.995935 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.996124 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.996149 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.996191 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:39.996221 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.996272 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.996372 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.283087 18540 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:40.259752 18411 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:39.987471 16174 rpcz_store.cc:276] 0709 13:05:36.774802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.779597 (+  4795us) service_pool.cc:224] Handling call
0709 13:05:36.780005 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.977685 (+3197680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.978820 (+  1135us) spinlock_profiling.cc:243] Waited 3.2 s on lock 0x7b54004bbed4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:39.979038 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7351888768}
I20260709 13:05:40.266557 18491 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:40.283661 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.284030 18491 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.285177 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.286417 18491 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:40.214178 18577 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.267675 15583 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:40.268175 18413 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.258463 16179 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:40.269289 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.269738 18375 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.289753 15585 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:40.289392 18413 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:40.259114 16177 rpcz_store.cc:269] 0709 13:05:37.480569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.480735 (+   166us) service_pool.cc:224] Handling call
0709 13:05:40.209770 (+2729035us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b540049bbd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:40.209911 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5366934400}
I20260709 13:05:40.270079 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:40.270691 18339 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:40.257874 18523 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.272951 18197 raft_consensus.cc:359] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:40.215939 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:40.278064 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.279919 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.267478 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.251580 15587 rpcz_store.cc:276] 0709 13:05:38.694669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.694828 (+   159us) service_pool.cc:224] Handling call
0709 13:05:38.781822 (+ 86994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.994229 (+1212407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.994599 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.256861 18511 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:40.291709 16179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 447) took 1485 ms (client timeout 1517 ms). Trace:
I20260709 13:05:40.305835 15586 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:40.305500 18554 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:40.305624 16179 rpcz_store.cc:269] 0709 13:05:38.806420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.012792 (+206372us) service_pool.cc:224] Handling call
0709 13:05:39.825638 (+812846us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b5800004598. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:05:40.291634 (+465996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13103488}
I20260709 13:05:40.296048 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.308492 15589 raft_consensus.cc:2410] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:40.289816 18375 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.314245 18375 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.315448 18554 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:39.662490 15341 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:39.767634 15406 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.013s	sys 0.050s
W20260709 13:05:40.363232 15406 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.620s	user 0.013s	sys 0.054s
W20260709 13:05:40.364537 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 1.6357e+06us
I20260709 13:05:39.920462 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1716) took 1409 ms. Trace:
I20260709 13:05:40.368525 15435 rpcz_store.cc:276] 0709 13:05:38.511468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.919088 (+1407620us) service_pool.cc:224] Handling call
0709 13:05:39.919465 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.920205 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.920402 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.369571 15440 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:39.176827 15443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1687) took 2169 ms (client timeout 1854 ms). Trace:
W20260709 13:05:39.583722 15436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1693) took 2564 ms (client timeout 2110 ms). Trace:
I20260709 13:05:39.936077 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:40.372041 15436 rpcz_store.cc:269] 0709 13:05:37.018961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.576815 (+557854us) service_pool.cc:224] Handling call
0709 13:05:39.583296 (+2006481us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54003f8ed4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:39.583597 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112820480}
I20260709 13:05:39.929363 15442 rpcz_store.cc:276] 0709 13:05:38.510691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.911158 (+1400467us) service_pool.cc:224] Handling call
0709 13:05:39.911510 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.925007 (+ 13497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.925311 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.370995 15513 rpcz_store.cc:276] 0709 13:05:37.517951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.518362 (+   411us) service_pool.cc:224] Handling call
0709 13:05:37.604090 (+ 85728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.703230 (+ 99140us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:38.186184 (+482954us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.332489 (+146305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.332572 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:38.332676 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.559849 (+227173us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b18003dfcc0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:39.568237 (+1008388us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b54000ecc54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:39.568312 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.568538 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":617361,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":3359,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":143,"spinlock_wait_cycles":249729664,"thread_start_us":604109,"threads_started":2,"wal-append.queue_time_us":341390,"wal-append.run_cpu_time_us":1353,"wal-append.run_wall_time_us":1004293}
I20260709 13:05:40.375036 15436 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:39.923139 15438 rpcz_store.cc:276] 0709 13:05:38.638829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.921808 (+1282979us) service_pool.cc:224] Handling call
0709 13:05:39.922169 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.922366 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.922393 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.922437 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:39.922478 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.922531 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.922640 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.377094 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 305) took 1649 ms. Trace:
I20260709 13:05:40.377880 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 306) took 1593 ms. Trace:
I20260709 13:05:40.378266 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:39.814919 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1811) took 1269 ms. Trace:
I20260709 13:05:40.380031 15439 rpcz_store.cc:276] 0709 13:05:38.545657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.676013 (+130356us) service_pool.cc:224] Handling call
0709 13:05:39.814837 (+1138824us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.821270 15441 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:05:40.303771 15590 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:40.302836 15592 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:40.297046 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:40.296234 15583 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:40.409722 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:40.517112 15512 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:40.449812 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1804) took 1962 ms. Trace:
I20260709 13:05:40.519162 15434 rpcz_store.cc:276] 0709 13:05:38.486705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.740604 (+253899us) service_pool.cc:224] Handling call
0709 13:05:40.445303 (+1704699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.445922 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.445959 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.446048 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:40.446217 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.446382 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.449190 (+  2808us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54000a4e50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:40.449529 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3823404416}
I20260709 13:05:40.300042 18339 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.521426 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:40.522631 15434 raft_consensus.cc:606] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:40.297302 18413 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:40.388216 15514 rpcz_store.cc:276] 0709 13:05:38.652363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.652627 (+   264us) service_pool.cc:224] Handling call
0709 13:05:38.653114 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.924026 (+1270912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.924058 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.924103 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:39.924138 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.950973 (+ 26835us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002030d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:39.951022 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.951159 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2922239872}
I20260709 13:05:40.394985 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 304) took 1667 ms. Trace:
W20260709 13:05:40.513585 15407 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.517s (SENT) [suppressed 7 similar messages]
I20260709 13:05:40.401463 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.527803 18393 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:40.378499 15438 rpcz_store.cc:276] 0709 13:05:38.784292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.376303 (+1592011us) service_pool.cc:224] Handling call
0709 13:05:40.376950 (+   647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.377347 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.377373 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.377446 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:40.377499 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.377565 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.377676 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:40.409207 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.448061 15437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1715) took 1936 ms (client timeout 1553 ms). Trace:
I20260709 13:05:40.529182 18393 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:40.529888 15437 rpcz_store.cc:269] 0709 13:05:38.511047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.540185 (+ 29138us) service_pool.cc:224] Handling call
0709 13:05:40.444362 (+1904177us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000a4e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:40.447576 (+  3214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936454016}
I20260709 13:05:40.380060 15515 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:40.532033 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:40.389716 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.377645 15442 rpcz_store.cc:276] 0709 13:05:38.728997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.375246 (+1646249us) service_pool.cc:224] Handling call
0709 13:05:40.375986 (+   740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.376479 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.376513 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.376589 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:40.376626 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.376688 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.376859 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.533075 18393 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:40.300398 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.533869 18511 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:40.529145 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 592957us
W20260709 13:05:40.535140 15441 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1813) took 1946 ms (client timeout 2046 ms). Trace:
I20260709 13:05:40.526068 18554 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:40.535029 18511 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:40.427000 18411 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:40.382642 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 307) took 1556 ms. Trace:
I20260709 13:05:40.526470 15436 rpcz_store.cc:276] 0709 13:05:38.727629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.374004 (+1646375us) service_pool.cc:224] Handling call
0709 13:05:40.374629 (+   625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.394637 (+ 20008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.394893 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:40.405115 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.371065 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1815) took 1731 ms. Trace:
I20260709 13:05:40.527904 15517 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:40.563014 15439 rpcz_store.cc:276] 0709 13:05:38.826654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.381120 (+1554466us) service_pool.cc:224] Handling call
0709 13:05:40.381680 (+   560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.382159 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.382199 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.382268 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:40.382351 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.382418 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.382576 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:40.536041 15441 rpcz_store.cc:269] 0709 13:05:38.588282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.666242 (+ 77960us) service_pool.cc:224] Handling call
0709 13:05:40.534909 (+1868667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.412563 18375 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:40.573325 18375 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.300205 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:40.429186 18480 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:40.394009 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.564592 15440 rpcz_store.cc:276] 0709 13:05:38.639168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.928860 (+1289692us) service_pool.cc:224] Handling call
0709 13:05:40.368911 (+440051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.370523 (+  1612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.370936 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:40.371743 15443 rpcz_store.cc:269] 0709 13:05:37.007834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.008024 (+   190us) service_pool.cc:224] Handling call
0709 13:05:39.176455 (+2168431us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b540006a254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:39.176686 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947646720}
W20260709 13:05:40.388264 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 95667.9us
W20260709 13:05:40.590473 18372 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.053s	user 0.004s	sys 0.000s
I20260709 13:05:40.595374 18523 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.596501 18523 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.597700 18375 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.598603 15513 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:05:40.599125 15513 pending_rounds.cc:85] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 3
I20260709 13:05:40.601845 15509 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:40.607127 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:40.430410 18519 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:40.613173 15509 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:40.605585 18523 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.620131 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:40.599474 15513 pending_rounds.cc:107] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:05:40.623677 15515 raft_consensus.cc:3055] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:40.623966 15513 raft_consensus.cc:2889] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:40.302284 18532 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.624291 15515 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:40.625633 15510 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:40.626866 18532 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.536052 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:40.625804 15515 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.429775 18491 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:40.637837 15518 raft_consensus.cc:2393] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:40.303923 18197 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:05:40.652264 18197 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:40.650147 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:40.658352 15512 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:40.579603 18411 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.573302 15341 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 7 to 8, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:40.660351 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:40.613471 18519 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.450704 18540 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.215s
I20260709 13:05:40.674335 15509 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:40.668471 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:40.640498 17875 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:40.673062 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1816) took 2033 ms. Trace:
I20260709 13:05:40.666034 18532 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:40.676864 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:40.682521 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 80955.1us
I20260709 13:05:40.686080 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:40.687829 15515 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:40.688063 17875 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.694242 15518 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:05:40.694994 15518 pending_rounds.cc:85] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:40.695297 15518 pending_rounds.cc:107] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:40.695634 15518 raft_consensus.cc:2889] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:40.654955 18480 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:40.712545 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.678550 15435 rpcz_store.cc:276] 0709 13:05:38.639566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.370624 (+1731058us) service_pool.cc:224] Handling call
0709 13:05:40.371468 (+   844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.393021 (+ 21553us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:40.393545 (+   524us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.668504 (+274959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.668569 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:40.672759 (+  4190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.672855 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.672995 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65118,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":4909,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":5632,"thread_start_us":271435,"threads_started":1}
I20260709 13:05:40.717911 18532 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.722514 18532 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.723424 15341 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 4 to 6, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 6 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.725698 18532 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.729444 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:40.736989 15341 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 2 to 5, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 5 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.738564 17875 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:40.743772 18339 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:40.723430 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:40.750743 15338 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 107) took 9042 ms. Trace:
I20260709 13:05:40.750067 18511 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.709638 18491 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.752224 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:40.752688 15584 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:40.728734 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 49247.2us
I20260709 13:05:40.734565 15443 raft_consensus.cc:606] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:40.768523 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.768301 18532 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.770749 18532 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.751253 15338 rpcz_store.cc:276] 0709 13:05:31.755672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.784427 (+ 28755us) service_pool.cc:224] Handling call
0709 13:05:40.750397 (+8965970us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:34.575737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:34.745955 (+170218us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:34.746011 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:05:34.746037 (+    26us) tablet.cc:662] Decoding operations
0709 13:05:34.747225 (+  1188us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:34.747313 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:34.747355 (+    42us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:05:35.087865 (+340510us) tablet.cc:701] Row locks acquired
0709 13:05:35.221546 (+133681us) write_op.cc:260] PREPARE: finished
0709 13:05:35.321312 (+ 99766us) write_op.cc:270] Start()
0709 13:05:35.363469 (+ 42157us) write_op.cc:276] Timestamp: P: 1783602335289146 usec, L: 0
0709 13:05:35.363531 (+    62us) op_driver.cc:348] REPLICATION: starting
0709 13:05:35.582990 (+219459us) log.cc:844] Serialized 3218 byte log entry
0709 13:05:36.093539 (+510549us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd52e28 00007fcf7f78d581 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d 000000000038f354 000000000038f199
0709 13:05:36.445183 (+351644us) op_driver.cc:464] REPLICATION: finished
0709 13:05:36.915661 (+470478us) write_op.cc:301] APPLY: starting
0709 13:05:36.915805 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:36.916037 (+   232us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:36.916061 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:36.966860 (+ 50799us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:36.967155 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:05:36.967216 (+    61us) write_op.cc:312] APPLY: finished
0709 13:05:36.984299 (+ 17083us) log.cc:844] Serialized 65 byte log entry
0709 13:05:36.997082 (+ 12783us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:37.021092 (+ 24010us) write_op.cc:454] Released schema lock
0709 13:05:37.032294 (+ 11202us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:37.072934 (+ 40640us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:37.090845 (+ 17911us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1061651,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":446590,"apply.run_cpu_time_us":4590,"apply.run_wall_time_us":155485,"num_ops":8,"prepare.queue_time_us":832416,"prepare.run_cpu_time_us":67463,"prepare.run_wall_time_us":1518019,"raft.queue_time_us":225190,"raft.run_cpu_time_us":87419,"raft.run_wall_time_us":235924,"replication_time_us":1060014,"spinlock_wait_cycles":118504704,"thread_start_us":826208,"threads_started":4,"wal-append.queue_time_us":368392,"wal-append.run_cpu_time_us":15304,"wal-append.run_wall_time_us":2037535}]]}
W20260709 13:05:40.778100 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 264802us
I20260709 13:05:40.795481 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.757535 18393 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:40.796118 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 260395us
I20260709 13:05:40.698061 18554 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:40.785454 15512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:05:40.805433 15512 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.805939 18575 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:40.806336 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:40.806350 15512 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:40.814627 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.813289 18197 ts_tablet_manager.cc:1434] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.560s	user 0.013s	sys 0.007s
I20260709 13:05:40.818812 18361 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:40.819037 18197 ts_tablet_manager.cc:1467] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Tablet startup took 565ms
W20260709 13:05:40.819582 18197 ts_tablet_manager.cc:1469] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Trace:
0709 13:05:27.248891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.249103 (+   212us) service_pool.cc:224] Handling call
0709 13:05:27.672729 (+423626us) ts_tablet_manager.cc:934] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
0709 13:05:31.465013 (+3792284us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:32.139844 (+674831us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:32.140016 (+   172us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:32.337558 (+197542us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:32.338024 (+   466us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:32.338487 (+   463us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:32.338627 (+   140us) inbound_call.cc:177] Queueing success response
0709 13:05:36.418807 (+4080180us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:40.253195 (+3834388us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:40.253883 (+   688us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:40.254590 (+   707us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":81519,"raft.queue_time_us":302,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":248,"tablet-copy.queue_time_us":422367,"tablet-download-pool.queue_time_us":11074,"tablet-download-pool.run_cpu_time_us":1732,"tablet-download-pool.run_wall_time_us":2268336,"thread_start_us":405616,"threads_started":2}
I20260709 13:05:40.831370 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:40.806682 18575 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.843066 18372 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:40.846740 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:40.847340 18532 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:40.816671 18393 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:40.849197 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:40.863135 15517 raft_consensus.cc:2410] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:40.861482 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.851768 18575 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:40.876216 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:40.882689 15510 raft_consensus.cc:2376] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6. Re-sending same reply.
W20260709 13:05:40.891901 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 85739.2us
I20260709 13:05:40.893150 18519 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:40.893393 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:40.895702 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46507.1us
I20260709 13:05:40.896749 16146 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:40.897748 18523 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.898773 18523 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:40.899914 15509 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:40.900856 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 106066us
I20260709 13:05:40.891145 15518 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:40.905857 15515 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:40.906356 15515 pending_rounds.cc:85] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 2
I20260709 13:05:40.909785 15515 pending_rounds.cc:107] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:40.910171 15515 raft_consensus.cc:2889] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:40.915448 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.865576 15341 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 3 to 6, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 6 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.920846 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:40.921746 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:40.922698 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.926378 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:40.923656 15510 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:40.910676 18532 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.930083 15439 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:40.953835 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 60713.6us
I20260709 13:05:40.953699 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:40.955096 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:40.957387 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:40.958447 18375 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:40.959924 18556 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:40.960666 18556 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.961122 18556 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.965021 15585 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:40.966986 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 64720.7us
I20260709 13:05:40.970880 18372 tablet_bootstrap.cc:492] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:05:40.972478 18372 ts_tablet_manager.cc:1403] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 2.449s	user 0.064s	sys 0.022s
I20260709 13:05:40.949627 15517 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:40.975282 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:40.980942 15442 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
W20260709 13:05:40.987012 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.950085 18411 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:40.988854 15512 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:40.999482 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.997619 15510 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:41.003371 15517 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:41.004099 15513 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:41.006647 18392 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:05:41.013274 15341 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 5 to 9, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 9 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.016028 15341 catalog_manager.cc:5697] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.993733 18480 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:41.020952 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 116758us
I20260709 13:05:41.035351 15512 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:41.042799 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:41.021806 18491 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.001816 18515 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.143s
I20260709 13:05:41.061734 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:41.062644 15590 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:41.054487 18595 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:41.065716 15406 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.073877 15509 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:41.075623 18361 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:41.075640 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 86659.1us
I20260709 13:05:41.069451 18372 raft_consensus.cc:359] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:41.067932 18480 consensus_queue.cc:1059] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:05:41.078148 18372 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:05:41.079372 15592 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:41.079123 18372 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:41.086599 18554 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.071920 18393 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.089254 18523 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:41.093878 18553 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:41.094542 18553 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:41.095046 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47171.5us
I20260709 13:05:41.096213 18553 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:41.098078 18595 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:41.107400 18515 consensus_queue.cc:1243] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:41.107801 18595 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.110080 18515 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:41.107409 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.147425 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48850.6us
I20260709 13:05:41.130908 18523 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:05:41.149921 18523 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:41.150403 18523 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:41.152967 18372 ts_tablet_manager.cc:1434] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.180s	user 0.007s	sys 0.004s
I20260709 13:05:41.155953 18556 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.112064 18402 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:05:41.110585 18515 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:41.162621 18592 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:41.163173 18592 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:41.130291 17875 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:05:41.163254 18515 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.164391 18592 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.165637 18515 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:41.165971 18592 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:41.114159 18569 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.170280 18569 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:41.172487 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.173877 18569 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.173940 18393 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:41.174743 18393 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:41.176477 18393 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.178423 18393 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:41.132849 18491 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:41.180850 18491 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.182122 18375 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.182762 18375 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.187391 18361 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:41.186820 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 96740.3us
I20260709 13:05:41.198716 18361 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.185613 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:41.200322 18554 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.201545 18361 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:41.201296 18554 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.203127 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:41.204360 18375 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:41.204851 18554 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.187391 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:41.208365 15518 raft_consensus.cc:2410] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:41.207826 18523 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.205534 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:41.211112 15590 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.212558 15556 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:41.214401 18540 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:41.215313 18540 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:41.217032 18540 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.214218 18595 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.189718 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:41.183483 18491 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.222173 18556 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:41.232025 18523 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:41.255383 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 123620us
W20260709 13:05:41.254659 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.257691 18375 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.266064 18375 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:41.276151 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 316747us
I20260709 13:05:41.277451 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:41.278986 18375 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:41.280264 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 146313us
I20260709 13:05:41.226938 18575 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.259364 18592 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:41.289306 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.282648 18375 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:41.297010 18547 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:41.297636 18547 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:41.302695 18600 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:05:41.304177 18600 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:41.305840 18392 raft_consensus.cc:993] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:41.313784 18592 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.316707 18592 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.294730 18491 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:05:41.318410 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:41.319046 18491 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:41.319298 15512 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:05:41.319516 18491 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:41.321223 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.323028 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:41.320655 18491 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:41.328613 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.329384 15590 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:05:41.304682 18600 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:41.339514 16146 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:41.340148 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62864.5us
I20260709 13:05:41.327618 17875 raft_consensus.cc:1081] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:41.329156 18592 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:41.353914 18491 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:41.355810 18590 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:05:41.365231 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.366791 15435 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:41.370549 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.370364 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.372903 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.374328 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.374794 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.375727 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.376824 15440 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:41.377801 18475 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:41.378293 18475 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:41.378724 18475 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.379863 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:41.380833 18375 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:41.381677 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:41.299136 18547 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.383252 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:41.357548 18556 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:41.396008 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.395757 15439 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:41.357424 18592 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.400561 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:41.398528 15434 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:41.402845 15441 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:41.403481 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:41.404197 15512 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:41.396037 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 90753.4us
I20260709 13:05:41.384378 18575 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.410920 18511 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:41.418977 18556 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:41.357924 18553 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.403206 18592 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.432065 18540 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:41.433137 18540 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.432090 18556 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.433488 16178 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:05:41.433902 16178 pending_rounds.cc:85] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Aborting all ops after (but not including) 7
I20260709 13:05:41.434281 16178 pending_rounds.cc:107] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:05:41.433815 18540 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.434525 16178 raft_consensus.cc:2889] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:41.429157 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.435696 18375 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:41.436071 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.436473 18540 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.438309 18601 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:41.365360 18411 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:05:41.439767 17875 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:41.439898 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:41.436267 18375 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.456282 18595 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:41.419661 18339 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.427060 18547 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:41.468779 15438 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:41.469763 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.442795 18375 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:41.429064 18569 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:41.470849 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 73451.7us
I20260709 13:05:41.475106 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:41.446062 18511 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:41.396718 18600 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.477910 15556 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:41.484403 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.490387 18589 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:41.491063 18589 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:41.491472 18589 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:41.460947 18554 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:05:41.503619 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66270.9us
W20260709 13:05:41.506578 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 85343.9us
I20260709 13:05:41.493150 18540 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:41.472534 18392 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:05:41.509518 17875 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:41.521807 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:41.503194 18601 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:41.498674 18554 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:41.477631 18590 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:05:41.515786 18605 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.097s	user 0.000s	sys 0.002s
I20260709 13:05:41.497004 18339 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.539952 15512 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:41.539587 18554 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.541180 18554 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.542749 18480 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:41.506120 18569 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.544132 18511 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.545795 18569 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.547334 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:41.513182 18540 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:41.514768 18553 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:41.550555 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.551932 18599 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.552670 18599 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.553453 15517 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:05:41.553666 18596 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:41.554097 18596 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:41.550307 18540 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:41.554509 18596 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:41.549130 18600 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:41.563010 18339 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:41.565990 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.565990 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:41.572486 18532 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:41.573108 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.574306 18402 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:41.574905 18402 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:41.576969 18590 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:41.577760 18590 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.585136 18575 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:41.585749 18575 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.586153 18575 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.555353 18599 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:41.601332 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:41.605307 18601 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:41.612661 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.613801 15482 leader_election.cc:400] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:41.614181 15482 leader_election.cc:403] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:05:41.614264 18592 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.615203 18594 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:41.616609 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.617646 18361 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:41.649420 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.597450 18595 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:05:41.664927 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.627051 17875 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:41.666765 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 65611.8us
I20260709 13:05:41.668880 18599 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:41.669754 18599 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:41.670351 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:41.657456 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.661986 18402 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.661955 18475 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.664645 18375 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.670784 18599 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.653453 18589 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.581790 18523 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:05:41.684319 18611 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:41.685431 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.598352 18553 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
W20260709 13:05:41.695243 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 198829us
W20260709 13:05:41.700583 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 51042.3us
I20260709 13:05:41.695186 18361 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:41.696836 18595 raft_consensus.cc:2764] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:41.709268 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.716105 18523 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:41.717494 18392 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:41.717998 18475 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.718061 18411 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:41.722494 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:41.724305 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.729391 18600 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:41.732473 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:41.733604 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.747561 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 93110.7us
I20260709 13:05:41.757792 18540 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.758726 18575 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:41.725747 18523 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:41.738466 18532 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:41.734927 18392 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:41.741034 18411 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:41.778632 18612 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:41.779353 18612 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.768883 18392 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:41.781735 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.786850 18612 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:41.792409 18411 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.797683 18411 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.803906 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:41.806277 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:41.807217 15512 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.793416 18547 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:41.808588 18547 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.809108 18547 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.806203 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:41.812652 18610 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:41.812934 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:41.813995 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:41.814891 15590 raft_consensus.cc:2368] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:41.814813 18610 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:41.815161 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:41.816277 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:41.806517 18618 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.816172 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:41.828176 15584 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:41.823339 15512 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:05:41.830917 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:41.837988 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:41.856530 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:41.780283 18592 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:41.869648 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.870844 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:41.878230 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 63191us
I20260709 13:05:41.870548 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:41.883198 15592 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:41.883735 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:41.960400 15583 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:41.960059 15440 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:05:42.015345 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 85804.2us
I20260709 13:05:42.056540 15512 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:42.057219 15512 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:41.989620 15436 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:41.872103 18611 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:42.058264 15512 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:42.065541 15512 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:41.930361 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 207928us
W20260709 13:05:42.068199 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.884604 18375 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.021546 18593 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:42.019802 18540 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:41.892534 18590 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:42.065070 18611 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.045475 18589 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:42.098234 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:42.094521 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:42.088595 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.097527 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.877965 18596 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.088518 18595 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.115367 18628 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:05:42.116734 18622 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:05:42.117478 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:42.104007 18611 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:41.877264 18618 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:41.930194 18523 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.138500 15512 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:05:42.151520 15512 pending_rounds.cc:85] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:05:42.097527 18475 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:05:42.152119 15512 pending_rounds.cc:107] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:05:42.127476 18610 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:42.125823 18589 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:41.892850 18361 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:42.155864 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:42.157780 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 308761us
I20260709 13:05:42.162246 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.155826 15512 raft_consensus.cc:2889] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:42.164793 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.176466 15585 raft_consensus.cc:2410] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:42.166709 18610 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.180591 18610 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:42.180102 15590 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:42.164193 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.164386 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.163479 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.182252 15586 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:05:42.185063 18594 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.003s
I20260709 13:05:42.185329 15589 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:42.185621 18594 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:42.186759 15591 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:42.188390 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:42.181528 15587 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:42.189566 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.125651 18595 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:42.195741 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.188445 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 105002us
I20260709 13:05:42.193862 15590 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:42.193957 18589 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:42.209570 18589 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.212378 18547 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:42.213912 18604 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:42.214600 18604 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:42.215746 18604 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:42.225558 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.224167 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:42.244843 18610 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.249198 18618 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.251096 18596 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.258687 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.263759 15590 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:42.301949 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.220000 18523 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:42.302978 15585 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
W20260709 13:05:42.310252 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.194125 18600 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:05:42.257004 18610 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.220808 18402 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:05:42.301316 18547 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:42.317124 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:42.316346 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 94752us
W20260709 13:05:42.323999 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.325237 15590 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:42.219983 18612 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.303776 18593 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:42.332355 15406 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:42.332656 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 110235us
I20260709 13:05:42.254932 18601 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:05:42.344874 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.368863 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:42.369831 15590 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:42.370990 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56740.6us
W20260709 13:05:42.488972 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.421264 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.505755 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.469663 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:42.314703 18540 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.511902 15584 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:42.403824 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.435091 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.389312 15443 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:42.460716 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.379329 15438 raft_consensus.cc:2368] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
W20260709 13:05:42.455744 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.514796 15440 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:05:42.421140 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.445145 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:42.458271 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:42.516952 15587 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:42.519248 15590 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:05:42.516567 15585 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:42.468880 15435 raft_consensus.cc:1217] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.7->[6.8-6.8]   Dedup: 6.8->[]
I20260709 13:05:42.522347 15435 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:05:42.522682 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.460777 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:42.452101 18392 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.005s
W20260709 13:05:42.375748 18635 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:05:42.528144 18612 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.457537 15452 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-5b97fcd3d908482fadc6fa54e513304d received from {username='slave'} at 127.0.0.1:47420
I20260709 13:05:42.545912 18611 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.548008 15452 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-5b97fcd3d908482fadc6fa54e513304d on tablet 5b97fcd3d908482fadc6fa54e513304d with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:42.546566 18392 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.524570 18540 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.550009 18611 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.550215 15439 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:42.457913 18636 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.374830 18596 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.544430 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.502919 18595 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.521667 18590 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.551201 15453 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-1915fdd81d344a749443e48f07a1fef8 received from {username='slave'} at 127.0.0.1:47420
I20260709 13:05:42.640302 18599 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:42.640607 15453 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-1915fdd81d344a749443e48f07a1fef8 on tablet 1915fdd81d344a749443e48f07a1fef8 with peer 6ff41728dec842afad5b53c20446a5a0
W20260709 13:05:42.642625 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 318724us
W20260709 13:05:42.639514 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 178899us
W20260709 13:05:42.642518 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79535.5us
I20260709 13:05:42.542616 18601 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:42.542869 18475 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.647802 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 309246us
I20260709 13:05:42.648550 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:42.654330 15482 connection.cc:256] RPC call timeout handler was delayed by -3.1421725310000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:05:42.651027 18540 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:42.662056 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.417114 18593 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:42.642716 18596 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:42.672479 15482 connection.cc:256] RPC call timeout handler was delayed by -2.9117725309999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
I20260709 13:05:42.660807 18392 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.659098 18601 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:42.678450 18601 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.676280 18540 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.682742 18540 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.673398 18532 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:42.684227 18532 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.685375 18540 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:42.686384 18532 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.661310 18475 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:42.656528 18590 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:42.690965 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.615257 18636 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.692312 18594 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:42.698107 15587 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:42.699720 18475 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:42.702028 18636 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:42.703722 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.705116 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0891235349999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:05:42.704239 18594 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:42.707692 18590 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:42.708818 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9377416330000869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 13:05:42.709262 15512 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:42.709307 15482 connection.cc:256] RPC call timeout handler was delayed by -1.7271713970001201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 13:05:42.736701 15514 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:42.738582 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:42.711405 18361 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.740533 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:42.740891 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 65332.6us
I20260709 13:05:42.742038 15518 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:42.749718 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:42.750905 15509 raft_consensus.cc:2368] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9.
W20260709 13:05:42.762764 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.777067 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:42.782855 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:42.778082 15517 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:42.792572 15509 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:42.794957 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:42.795377 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:42.795631 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:42.796134 15509 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:42.798623 15443 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 12. Ops: [10.7-10.7]
I20260709 13:05:42.800772 15510 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:42.804797 18645 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:05:42.805938 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:42.806644 15513 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:42.806766 18646 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:05:42.808640 18647 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:42.809810 18392 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:42.813165 15513 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:42.816177 18594 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.817229 18596 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.820513 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:42.822558 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:42.823658 15514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:05:42.824517 15514 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.824980 15514 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.827767 18640 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:42.828284 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:42.829173 15513 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:42.836061 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.836303 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.837476 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:42.836915 15436 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:05:42.838129 16179 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:42.838157 16176 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:42.839681 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:42.841295 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:42.842147 15510 raft_consensus.cc:2393] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:42.843055 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:42.844524 18523 consensus_meta.cc:287] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.004s
I20260709 13:05:42.775589 18361 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.801383 18590 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.848789 18590 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.850513 15512 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:05:42.851881 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.852293 15510 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:42.828301 18640 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:42.861192 18640 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:42.862357 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:42.856166 18636 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.864331 18636 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:42.854038 18475 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:42.866946 18475 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:42.869092 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:42.875241 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54803.3us
I20260709 13:05:42.876083 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:42.831627 18593 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.876976 15514 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:42.882539 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.882812 18612 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:42.884862 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:42.869431 18475 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:42.888351 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:42.889308 15513 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:42.890195 15434 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:42.890588 15434 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:42.893054 15510 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:42.941183 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.012655 15514 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:42.866977 18636 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:43.015873 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 139875us
I20260709 13:05:42.874894 18523 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:43.019210 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.019973 15514 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:43.023844 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.024370 15591 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:43.024675 15510 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:05:43.025849 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:42.877336 18361 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:43.030725 15514 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:43.014959 15434 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.032791 15434 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.034008 15436 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:43.030532 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.037575 15583 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:43.038390 15592 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:43.052161 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:43.052253 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.052223 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.058204 15435 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:43.059501 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:43.062229 15589 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:43.065531 16179 raft_consensus.cc:1217] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:05:43.068228 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:43.068254 15513 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:43.068960 15587 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:43.070390 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.073915 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.074337 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.074525 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.080192 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:43.081043 15440 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:43.084064 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.075160 15513 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:43.086061 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.071923 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:43.073742 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.088065 15592 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:43.087823 18642 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.087966 16178 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:43.017761 18593 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.091745 15518 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:43.093673 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.092989 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.104862 16174 raft_consensus.cc:2368] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9.
I20260709 13:05:43.106379 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:43.107139 15443 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:43.107476 15443 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:43.108217 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:43.111442 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.108316 15443 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:43.114462 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.114735 16176 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:43.112165 15441 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:43.115566 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:43.117666 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.116541 18411 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:05:43.120144 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.121549 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.121781 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:43.123131 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.126951 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.128145 16174 raft_consensus.cc:2410] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:05:43.123818 15437 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:05:43.137277 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:43.138868 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.140393 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.141422 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.142525 18575 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:43.144018 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:43.159353 15440 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
W20260709 13:05:43.146693 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:43.149839 18638 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.510s	user 0.000s	sys 0.012s
I20260709 13:05:43.151655 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.152869 18593 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:43.089059 18642 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:43.158720 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:43.144309 15434 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:05:43.159823 15442 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:43.163249 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.211613 15434 pending_rounds.cc:85] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 6
I20260709 13:05:43.212108 15434 pending_rounds.cc:107] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:05:43.184644 18361 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:43.192881 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:43.194171 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76440.8us
I20260709 13:05:43.194890 18547 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.196045 18411 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:43.196633 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.198081 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.216025 15514 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:43.215869 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 58571.8us
I20260709 13:05:43.131266 18640 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.199043 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.199894 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.217437 15511 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:43.124154 18553 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:43.200866 15443 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:43.201258 18652 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:05:43.202514 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.224354 15518 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:43.203624 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.224746 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.226576 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:43.212445 15434 raft_consensus.cc:2889] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.217711 15437 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:43.221452 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:43.223403 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:43.208859 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.229245 15514 raft_consensus.cc:2368] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:05:43.121255 18392 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:05:43.230377 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.232192 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.234090 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.235201 15514 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:43.237412 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:43.216897 18411 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.229136 18547 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:43.249212 15443 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:43.265473 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.256376 15592 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:43.266408 15518 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:43.219856 18593 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:43.244555 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.278230 15514 raft_consensus.cc:2368] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:43.279636 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.281366 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.282835 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.286728 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:43.287143 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.287484 15518 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:43.287896 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.290321 18339 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:43.290591 18540 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.290958 18339 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:43.291671 18653 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:05:43.291222 18540 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.294615 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.295466 15509 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:43.297574 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.298617 15515 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
W20260709 13:05:43.304064 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.275861 15407 leader_election.cc:400] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9.
I20260709 13:05:43.223166 18553 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:43.258671 15556 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:43.300876 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.299814 18540 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:43.246173 18411 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:43.299937 18604 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.219364 18361 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.305097 15407 leader_election.cc:403] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:43.338436 15514 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:43.412220 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.316566 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:43.284466 18610 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:43.288674 18392 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:43.307531 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49008.4us
I20260709 13:05:43.312166 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1851) took 1218 ms. Trace:
I20260709 13:05:43.436308 15439 rpcz_store.cc:276] 0709 13:05:42.093413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.093543 (+   130us) service_pool.cc:224] Handling call
0709 13:05:42.106250 (+ 12707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.550663 (+444413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.311904 (+761241us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000a4e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:43.312099 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020455168}
I20260709 13:05:43.316996 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:43.316113 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:43.434393 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 69644us
I20260709 13:05:43.408993 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.401607 15518 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:05:43.380573 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1845) took 1577 ms. Trace:
I20260709 13:05:43.440337 15438 rpcz_store.cc:276] 0709 13:05:41.803428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.803629 (+   201us) service_pool.cc:224] Handling call
0709 13:05:43.380221 (+1576592us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54002d1254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:43.380467 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320741248}
I20260709 13:05:43.434618 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.435305 15511 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:05:43.440568 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.454510 15518 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:43.308823 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.455790 15509 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:05:43.455997 15590 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:43.328984 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.458087 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.458990 15511 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:43.442303 15515 raft_consensus.cc:2393] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 4: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:43.437592 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:43.446301 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 183069us
W20260709 13:05:43.322521 18654 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:43.390484 18575 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:43.460206 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:43.473176 15586 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.457108 15516 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:43.305099 18339 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:43.463375 15590 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:43.467855 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.480015 15509 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:43.481539 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.482288 15509 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:43.483421 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.439838 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:43.310670 18640 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:43.331050 18361 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:43.322713 18590 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:43.471767 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:43.305732 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 90628.5us
I20260709 13:05:43.499853 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.474948 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.500496 18361 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:43.500746 15516 raft_consensus.cc:2368] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:43.500976 18361 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.501287 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.501754 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.502130 15514 raft_consensus.cc:2368] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:05:43.502761 15516 raft_consensus.cc:2410] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:43.500806 15406 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:43.502987 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.307111 18553 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:43.504103 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:43.505007 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:43.505079 18640 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:43.505919 18601 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:43.307739 18475 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:43.476549 15587 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:43.306839 18547 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:43.500036 15585 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:43.501411 18361 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:43.507421 15514 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:43.491601 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.492432 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.507597 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.507869 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:43.435802 18610 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:43.510859 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:43.521356 15515 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
W20260709 13:05:43.523132 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 59645.4us
I20260709 13:05:43.525830 15517 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:43.316279 18604 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:43.523324 15514 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:43.532651 15510 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:43.533860 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:43.535584 15518 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:43.536409 15511 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:43.536653 15509 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:43.540627 15517 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:43.542327 15515 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:43.520545 18392 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:43.471109 18515 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:05:43.553378 16176 raft_consensus.cc:1217] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:05:43.543862 15509 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:43.545387 15512 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:05:43.510941 18601 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.550164 15516 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:43.321681 18642 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:43.526728 18610 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:43.560369 15585 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:43.560910 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 148172us
I20260709 13:05:43.560719 15510 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:43.562201 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.564046 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:43.564980 15515 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:43.537972 18475 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:43.541380 18547 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:43.582463 15443 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:05:43.588929 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 149171us
I20260709 13:05:43.584421 15434 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:43.586514 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.589785 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:43.590358 15438 raft_consensus.cc:2376] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9. Re-sending same reply.
I20260709 13:05:43.558256 18601 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:43.622606 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.623499 15441 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:43.632695 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.634457 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.635128 15442 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:05:43.635699 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 323) took 1175 ms. Trace:
I20260709 13:05:43.635972 15515 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:43.630175 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:43.728384 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:43.635991 15442 rpcz_store.cc:276] 0709 13:05:42.460035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.534565 (+ 74530us) service_pool.cc:224] Handling call
0709 13:05:43.143900 (+609335us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5800003698. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32eee 0000000000375939 00007fcf80ca61e0 00007fcf80d6f0c4 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:05:43.635638 (+491738us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4942976}
W20260709 13:05:43.707634 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 81090.7us
I20260709 13:05:43.742139 18658 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:43.711318 15585 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:43.744988 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:43.745486 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.727903 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:43.643224 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.746717 15584 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:43.747959 15555 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.552s (SENT)
I20260709 13:05:43.666185 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:43.663744 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 74044.3us
I20260709 13:05:43.750659 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:43.695180 15443 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:43.581746 18590 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:43.717294 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.748454 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:43.766404 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:43.770673 15435 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.001s
I20260709 13:05:43.771430 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:43.771803 15435 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
W20260709 13:05:43.723052 18655 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:05:43.775388 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.776856 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:43.780165 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 206672us
I20260709 13:05:43.606020 18547 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:43.667047 18569 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:43.641270 18624 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9.
W20260709 13:05:43.801184 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.767640 18392 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:43.762430 18590 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.802506 18491 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.759727 18640 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:43.809865 16146 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:43.810832 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.809549 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:43.786840 18554 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:43.824379 18540 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:43.825042 18494 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.825785 18666 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:43.795187 18339 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:43.695225 18657 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.171s
I20260709 13:05:43.768666 18609 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:05:43.829869 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 81948.3us
I20260709 13:05:43.861974 15592 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:05:43.822386 18491 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.818109 18515 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:05:43.839506 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:43.818876 18590 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:43.846151 15586 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:43.743808 18475 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:43.862494 15592 pending_rounds.cc:85] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 5
I20260709 13:05:43.873536 15592 pending_rounds.cc:107] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:05:43.839860 18604 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:43.868762 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.873845 15592 raft_consensus.cc:2889] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.865804 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:43.886773 15583 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:43.849752 18659 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:43.888216 18659 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:43.889406 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.889478 18659 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.939327 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:43.941900 16179 raft_consensus.cc:2368] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4.
I20260709 13:05:43.943114 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.944128 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.944883 15441 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:05:43.868510 18411 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.001s
W20260709 13:05:43.948679 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 74147us
I20260709 13:05:43.951136 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:43.954620 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.955514 15440 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:05:43.958117 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:43.958890 15443 raft_consensus.cc:3055] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:43.959321 15443 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:43.960847 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.953680 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:43.946116 15436 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:43.968906 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:43.938787 18667 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:05:43.950496 18392 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:43.939687 18339 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:05:43.872912 18642 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:05:43.975811 18547 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:43.864727 18554 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.977326 18523 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:43.977952 18523 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:43.979475 18554 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:43.980146 18554 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:43.980476 18554 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:43.981444 18554 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:43.864892 18540 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.971395 18361 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:43.984669 18540 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:43.937129 18593 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:05:43.986722 15514 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:43.978842 18523 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:43.954351 18411 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:43.993314 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43740.3us
I20260709 13:05:43.778525 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.010890 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:44.011677 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:44.011405 15585 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:43.940419 18604 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:44.014340 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 215237us
I20260709 13:05:44.033293 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:44.035915 15556 leader_election.cc:400] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:05:44.036412 15556 leader_election.cc:403] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:05:44.048983 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:43.960511 15443 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:44.055680 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.058780 15443 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.977445 18553 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:44.061456 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 162637us
I20260709 13:05:44.097222 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.054872 18523 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.114966 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2129) took 1292 ms. Trace:
W20260709 13:05:44.112121 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 48163.1us
I20260709 13:05:44.118942 15514 rpcz_store.cc:276] 0709 13:05:42.822174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.529571 (+707397us) service_pool.cc:224] Handling call
0709 13:05:43.529896 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.987101 (+457205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.114493 (+127392us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54002a1554. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:44.114857 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049990528}
W20260709 13:05:44.119683 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.119788 15556 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:44.122432 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:44.057413 18661 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:44.056406 18547 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:44.125025 15590 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:44.125370 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:44.126837 16178 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:44.133711 15443 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:44.134810 18642 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:44.138757 15437 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:44.140041 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.140861 15585 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:05:44.141987 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.140753 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:44.041769 18604 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:44.154882 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:44.111048 18361 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:44.173498 18553 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:44.174876 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 555) took 1027 ms. Trace:
I20260709 13:05:44.192900 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:44.194687 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:44.178624 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:44.180241 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45428.1us
I20260709 13:05:44.197386 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:44.181628 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:44.182183 18393 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:44.185463 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.205468 15591 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:44.062922 18666 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:05:44.216362 18491 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:44.216962 18663 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:44.217628 18666 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:44.218075 18666 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:44.218549 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.196353 15592 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:05:44.192238 15511 rpcz_store.cc:276] 0709 13:05:43.147020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.539892 (+392872us) service_pool.cc:224] Handling call
0709 13:05:43.558312 (+ 18420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.558698 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.558737 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.560264 (+  1527us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.881067 (+320803us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:43.881112 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.881193 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.174610 (+293417us) raft_consensus.cc:1685] finished
0709 13:05:44.174635 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.174801 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":169493,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":320413,"threads_started":1,"wal-append.queue_time_us":488324}
W20260709 13:05:44.203686 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.221436 18660 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:44.222057 18660 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:44.224159 15515 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:44.203967 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.225013 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:44.225740 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.206665 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:44.207438 18612 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:44.207588 18553 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:44.215453 15585 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:44.217005 18491 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:44.242784 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:44.243911 18554 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.244587 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:44.245226 15515 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:44.246479 18610 consensus_meta.cc:287] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.003s
I20260709 13:05:44.247023 18610 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:44.231896 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:44.233328 15517 raft_consensus.cc:2410] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:44.234120 15584 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:44.237146 15514 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:44.127218 18589 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:05:44.056664 18640 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:44.198316 15590 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.145985 18673 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:44.252597 15512 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:44.261862 15513 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:05:44.261302 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.270035 15509 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:44.270606 15584 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:44.273696 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:44.225082 18547 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:44.279146 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:44.280541 15590 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:05:44.235561 17875 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:44.218941 18666 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:44.254238 18601 consensus_meta.cc:287] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.002s
W20260709 13:05:44.283968 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 67162.8us
I20260709 13:05:44.288702 15443 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:44.290968 18590 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:44.291684 15584 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:44.292266 18666 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:44.296237 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:44.296561 15518 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
W20260709 13:05:44.301676 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 104360us
I20260709 13:05:44.301913 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:44.308960 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:44.306867 15511 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:44.310974 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.261161 18648 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:05:44.271924 18673 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.252869 18612 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:44.298730 18411 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:44.324745 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:44.307651 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:44.302598 15515 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:44.302755 18667 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:05:44.311436 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.327696 15587 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 6: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:05:44.384559 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 69521.5us
W20260709 13:05:44.401693 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.306375 18361 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:44.393143 16178 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
W20260709 13:05:44.408533 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 143126us
W20260709 13:05:44.398509 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 90983.4us
I20260709 13:05:44.396531 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:44.304723 18601 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:44.325892 18673 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:44.413292 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:44.421123 15511 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:44.416460 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 109591us
I20260709 13:05:44.421497 16178 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:44.426725 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:44.428318 15617 heartbeater.cc:646] Failed to heartbeat to 127.13.245.126:46019 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.245.126:46019 timed out after 15.000s (SENT)
I20260709 13:05:44.434259 18674 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:44.435992 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.404484 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:44.318897 18624 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
W20260709 13:05:44.444868 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.459889 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.422479 18667 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:44.420166 18491 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:44.477288 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.478272 15584 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:44.445581 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:44.422739 18411 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:44.416560 18361 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:44.472606 18680 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:05:44.473815 18676 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:05:44.461735 18393 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:44.437387 18660 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:44.479363 18491 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.482604 18411 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.463512 18691 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:44.495296 17875 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:44.476147 18547 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:05:44.557104 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:44.537509 18491 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.461556 18612 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:44.538853 18411 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.535240 18393 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:44.577757 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 83401.9us
I20260709 13:05:44.580684 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:44.551044 18604 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:44.473210 18690 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:05:44.469309 18692 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:05:44.620169 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:44.622139 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:44.635751 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.646847 18691 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:44.647580 18691 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.648021 18691 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:44.653685 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:44.610183 18393 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.654495 15443 raft_consensus.cc:2376] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9. Re-sending same reply.
I20260709 13:05:44.660575 15434 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:44.618865 18660 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:44.617996 18590 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:44.692456 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 269015us
W20260709 13:05:44.704711 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 82793.3us
W20260709 13:05:44.693723 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 136710us
W20260709 13:05:44.695634 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 250171us
I20260709 13:05:44.723959 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:44.687127 18697 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:44.730262 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:44.730872 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.730571 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:44.693665 18612 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:05:44.722808 18601 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:44.617548 18667 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:44.748118 18589 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:44.828613 18589 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.829053 18589 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:44.830749 18693 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:05:44.831974 18698 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:05:44.778671 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:44.782791 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51310 (request call id 407) took 1020 ms. Trace:
I20260709 13:05:44.783317 15583 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:44.835654 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 105227us
W20260709 13:05:44.835222 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 62598.9us
W20260709 13:05:44.777987 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:44.754073 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52015.1us
I20260709 13:05:44.838759 15434 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:44.836640 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:44.835210 15587 rpcz_store.cc:276] 0709 13:05:43.762885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.839120 (+ 76235us) service_pool.cc:224] Handling call
0709 13:05:44.782456 (+943336us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540015f4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:44.782701 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049559424}
W20260709 13:05:44.825342 18523 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.002s
I20260709 13:05:44.779234 18704 raft_consensus.cc:1064] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
W20260709 13:05:44.849136 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 89875.6us
I20260709 13:05:44.853967 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:44.747252 18700 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:05:44.840627 18554 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.005s
I20260709 13:05:44.747629 18690 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:44.822988 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:44.859724 18540 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:44.729465 17875 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:44.866010 18411 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:44.899005 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:44.869114 18666 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.010s
I20260709 13:05:44.847195 18663 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:05:44.871093 18685 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.555s	user 0.002s	sys 0.000s
W20260709 13:05:44.873128 18682 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
I20260709 13:05:44.873569 15555 leader_election.cc:400] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:44.875593 18700 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:44.879148 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:44.780905 18674 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:44.774896 18707 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:44.913429 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:44.813001 18361 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:44.849932 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 166463us
I20260709 13:05:44.942831 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:44.738890 18660 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
W20260709 13:05:44.933349 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80608.5us
I20260709 13:05:44.847741 18640 consensus_queue.cc:1059] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:05:44.950183 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:44.944911 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:05:44.933722 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49910us
W20260709 13:05:44.944205 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65861.1us
W20260709 13:05:44.954460 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.956329 15555 leader_election.cc:400] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:05:44.957481 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:44.912324 18540 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:44.961997 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:44.962888 15589 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:44.778497 18712 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.161s
I20260709 13:05:44.970971 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:44.744537 18697 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:44.940513 18666 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:44.950202 18692 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:44.943866 18683 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.982590 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:44.991882 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:44.943779 18339 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:05:44.992686 15588 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:44.972030 18540 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:45.012286 18515 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:44.976269 18361 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:45.010679 15515 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:45.015892 18708 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:45.013608 18695 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:44.987102 15406 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:45.032135 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45127us
I20260709 13:05:45.014322 18718 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:05:45.023867 18411 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:45.041152 18673 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.001s
I20260709 13:05:45.041023 18691 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.041692 18673 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.042806 15591 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:45.039335 18704 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:44.975461 18690 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:45.015699 18714 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:44.978277 18666 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:44.985774 18692 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.080685 18692 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:45.083679 18687 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:45.047958 18667 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:45.084236 18687 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:44.992722 18640 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:05:45.085162 18687 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.048754 15586 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:45.032987 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:44.992583 18523 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.062144 16178 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:45.063985 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:45.085631 18610 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:45.065114 18697 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:45.047776 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1853) took 1464 ms. Trace:
W20260709 13:05:45.087127 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62134.4us
I20260709 13:05:45.061583 15588 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:45.101052 18707 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:45.095265 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:45.105302 15589 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.026664 18708 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.985456 18663 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
W20260709 13:05:45.102734 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69847.7us
I20260709 13:05:45.094942 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:45.031358 18695 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:45.107636 18554 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:45.043534 18339 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:45.097848 15439 rpcz_store.cc:276] 0709 13:05:43.583089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.583273 (+   184us) service_pool.cc:224] Handling call
0709 13:05:43.629812 (+ 46539us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:43.755259 (+125447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.755291 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:43.802677 (+ 47386us) log.cc:844] Serialized 52 byte log entry
0709 13:05:44.302577 (+499900us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:44.302622 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.302690 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.870418 (+567728us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:45.031339 (+160921us) raft_consensus.cc:1685] finished
0709 13:05:45.031362 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.047683 (+ 16321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":748,"raft.queue_time_us":150406,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":144,"spinlock_wait_cycles":32447744,"thread_start_us":584223,"threads_started":2,"wal-append.queue_time_us":489195}
I20260709 13:05:45.095393 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:45.055279 18690 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:45.049613 18691 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:45.123978 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:45.124150 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 181378us
I20260709 13:05:45.093911 18523 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:45.096971 18640 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.122821 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:45.053915 18666 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.108189 18689 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:45.128011 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:45.118755 18339 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:05:45.138563 18709 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:05:45.138682 18339 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.140327 18339 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.140827 18729 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:45.125852 18640 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.144487 18666 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:45.132261 18523 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.117859 18687 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.144697 18640 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.049723 18491 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.126966 18697 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:45.112380 18708 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.156198 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:45.126156 18690 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:45.132616 18361 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.184726 15588 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:45.160794 18553 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:45.189445 18697 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:45.190699 18697 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.028118 18700 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.160980 18660 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:45.194020 15592 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:45.121457 18393 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.197832 18553 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:45.206764 18553 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.208397 18696 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:45.209110 18696 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.174882 18729 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:45.192993 18689 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:45.198197 18660 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:45.230473 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 107753us
I20260709 13:05:45.210145 18540 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.208444 18673 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:45.195569 18361 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:45.256824 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.512s (SENT)
I20260709 13:05:45.257469 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.231352 18660 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.270418 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:45.274502 18491 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:45.274353 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:45.277837 18731 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.278443 18540 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:45.279765 18728 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:05:45.281335 18727 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:05:45.282312 18689 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.250509 18648 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:45.192891 18590 consensus_queue.cc:1175] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" responder_term: 7 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:45.263196 18695 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:45.290211 18695 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.293685 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:45.294584 15518 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.296401 18696 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:45.298307 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.301801 15515 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:45.302403 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45645us
W20260709 13:05:45.303800 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 147752us
I20260709 13:05:45.304648 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:45.316663 15555 leader_election.cc:336] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.586s (SENT)
I20260709 13:05:45.317466 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.274899 18393 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:45.260179 18663 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:05:45.250490 18589 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.309237 18491 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.345407 18673 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.266655 18692 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:45.371865 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 55273us
W20260709 13:05:45.378866 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.589s (SENT)
I20260709 13:05:45.376749 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:45.380772 15516 raft_consensus.cc:2410] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:05:45.357431 18726 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:45.402987 15587 raft_consensus.cc:2368] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7.
W20260709 13:05:45.405074 18734 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:05:45.410234 18740 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:45.368448 18729 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.415205 18683 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.433667 15518 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:45.425153 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46334.2us
W20260709 13:05:45.441511 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.669s (SENT)
I20260709 13:05:45.442139 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.448802 18746 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:45.449716 18746 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:45.454964 15589 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:45.450938 18746 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.454092 18740 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:45.422452 18708 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.423513 18361 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:45.425109 15510 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:45.464655 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 160087us
W20260709 13:05:45.465248 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.571s (SENT)
I20260709 13:05:45.470901 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.371457 18523 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.465751 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.477056 18718 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.462534 18740 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.477641 18718 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.479979 18718 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:45.475010 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:45.483459 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.579s (SENT)
I20260709 13:05:45.491444 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2116) took 1006 ms. Trace:
I20260709 13:05:45.486966 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.492141 15586 rpcz_store.cc:276] 0709 13:05:44.485434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.703268 (+217834us) service_pool.cc:224] Handling call
0709 13:05:44.703688 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.088096 (+384408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.491132 (+403036us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400247cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:45.491359 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792898304}
W20260709 13:05:45.497357 15555 leader_election.cc:336] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.763s (SENT)
I20260709 13:05:45.498119 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.499590 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2103) took 1754 ms. Trace:
I20260709 13:05:45.500509 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1754) took 1501 ms. Trace:
I20260709 13:05:45.470782 18673 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:45.500082 15583 rpcz_store.cc:276] 0709 13:05:43.735269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.916450 (+181181us) service_pool.cc:224] Handling call
0709 13:05:44.783029 (+866579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.844371 (+ 61342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.489316 (+644945us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540015f4d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:45.489428 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991673088}
I20260709 13:05:45.471508 18661 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.501065 15591 rpcz_store.cc:276] 0709 13:05:43.988787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.269861 (+281074us) service_pool.cc:224] Handling call
0709 13:05:44.296284 (+ 26423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.043242 (+746958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.489569 (+446327us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54001f4854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:45.489730 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716367232}
I20260709 13:05:45.484197 18491 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:45.499805 18393 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:45.558543 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61256.5us
I20260709 13:05:45.434746 18726 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.561544 18540 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:45.560585 18690 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.578261 18726 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:45.496148 18361 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:05:45.580067 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.657s (SENT)
I20260709 13:05:45.580530 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.581490 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:45.516875 18553 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:45.633874 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 53852.1us
W20260709 13:05:45.645613 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.658s (SENT)
W20260709 13:05:45.646606 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:45.647477 15555 leader_election.cc:336] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.842s (SENT)
I20260709 13:05:45.647958 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.622278 18540 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.556792 18661 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.653538 18753 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:05:45.604606 18689 raft_consensus.cc:3055] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:45.603720 18749 raft_consensus.cc:2764] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:05:45.678646 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.678687 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:45.682328 16176 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:45.702919 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.740911 15510 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:45.668416 18589 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:45.651026 18642 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:45.651398 18692 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:45.678519 18339 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.538s	user 0.015s	sys 0.000s
I20260709 13:05:45.679042 18475 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:45.709429 18691 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:45.783404 18475 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:45.659349 18752 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:45.680423 18689 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:45.679455 18726 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:45.784443 18755 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:45.785012 18752 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.785301 18755 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.785008 18642 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.788005 18726 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:45.789886 18755 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:45.784529 18475 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.739270 18553 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.791558 18475 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.791797 18553 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.794114 18726 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:45.791558 18689 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:45.787431 18758 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:05:45.790066 18708 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:45.780367 18690 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:45.811910 18640 consensus_meta.cc:287] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.003s
W20260709 13:05:45.865789 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 260135us
W20260709 13:05:45.865418 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 217953us
W20260709 13:05:45.869542 15555 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.863s (SENT)
I20260709 13:05:45.795921 18752 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:45.890883 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:45.870384 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 383891us
I20260709 13:05:45.790124 16174 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:45.854519 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:45.895179 15443 raft_consensus.cc:606] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.896565 15443 raft_consensus.cc:614] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:45.898037 15511 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:45.893268 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:45.905083 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:45.912432 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:45.909176 18660 consensus_meta.cc:287] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.002s
I20260709 13:05:45.912568 18690 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:45.923584 18669 consensus_queue.cc:1059] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:45.927277 18624 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:45.927884 18624 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:45.928525 18661 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:45.928900 18624 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.930418 18624 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:45.937279 18695 consensus_meta.cc:287] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.006s
W20260709 13:05:45.938246 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.872798 18640 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.938759 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:45.941138 18640 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:45.943094 18660 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.945506 18660 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:45.917239 18764 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:45.955109 18764 raft_consensus.cc:697] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:45.956794 18764 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:45.965137 15482 leader_election.cc:400] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
W20260709 13:05:45.966253 18750 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.257s	user 0.004s	sys 0.000s
I20260709 13:05:45.973374 18729 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:45.976060 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56186.2us
W20260709 13:05:45.977283 18760 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:05:45.974171 18729 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:45.982179 18729 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:45.991830 18553 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:45.977911 16176 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:45.978569 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:45.992304 18687 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.999233 18687 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:46.001144 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 131624us
W20260709 13:05:46.002274 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.772s (SENT) [suppressed 48 similar messages]
I20260709 13:05:46.006315 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:46.001241 18658 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:46.014462 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:46.032339 15443 raft_consensus.cc:606] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:46.033272 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.035630 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.008630 18695 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.039886 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.011145 18660 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:46.040977 18759 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:46.041430 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.041610 18759 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:46.041087 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 172339us
I20260709 13:05:46.042128 18759 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.042372 18726 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.042840 18726 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.042518 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:46.044710 18726 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.046414 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.047922 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:46.048812 18752 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.050482 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.047515 18660 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.051569 18752 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:46.052565 18752 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.052583 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:46.053833 18755 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.053422 18752 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.063315 18759 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.056684 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.058306 18691 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.032059 18624 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.054605 18660 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.033349 18692 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.040421 18695 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.036552 18658 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:46.034701 18690 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:46.089427 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.094070 18686 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:46.094766 18766 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:05:46.097484 18759 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.074368 18729 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:05:46.075116 18411 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:46.106514 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49987.4us
I20260709 13:05:46.209005 15589 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:46.145449 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 143218us
I20260709 13:05:46.184340 15586 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:05:46.210206 15586 pending_rounds.cc:85] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 4
I20260709 13:05:46.210269 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.146461 18690 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:46.143275 18695 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.214814 18708 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:46.119275 18691 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.211150 18768 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:05:46.220734 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2119) took 1280 ms. Trace:
I20260709 13:05:46.233722 15587 rpcz_store.cc:276] 0709 13:05:44.940251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.949863 (+  9612us) service_pool.cc:224] Handling call
0709 13:05:46.220470 (+1270607us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b540016cbd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:46.220624 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038925696}
I20260709 13:05:46.220916 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:46.220242 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 415) took 1438 ms. Trace:
I20260709 13:05:46.125168 18640 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.129350 18624 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:46.309468 18640 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.176122 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:46.311655 18779 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:05:46.311949 15585 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:46.117698 18687 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:46.128319 18660 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.117187 18755 raft_consensus.cc:2764] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:05:46.197029 15583 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:46.197880 15588 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:46.202750 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.226315 18691 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:46.204332 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 199824us
I20260709 13:05:46.205297 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:46.206132 16176 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:46.126354 18590 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.210618 15586 pending_rounds.cc:107] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:05:46.324153 15586 raft_consensus.cc:2889] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:46.326337 15586 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:46.183606 15592 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:46.328691 15588 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:05:46.307793 18612 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:46.334074 15586 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:05:46.190627 18700 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.156915 18686 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:46.302560 15589 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.216992 18726 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.306082 15584 rpcz_store.cc:276] 0709 13:05:44.781468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.841283 (+ 59815us) service_pool.cc:224] Handling call
0709 13:05:44.841637 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.973250 (+131613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.973303 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.973374 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:44.973438 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.219919 (+1246481us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54000c03d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:46.219976 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.220168 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301966720}
W20260709 13:05:46.316051 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 108482us
I20260709 13:05:46.220288 18759 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:46.311311 18624 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.226887 18768 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:46.218241 18772 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:46.314872 18640 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.334903 15591 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:46.335877 15586 pending_rounds.cc:85] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 3
I20260709 13:05:46.372368 15586 pending_rounds.cc:107] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:05:46.372725 15586 raft_consensus.cc:2889] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:46.212682 15555 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.831s (SENT)
I20260709 13:05:46.373889 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:46.374902 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 162238us
W20260709 13:05:46.375627 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.967s (SENT)
I20260709 13:05:46.308081 18411 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:46.312616 18714 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.382854 18714 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.385226 18714 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.380605 18759 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:46.385991 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.386714 15588 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:46.386420 18759 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.222308 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:46.388675 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 166543us
W20260709 13:05:46.343436 16174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52918 (request call id 362) took 1600 ms (client timeout 1724 ms). Trace:
I20260709 13:05:46.380542 18687 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.389561 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:46.389292 16174 rpcz_store.cc:269] 0709 13:05:44.742630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.743408 (+   778us) service_pool.cc:224] Handling call
0709 13:05:46.343178 (+1599770us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400510254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:46.343334 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199803648}
I20260709 13:05:46.374470 18768 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:46.345661 16178 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:46.346434 18732 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:46.391053 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:46.341431 18690 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:46.391281 18768 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:46.391505 18732 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:46.392601 18755 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:46.356256 18778 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:05:46.347069 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.368691 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.367270 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:46.392736 18768 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.395874 15584 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:46.393082 18755 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.396544 18755 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.394273 18732 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:46.365492 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 152140us
I20260709 13:05:46.397912 15583 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:05:46.388291 18411 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.374626 18772 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:46.349465 18648 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.352057 18642 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:46.391996 18746 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:46.377084 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.404451 18517 consensus_queue.cc:1059] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:05:46.405077 18777 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:05:46.379315 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.408954 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:05:46.414965 15555 leader_election.cc:336] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.021s (SENT)
I20260709 13:05:46.386816 18695 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:46.418201 18748 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.634s	user 0.004s	sys 0.000s
I20260709 13:05:46.357225 18590 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.394809 18726 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.337435 18612 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:46.417313 18766 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:46.372484 18669 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:05:46.381585 15407 leader_election.cc:400] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7.
I20260709 13:05:46.516433 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:46.755457 18756 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.972s	user 0.003s	sys 0.000s
I20260709 13:05:46.524580 15589 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:46.527619 15592 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:46.533919 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:46.757037 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2160) took 1447 ms. Trace:
W20260709 13:05:46.757973 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 343039us
I20260709 13:05:46.757452 15512 rpcz_store.cc:276] 0709 13:05:45.309870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.432144 (+122274us) service_pool.cc:224] Handling call
0709 13:05:45.454363 (+ 22219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.461181 (+  6818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.461212 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.461738 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.634509 (+172771us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:45.634554 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.634634 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.754764 (+1120130us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:46.756688 (+  1924us) raft_consensus.cc:1685] finished
0709 13:05:46.756709 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.756951 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9426,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":25855,"spinlock_wait_cycles":67699968,"thread_start_us":113576,"threads_started":1,"wal-append.queue_time_us":321288}
W20260709 13:05:46.539278 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 130393us
I20260709 13:05:46.760841 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:46.763047 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:46.784485 18792 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:46.527961 18648 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.545207 18695 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.545861 18612 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:46.527101 18687 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:46.788347 18687 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:46.791074 18687 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:46.547650 18786 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:46.791666 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.791877 18786 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:46.794385 18786 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.548890 18686 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:46.534127 18775 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 13:05:46.532763 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 164919us
I20260709 13:05:46.586023 18752 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.805892 18752 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.547695 18590 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:46.806780 18792 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:05:46.602494 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.809631 18590 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.810366 18590 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.813264 18590 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:46.619266 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60968.9us
W20260709 13:05:46.630347 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 112604us
I20260709 13:05:46.623958 18657 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.820048 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.819955 18657 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.822897 18657 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.629043 18714 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:05:46.657634 18523 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.825002 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:46.672322 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.649405 18658 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.681809 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "534703c18f76440380b33b80bf77802e"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:46.840473 15443 raft_consensus.cc:606] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:46.675041 18712 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.627681 18772 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.679512 18660 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:46.711333 18753 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.026s	sys 0.042s
I20260709 13:05:46.729192 18755 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:05:46.732656 18783 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 13:05:46.738644 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.877997 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.878533 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.746548 18773 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.481s	user 0.000s	sys 0.001s
I20260709 13:05:46.544301 18726 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:46.764788 18674 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:46.760682 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 379238us
I20260709 13:05:46.890255 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:46.759402 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.046s (SENT)
W20260709 13:05:46.765287 15515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 2149) took 1497 ms (client timeout 1767 ms). Trace:
W20260709 13:05:46.893581 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134219us
W20260709 13:05:46.894374 15555 leader_election.cc:336] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.098s (SENT)
I20260709 13:05:46.894805 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:46.775475 18774 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.463s	user 0.001s	sys 0.001s
I20260709 13:05:46.777213 18515 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:46.779242 18796 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:46.780953 18689 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.519696 18692 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.806820 18695 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:46.819172 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.920921 15591 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:05:46.921897 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:46.922562 15511 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:46.850526 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.858229 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.860831 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:46.924096 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:46.861781 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:46.875082 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.924865 15587 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.807529 18792 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.882738 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:46.844265 15338 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.887101 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.886387 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.772387 18708 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:05:46.893443 15515 rpcz_store.cc:269] 0709 13:05:45.268237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.270045 (+  1808us) service_pool.cc:224] Handling call
0709 13:05:46.765074 (+1495029us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b54000ecc54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:46.765197 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69704448}
I20260709 13:05:46.899088 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:46.928908 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:46.905010 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:46.908778 15514 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:46.929613 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:46.910753 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:46.914163 15555 leader_election.cc:336] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.135s (SENT)
I20260709 13:05:46.930228 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:46.888989 18590 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.916390 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:46.938066 15441 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:05:46.917987 15510 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:46.919251 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:46.922675 15591 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.924404 15584 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 10: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:46.940357 15407 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:46.941874 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:46.873226 18753 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.026s	sys 0.042s
I20260709 13:05:46.889402 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:46.943429 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54121.4us
I20260709 13:05:46.944751 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:46.925834 15589 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:46.926604 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:46.929682 16178 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:46.915112 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8566093919999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 13:05:46.930719 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:46.931007 15436 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:05:46.946798 15482 connection.cc:256] RPC call timeout handler was delayed by -1.2518093919999274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:05:46.930518 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:46.931748 15592 raft_consensus.cc:2393] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:46.947865 15435 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.948079 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:46.947521 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:46.889950 18726 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:46.862739 18712 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:46.932858 15338 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:46.935029 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:46.936395 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.902321 18657 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.954752 15436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:46.933722 15511 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:46.985939 15436 raft_consensus.cc:606] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:46.939363 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:46.986255 15338 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:46.986997 15441 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:46.984009 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:46.958459 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:46.898603 18515 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:05:46.915503 18733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.014s	sys 0.005s
I20260709 13:05:46.991391 15338 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 4, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 3 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:05:46.989564 15440 raft_consensus.cc:2393] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:46.989601 15482 leader_election.cc:400] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 3. Current term is 4.
I20260709 13:05:46.983634 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:46.995859 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:46.999372 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:47.000237 15441 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:47.008373 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:46.961123 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:47.001497 15587 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:47.002877 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:46.963867 15341 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 203) took 17703 ms (client timeout 15000 ms). Trace:
I20260709 13:05:47.008463 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:46.905656 18741 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:05:46.914558 18666 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:05:47.022958 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:46.960912 18547 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:47.044457 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 55003.8us
I20260709 13:05:47.044821 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:46.902657 18648 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.046562 15518 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:47.091890 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.092549 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:46.996518 18768 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:47.093814 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:46.904170 18612 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:05:47.010867 15338 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 5, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:05:47.094573 15518 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:47.095324 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.095625 15338 catalog_manager.cc:5697] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:47.001551 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.097458 15439 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.012723 18708 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:47.046983 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 88627.6us
W20260709 13:05:47.009426 18733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.014s	sys 0.006s
I20260709 13:05:46.995177 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:46.963291 18674 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:46.927917 18792 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:46.914736 18610 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:05:46.984373 18696 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:46.967674 18590 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.059836 15435 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:47.123329 16176 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 3 LEARNER]: Advancing to term 4
I20260709 13:05:46.928683 18762 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:05:47.060981 18712 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:46.914925 18796 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.063314 18642 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:47.045851 15341 rpcz_store.cc:269] 0709 13:05:29.237406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.237628 (+   222us) service_pool.cc:224] Handling call
0709 13:05:46.940404 (+17702776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:41.462434 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:41.463456 (+  1022us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:41.463528 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:05:41.463581 (+    53us) tablet.cc:662] Decoding operations
0709 13:05:41.464792 (+  1211us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:41.464919 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:41.464969 (+    50us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:05:41.465992 (+  1023us) tablet.cc:701] Row locks acquired
0709 13:05:41.466058 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:05:41.466339 (+   281us) write_op.cc:270] Start()
0709 13:05:41.466554 (+   215us) write_op.cc:276] Timestamp: P: 1783602341466234 usec, L: 0
0709 13:05:41.466593 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:05:41.530522 (+ 63929us) log.cc:844] Serialized 2870 byte log entry
0709 13:05:42.045338 (+514816us) op_driver.cc:464] REPLICATION: finished
0709 13:05:42.172839 (+127501us) write_op.cc:301] APPLY: starting
0709 13:05:42.181610 (+  8771us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:42.188746 (+  7136us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:42.188925 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:42.208826 (+ 19901us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:42.209276 (+   450us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:05:42.209340 (+    64us) write_op.cc:312] APPLY: finished
0709 13:05:42.209770 (+   430us) log.cc:844] Serialized 59 byte log entry
0709 13:05:42.243414 (+ 33644us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:42.294171 (+ 50757us) write_op.cc:454] Released schema lock
0709 13:05:42.309059 (+ 14888us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:42.367646 (+ 58587us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:42.367693 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1300903,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":120806,"apply.run_cpu_time_us":12827,"apply.run_wall_time_us":166339,"num_ops":7,"prepare.queue_time_us":267499,"prepare.run_cpu_time_us":99159,"prepare.run_wall_time_us":249490,"raft.queue_time_us":264645,"raft.run_cpu_time_us":29121,"raft.run_wall_time_us":51689,"replication_time_us":578522,"thread_start_us":532253,"threads_started":4,"wal-append.queue_time_us":162798,"wal-append.run_cpu_time_us":11917,"wal-append.run_wall_time_us":1471831}]]}
I20260709 13:05:46.931137 18692 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:46.960513 18726 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.068857 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:46.985734 18657 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.921379 18714 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:05:46.928189 18691 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.996820 18759 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:47.149744 18759 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:47.150986 18759 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.078198 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:47.071017 18781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.011s	sys 0.042s
W20260709 13:05:47.082686 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.161646 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.085244 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.162672 15515 raft_consensus.cc:2368] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:05:47.086544 16178 raft_consensus.cc:2410] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:47.100149 15338 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:46.990213 18663 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.057507 18640 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.106112 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.184597 15518 raft_consensus.cc:2393] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:46.964900 18704 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 13:05:47.107920 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:47.057240 18411 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:47.116755 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.128880 15586 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:47.092742 18547 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.099857 18768 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.135603 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:47.200774 15438 raft_consensus.cc:606] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:47.104311 18361 raft_consensus.cc:2764] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:47.138440 15512 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:47.144431 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 230289us
W20260709 13:05:47.160966 18781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.012s	sys 0.042s
I20260709 13:05:47.158138 16176 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:47.164525 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.212958 15515 raft_consensus.cc:2368] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:47.214191 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:47.175228 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 217627us
I20260709 13:05:47.099491 18766 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:05:47.138746 18642 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.164554 15338 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 7, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 7 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.192119 15516 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:05:47.201709 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.250919 15591 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
W20260709 13:05:47.206185 15555 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.140s (SENT)
W20260709 13:05:47.252573 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46436.9us
W20260709 13:05:47.253612 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.199s (SENT)
I20260709 13:05:47.254218 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:47.144897 18657 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.149101 18648 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:47.207096 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.208639 15441 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:05:47.210539 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.211431 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.190425 18759 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.256670 15516 pending_rounds.cc:85] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 4
I20260709 13:05:47.271960 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.182794 18708 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:47.266264 15518 raft_consensus.cc:2376] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9. Re-sending same reply.
I20260709 13:05:47.248220 15515 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:47.256187 15338 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 9 to 10, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 10 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.272461 15516 pending_rounds.cc:107] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:05:47.182298 18663 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.205354 18547 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.205613 18768 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:47.209519 18669 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:47.322667 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.263443 18642 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.274500 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.326828 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:47.274732 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 166563us
I20260709 13:05:47.248749 18755 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:47.213315 18741 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:47.338160 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 84607.8us
I20260709 13:05:47.328672 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:47.338974 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.199s (SENT)
I20260709 13:05:47.339730 15512 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:47.339965 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.340826 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.341583 15512 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9.
I20260709 13:05:47.260469 18804 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:47.360291 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:47.324064 18663 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.317271 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.367760 15518 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:47.369294 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.205502 18640 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.371918 15440 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:47.259328 18660 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:47.329165 15516 raft_consensus.cc:2889] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.342592 15436 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:47.213795 18411 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.342012 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:47.374563 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:47.370966 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.332805 15338 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 4 to 5, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 5 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.341670 18766 consensus_queue.cc:1243] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer 6ff41728dec842afad5b53c20446a5a0 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:47.324748 18696 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:47.383198 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.383754 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.427340 15518 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:47.389815 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:47.393458 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 57789.3us
I20260709 13:05:47.429109 15512 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:47.429416 15407 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:47.388700 15338 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:47.342480 18648 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.408478 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.411132 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:47.441490 15441 raft_consensus.cc:2410] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:47.364378 18590 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:47.440766 15514 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:47.449213 15338 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 4 to 5, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:47.450969 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.451102 15338 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 4, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 4 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.452765 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.453835 15514 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:47.342458 18691 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.444594 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 105655us
I20260709 13:05:47.445251 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.440652 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.465426 15518 raft_consensus.cc:2368] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:47.466879 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.326473 18708 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:47.488703 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59400.5us
I20260709 13:05:47.489880 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:47.446945 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:47.441134 15438 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:05:47.496253 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.496124 15338 catalog_manager.cc:5697] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 4, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 4 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.497841 15338 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 4, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 4 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:47.499318 15338 catalog_manager.cc:5697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } }
I20260709 13:05:47.501573 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:47.505904 15439 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
W20260709 13:05:47.469751 15555 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.206s (SENT)
I20260709 13:05:47.508266 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:47.509776 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48958.3us
W20260709 13:05:47.510720 15555 leader_election.cc:336] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.545s (SENT)
I20260709 13:05:47.327327 18813 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:47.496897 15511 raft_consensus.cc:2376] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12. Re-sending same reply.
I20260709 13:05:47.334542 18669 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.554761 16178 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:47.569114 15515 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.487072 18695 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.588635 18523 raft_consensus.cc:993] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:47.528098 18806 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:47.540608 18590 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:47.620095 18797 log.cc:927] Time spent T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
W20260709 13:05:47.606660 18801 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.450s	user 0.001s	sys 0.000s
I20260709 13:05:47.546553 18740 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:47.367897 18741 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.365209 18802 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.530262 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.678023 15511 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:47.518823 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:47.678843 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 311178us
I20260709 13:05:47.530961 18691 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.454917 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.511368 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:47.630546 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:47.688452 15514 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:47.689882 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.690757 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:47.653136 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2149) took 1280 ms. Trace:
W20260709 13:05:47.658097 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 211200us
I20260709 13:05:47.691610 15586 rpcz_store.cc:276] 0709 13:05:46.375270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.391038 (+ 15768us) service_pool.cc:224] Handling call
0709 13:05:46.391399 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.200286 (+808887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.628914 (+428628us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54001f5c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:47.653060 (+ 24146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687395200}
I20260709 13:05:47.692636 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:47.495689 18809 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:47.546902 18660 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:05:47.696725 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.638382 18807 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:05:47.690580 15514 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:47.711036 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.707660 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:47.645695 18712 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:47.707166 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.717927 15511 raft_consensus.cc:2376] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12. Re-sending same reply.
I20260709 13:05:47.601998 18806 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.712908 15512 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:47.681329 18523 raft_consensus.cc:1081] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:47.635334 18772 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:47.641794 18796 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:47.719130 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:47.706017 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 195347us
I20260709 13:05:47.659135 18686 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.550060 18813 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.640880 18411 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:47.723116 15590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.007s
I20260709 13:05:47.723388 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.763999 15511 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:47.764128 15590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.001s	sys 0.007s
I20260709 13:05:47.764492 15512 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:47.711895 18764 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:47.597899 18695 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:47.729409 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 471629us
I20260709 13:05:47.731676 18741 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:47.728993 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:47.733037 15515 raft_consensus.cc:2410] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:47.717700 18712 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:47.721625 18640 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:47.678192 18740 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.735293 18669 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:47.740692 18696 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.741847 18691 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:47.707481 18590 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:47.759054 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.627457 18361 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:47.767463 15555 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.664s (SENT)
I20260709 13:05:47.771047 18687 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.776057 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 68494.2us
I20260709 13:05:47.808086 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:47.731886 18660 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:47.773859 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.811065 15511 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:47.812168 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.813100 15511 raft_consensus.cc:2368] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6.
I20260709 13:05:47.814085 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.814998 15511 raft_consensus.cc:2368] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6.
I20260709 13:05:47.733917 18809 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:47.724436 18806 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:47.785480 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 56570.3us
W20260709 13:05:47.822456 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.822916 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.788522 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.701902 18802 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.772258 18796 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.802205 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:47.767517 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.802621 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.768851 18764 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:47.770766 18686 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.797462 18815 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:47.833804 18764 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:47.830137 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62706.8us
W20260709 13:05:47.842237 15555 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 3.095s (SENT)
I20260709 13:05:47.842684 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:47.796790 18624 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:05:47.818913 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.810664 18411 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:05:47.825440 15509 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:47.793401 18741 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:05:47.810050 18660 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:47.830019 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:47.817327 18687 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.889322 18708 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:47.844831 18712 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.834177 18814 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.888432 18809 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.831916 18590 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.883049 18515 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.810453 18640 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:05:47.889708 18810 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:47.904021 15511 raft_consensus.cc:2368] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 10.
I20260709 13:05:47.802060 18361 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:47.910406 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.912312 15509 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:47.913486 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:47.837206 18815 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:47.844857 18669 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.926532 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 96570.4us
W20260709 13:05:47.928965 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.916429 18811 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:05:47.918512 18803 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:05:47.946386 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.986625 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:47.988401 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:47.988963 15511 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.966249 15512 raft_consensus.cc:2368] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6.
I20260709 13:05:47.906479 18691 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:47.977741 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:47.977902 18819 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.940403 18708 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:47.935194 18590 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.972119 18515 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.975739 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:47.926244 18695 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:47.916867 18796 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:05:47.967978 15509 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:47.979909 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:48.015115 15509 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:48.001624 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:47.972988 18361 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.974547 18815 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:47.974659 18712 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:48.019038 18822 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:05:47.940526 18821 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:48.020247 18590 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:48.021353 18687 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:48.023051 18820 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:05:48.027798 18824 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:48.029738 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:48.031164 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:48.040755 18813 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:48.040861 15513 raft_consensus.cc:2376] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8. Re-sending same reply.
I20260709 13:05:48.041481 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:48.042032 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:48.042301 18392 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:48.042716 18392 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:47.983098 18806 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:48.011376 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:48.045151 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:48.046547 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:48.047070 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.032071 18819 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:47.992087 18660 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:48.034510 18796 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:05:48.035296 18657 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.721s	user 0.004s	sys 0.004s
I20260709 13:05:48.036582 18824 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:47.987378 18810 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:48.039829 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2170) took 1133 ms. Trace:
I20260709 13:05:48.042858 15513 raft_consensus.cc:2393] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:48.007753 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:48.043089 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:48.008665 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:48.050267 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:48.061944 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:48.062667 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:48.064335 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:48.054414 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:48.065644 15442 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:48.067781 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:48.071130 15511 raft_consensus.cc:2410] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:48.085347 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:48.087181 15591 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:48.092629 15555 leader_election.cc:336] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 3.305s (SENT)
I20260709 13:05:48.093308 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:48.014509 18640 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:48.090104 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:48.096746 15592 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:48.097697 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:48.106073 15591 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:47.987358 18669 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:48.095237 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:50.356020 18361 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 2.340s	user 0.015s	sys 0.000s
I20260709 13:05:48.043936 18392 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:50.255064 18515 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 2.231s	user 0.015s	sys 0.001s
I20260709 13:05:51.243625 18361 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:48.168210 18547 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.003s
I20260709 13:05:51.246174 18392 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:48.115149 18569 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:48.049995 18590 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:51.248309 18569 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:51.249145 18569 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:51.248869 18590 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:51.002012 18612 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.009s	sys 0.012s
W20260709 13:05:51.253610 18612 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.010s	sys 0.012s
I20260709 13:05:48.103935 18640 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.255842 18640 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:48.215164 18642 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.855s	user 0.013s	sys 0.000s
I20260709 13:05:51.258389 18361 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:51.259502 18642 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:48.076548 18657 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:48.077370 18648 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:51.265439 18648 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:48.114569 18660 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:51.268575 18648 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:51.269119 18569 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:51.271541 18569 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:48.226394 18663 consensus_meta.cc:287] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.837s	user 0.012s	sys 0.000s
I20260709 13:05:51.273500 18663 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:05:51.275383 18674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.131s	user 0.006s	sys 0.021s
I20260709 13:05:51.267395 18657 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:51.276047 18674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.139s	user 0.006s	sys 0.021s
I20260709 13:05:48.229518 18669 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:48.219276 18686 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:48.074409 18687 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.278898 18687 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.282040 18687 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:48.224542 18689 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.310s	user 0.014s	sys 0.003s
I20260709 13:05:48.056689 18695 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:51.283649 18642 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:51.283788 18624 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.284895 18624 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:51.276690 18663 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:49.954321 18696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.738s	user 0.019s	sys 0.042s
I20260709 13:05:51.285926 18640 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:51.286900 18696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.071s	user 0.020s	sys 0.042s
W20260709 13:05:50.294094 18700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.083s	user 0.030s	sys 0.087s
W20260709 13:05:51.288971 18700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.083s	user 0.030s	sys 0.088s
I20260709 13:05:51.289044 18695 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:48.083920 18708 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:51.292506 18640 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:48.214943 18726 consensus_meta.cc:287] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.054s	user 0.015s	sys 0.000s
W20260709 13:05:50.362308 18815 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 2.346s	user 0.013s	sys 0.000s
I20260709 13:05:48.109936 18740 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:51.294036 18726 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:51.065399 18835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.007s	sys 0.021s
W20260709 13:05:51.295868 18835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.007s	sys 0.022s
I20260709 13:05:48.219172 18806 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:48.589597 18759 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.265s	user 0.014s	sys 0.001s
I20260709 13:05:48.049834 18796 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:48.231377 18824 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:48.079520 18821 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.729436 18810 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:50.377197 18764 consensus_meta.cc:287] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 2.473s	user 0.015s	sys 0.000s
I20260709 13:05:51.303748 18821 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.304204 18764 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:51.305763 18796 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:49.728487 18831 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:51.290799 18695 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.307447 18764 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:51.307744 18796 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:49.199277 18828 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.653s	user 0.000s	sys 0.000s
I20260709 13:05:48.181860 18808 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:48.214588 18792 consensus_meta.cc:287] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.080s	user 0.014s	sys 0.000s
I20260709 13:05:51.309540 18808 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.309796 18792 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.312323 15518 raft_consensus.cc:2410] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:05:48.212009 18768 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.882s	user 0.005s	sys 0.009s
I20260709 13:05:51.313627 18768 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.313918 18590 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:51.314719 18808 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:49.132002 18819 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:50.264349 18829 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.687s	user 0.000s	sys 0.001s
W20260709 13:05:51.237941 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.246752 18547 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.276487 18674 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:51.294368 18815 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:48.139659 18802 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:51.300961 18726 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:51.316682 18768 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:51.312565 18792 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:51.348199 18674 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:51.357865 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.349196 15434 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:51.367786 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 3.36585e+06us
I20260709 13:05:51.372151 18604 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:51.352241 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:51.386250 15438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1775) took 3408 ms (client timeout 1563 ms). Trace:
W20260709 13:05:51.390271 15442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 347) took 3401 ms (client timeout 1967 ms). Trace:
W20260709 13:05:51.387116 15438 rpcz_store.cc:269] 0709 13:05:47.977648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.007419 (+ 29771us) service_pool.cc:224] Handling call
0709 13:05:51.385835 (+3378416us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:51.390959 15442 rpcz_store.cc:269] 0709 13:05:47.988916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.054002 (+ 65086us) service_pool.cc:224] Handling call
0709 13:05:51.389915 (+3335913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.351094 18547 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:51.408004 15435 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:51.407701 15585 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:51.409981 18815 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:51.393585 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:51.407135 18726 raft_consensus.cc:476] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:05:51.428900 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 344) took 3441 ms. Trace:
W20260709 13:05:51.430219 15515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1747) took 4164 ms (client timeout 1542 ms). Trace:
I20260709 13:05:51.432665 15512 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:51.438254 15514 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:51.412441 18792 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:51.439955 15515 rpcz_store.cc:269] 0709 13:05:47.265417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.339622 (+ 74205us) service_pool.cc:224] Handling call
0709 13:05:51.429510 (+4089888us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001e4bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:51.429870 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525098368}
I20260709 13:05:51.440881 18792 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:51.439296 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2186) took 4449 ms. Trace:
W20260709 13:05:51.447909 15435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1873) took 4246 ms (client timeout 1694 ms). Trace:
W20260709 13:05:51.448568 15435 rpcz_store.cc:269] 0709 13:05:47.201301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.201439 (+   138us) service_pool.cc:224] Handling call
0709 13:05:51.447471 (+4246032us) spinlock_profiling.cc:243] Waited 4.13 s on lock 0x7b54003ed854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:51.447761 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9493038464}
W20260709 13:05:51.458526 15406 connection.cc:256] RPC call timeout handler was delayed by -1.8552711259999342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:05:51.459124 15406 connection.cc:256] RPC call timeout handler was delayed by -1.7888690089999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:05:51.445662 15585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2164) took 3350 ms (client timeout 2196 ms). Trace:
I20260709 13:05:51.429702 15438 rpcz_store.cc:276] 0709 13:05:47.988042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.426946 (+3438904us) service_pool.cc:224] Handling call
0709 13:05:51.427715 (+   769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.428289 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.428330 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.428426 (+    96us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:51.428483 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.428564 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.428762 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.461971 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 345) took 3463 ms. Trace:
I20260709 13:05:51.445339 15514 rpcz_store.cc:276] 0709 13:05:46.989400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.436546 (+4447146us) service_pool.cc:224] Handling call
0709 13:05:51.437419 (+   873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.438871 (+  1452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.439139 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.529742 15514 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:51.530609 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1742) took 4398 ms. Trace:
I20260709 13:05:51.530975 15514 rpcz_store.cc:276] 0709 13:05:47.132069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.528813 (+4396744us) service_pool.cc:224] Handling call
0709 13:05:51.529386 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.530285 (+   899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.530514 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.440042 15440 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:05:51.533270 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:51.533840 15440 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 346) took 3545 ms (client timeout 1861 ms). Trace:
I20260709 13:05:51.534173 16180 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 3.
I20260709 13:05:51.535043 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 587) took 4402 ms. Trace:
W20260709 13:05:51.534317 15440 rpcz_store.cc:269] 0709 13:05:47.988607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.046570 (+ 57963us) service_pool.cc:224] Handling call
0709 13:05:51.533707 (+3487137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.537849 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 351) took 3536 ms. Trace:
I20260709 13:05:51.469952 18717 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.539220 18717 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.517520 18686 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:51.495944 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2157) took 3414 ms. Trace:
I20260709 13:05:51.683665 15583 rpcz_store.cc:276] 0709 13:05:48.081254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.083678 (+  2424us) service_pool.cc:224] Handling call
0709 13:05:51.483533 (+3399855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.494585 (+ 11052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.494613 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.494683 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:51.494728 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.494815 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.495713 (+   898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.683777 18686 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:51.685498 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:51.687199 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:51.511960 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.688701 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:51.519120 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:51.691233 16176 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:51.690186 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:51.523587 16177 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:51.525429 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:51.459417 15406 connection.cc:256] RPC call timeout handler was delayed by -1.5911256220000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 13:05:51.694150 16178 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:51.532516 15435 rpcz_store.cc:276] 0709 13:05:47.988342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.449835 (+3461493us) service_pool.cc:224] Handling call
0709 13:05:51.450482 (+   647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.450991 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.451029 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.451113 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:51.451188 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.451268 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.451461 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:51.460469 15585 rpcz_store.cc:269] 0709 13:05:48.094738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.094921 (+   183us) service_pool.cc:224] Handling call
0709 13:05:51.444535 (+3349614us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540028b4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:51.444910 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345515392}
I20260709 13:05:51.699251 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:51.700228 15585 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:51.531363 18411 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:51.705150 18411 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:51.470760 18729 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:05:51.894464 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:51.897572 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.547116 15440 rpcz_store.cc:276] 0709 13:05:48.001202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.535968 (+3534766us) service_pool.cc:224] Handling call
0709 13:05:51.536588 (+   620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.537267 (+   679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.537317 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.537420 (+   103us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:51.537480 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.537586 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.537767 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.903772 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:51.905766 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:51.552134 15437 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:51.508574 18792 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:51.557171 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:51.918278 16180 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:51.535516 15514 rpcz_store.cc:276] 0709 13:05:47.133118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.533883 (+4400765us) service_pool.cc:224] Handling call
0709 13:05:51.534339 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.534605 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.534630 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.534699 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:51.534731 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.534829 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.534980 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.919131 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1772) took 4812 ms. Trace:
I20260709 13:05:51.919708 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:51.919790 15437 rpcz_store.cc:276] 0709 13:05:47.106505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.106704 (+   199us) service_pool.cc:224] Handling call
0709 13:05:47.121956 (+ 15252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.908131 (+4786175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.918813 (+ 10682us) spinlock_profiling.cc:243] Waited 4.43 s on lock 0x7b54003ee754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:51.919062 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10187424512}
I20260709 13:05:51.921452 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:51.573207 15510 raft_consensus.cc:2410] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:05:51.567044 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.503s	user 0.049s	sys 0.097s
I20260709 13:05:51.575894 15511 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:51.578207 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2179) took 4618 ms. Trace:
W20260709 13:05:51.576258 15407 connection.cc:256] RPC call timeout handler was delayed by -2.4650133990000995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260709 13:05:51.923094 15407 connection.cc:256] RPC call timeout handler was delayed by -2.3363133990001188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:05:51.583065 15512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1753) took 4222 ms (client timeout 2222 ms). Trace:
W20260709 13:05:51.923630 15407 connection.cc:256] RPC call timeout handler was delayed by -2.2985133990000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 13:05:48.058350 15516 rpcz_store.cc:276] 0709 13:05:46.906897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.909351 (+  2454us) service_pool.cc:224] Handling call
0709 13:05:46.935292 (+ 25941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.387174 (+451882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.039436 (+652262us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54002a1054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:48.039732 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569887872}
W20260709 13:05:51.586295 15509 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 3.571s	user 0.055s	sys 0.063s
W20260709 13:05:51.595000 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 3.50203e+06us
I20260709 13:05:51.596174 18840 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:51.926302 15509 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:05:51.926761 15509 pending_rounds.cc:85] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 7
I20260709 13:05:51.927052 15509 pending_rounds.cc:107] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:05:51.927335 15509 raft_consensus.cc:2889] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:51.927515 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:51.928357 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 575) took 5940 ms. Trace:
I20260709 13:05:51.597642 18808 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.928905 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:51.929674 15516 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:51.929508 18808 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.930630 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:51.930953 15437 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:05:51.931926 18749 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:05:51.598569 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 343) took 3611 ms. Trace:
I20260709 13:05:51.932555 15442 rpcz_store.cc:276] 0709 13:05:47.986809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.424561 (+3437752us) service_pool.cc:224] Handling call
0709 13:05:51.491762 (+ 67201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.492332 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:51.492923 (+   591us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.598096 (+105173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.598158 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:51.598241 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.598321 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.598482 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1126,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":70091,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":4813,"thread_start_us":103975,"threads_started":1,"wal-append.queue_time_us":103858}
I20260709 13:05:51.608002 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2160) took 3525 ms. Trace:
W20260709 13:05:51.923799 15512 rpcz_store.cc:269] 0709 13:05:47.360390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.990116 (+629726us) service_pool.cc:224] Handling call
0709 13:05:51.582703 (+3592587us) spinlock_profiling.cc:243] Waited 3.37 s on lock 0x7b54002e2a54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:51.582953 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7745735552}
I20260709 13:05:51.935787 15584 rpcz_store.cc:276] 0709 13:05:48.082166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.083117 (+   951us) service_pool.cc:224] Handling call
0709 13:05:48.083612 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.606183 (+3522571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.606231 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.606295 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:51.606357 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.607497 (+  1140us) spinlock_profiling.cc:243] Waited 3.52 s on lock 0x7b5400114254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:51.607564 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.607807 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8100294400}
I20260709 13:05:51.936836 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:51.937393 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:51.938161 15584 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:51.612311 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:51.939836 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:51.639094 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.622462 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2168) took 3522 ms. Trace:
I20260709 13:05:51.940575 15591 rpcz_store.cc:276] 0709 13:05:51.474739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.621015 (+146276us) service_pool.cc:224] Handling call
0709 13:05:51.621514 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.621933 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.621959 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.622020 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:51.622051 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.622103 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.622245 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.941921 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:51.647754 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:51.943783 18759 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.944414 18759 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:51.923108 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2182) took 4939 ms. Trace:
I20260709 13:05:51.667114 18692 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:05:51.674046 18592 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.949170 18592 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:51.703104 15406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.666s (SENT) [suppressed 11 similar messages]
I20260709 13:05:51.692371 15583 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.954010 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:51.715201 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.723850 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1766) took 4793 ms. Trace:
I20260709 13:05:51.728351 18515 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.731292 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1875) took 4528 ms. Trace:
I20260709 13:05:51.732151 18717 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:51.922897 15513 rpcz_store.cc:276] 0709 13:05:46.980661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.576615 (+4595954us) service_pool.cc:224] Handling call
0709 13:05:51.577101 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.577617 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.577643 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.577719 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:51.577757 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.577814 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.577970 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:51.736145 15439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.820s	user 0.035s	sys 0.062s
I20260709 13:05:51.681664 18624 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:51.928757 15509 rpcz_store.cc:276] 0709 13:05:45.988069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.989139 (+  1070us) service_pool.cc:224] Handling call
0709 13:05:45.989416 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.825305 (+1835889us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54000d4420. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd591c0 00007fcf7bd5a231 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c
0709 13:05:51.927938 (+4102633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.928258 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246309120}
I20260709 13:05:51.756412 18686 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:51.759747 18361 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:51.771512 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2188) took 4770 ms. Trace:
I20260709 13:05:51.773989 18766 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.792565 18695 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:51.798913 18726 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.805735 15518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1745) took 4587 ms (client timeout 1789 ms). Trace:
I20260709 13:05:51.808320 15443 raft_consensus.cc:2410] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:05:51.811019 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.811810 18755 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:51.816514 15517 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:51.826120 18802 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:51.829291 18815 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:51.859696 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:51.861078 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:51.868175 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1774) took 4976 ms. Trace:
I20260709 13:05:51.882079 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:51.895706 18729 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.907418 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:51.911931 15556 connection.cc:256] RPC call timeout handler was delayed by -3.6112920979999217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260709 13:05:51.912921 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:51.917066 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:51.921501 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:51.924014 15407 connection.cc:256] RPC call timeout handler was delayed by -2.2310133990000622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 13:05:51.580503 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 349) took 3591 ms. Trace:
W20260709 13:05:51.922904 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:51.922377 15510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1740) took 4832 ms (client timeout 3462 ms). Trace:
W20260709 13:05:51.925887 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.862s	user 0.052s	sys 0.098s
I20260709 13:05:51.937531 15512 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:51.940030 15588 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:51.614856 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2155) took 3547 ms. Trace:
I20260709 13:05:51.649326 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:51.948411 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:51.711215 18821 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:51.956216 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.943290 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:51.935146 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:51.706900 18411 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:51.955865 15434 rpcz_store.cc:276] 0709 13:05:46.930309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.976860 (+ 46551us) service_pool.cc:224] Handling call
0709 13:05:46.977360 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.360410 (+4383050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.723399 (+362989us) spinlock_profiling.cc:243] Waited 4.37 s on lock 0x7b5400031454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:51.723746 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10053358848}
I20260709 13:05:51.948062 15511 rpcz_store.cc:276] 0709 13:05:46.984015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.574758 (+4590743us) service_pool.cc:224] Handling call
0709 13:05:51.575273 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.922824 (+347551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.923049 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:51.961860 15439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.050s	user 0.036s	sys 0.063s
I20260709 13:05:51.957288 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:52.000656 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.956163 18515 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:51.956296 15436 rpcz_store.cc:276] 0709 13:05:47.203128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.391652 (+188524us) service_pool.cc:224] Handling call
0709 13:05:47.392053 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.447981 (+ 55928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.448003 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:47.448037 (+    34us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:47.448059 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.730756 (+4282697us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b540026b954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:51.730835 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.731078 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128205056}
I20260709 13:05:52.069427 15516 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:52.071441 15407 connection.cc:256] RPC call timeout handler was delayed by -1.9430133990000513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 13:05:51.961915 15515 rpcz_store.cc:276] 0709 13:05:47.000988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.441857 (+4440869us) service_pool.cc:224] Handling call
0709 13:05:51.442478 (+   621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.443188 (+   710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.443218 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.444056 (+   838us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.484074 (+ 40018us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:51.484143 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.484251 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.768987 (+284736us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b180036e440. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:51.771085 (+  2098us) raft_consensus.cc:1685] finished
0709 13:05:51.771110 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.771400 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19953,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":17812,"spinlock_wait_cycles":9799936,"thread_start_us":39432,"threads_started":1,"wal-append.queue_time_us":42920}
I20260709 13:05:52.076960 15583 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:52.012509 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:52.083853 15592 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:52.084300 15340 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.085750 18515 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.086745 18691 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.087379 18691 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:52.087924 15591 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:52.086529 15340 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:52.073042 15510 rpcz_store.cc:269] 0709 13:05:47.090352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.063915 (+973563us) service_pool.cc:224] Handling call
0709 13:05:51.922265 (+3858350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.075361 15586 rpcz_store.cc:276] 0709 13:05:48.068242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.068645 (+   403us) service_pool.cc:224] Handling call
0709 13:05:48.069095 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.613739 (+3544644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.613790 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.613834 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:51.613873 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.614415 (+   542us) spinlock_profiling.cc:243] Waited 3.54 s on lock 0x7b540024ac54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:51.614462 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.614655 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8150771968}
I20260709 13:05:52.094668 15437 raft_consensus.cc:2368] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
W20260709 13:05:52.073231 15518 rpcz_store.cc:269] 0709 13:05:47.218607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.466451 (+247844us) service_pool.cc:224] Handling call
0709 13:05:51.805327 (+4338876us) spinlock_profiling.cc:243] Waited 3.83 s on lock 0x7b5400202bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:51.805603 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8809415936}
I20260709 13:05:52.096911 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:52.063832 18361 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:52.097695 15591 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:52.099153 18361 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:51.955699 18592 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.099931 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.100739 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:52.102118 15592 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:52.113739 18674 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.114197 18749 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:52.103703 18853 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:05:52.103802 15514 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:52.104352 15589 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:52.077543 15587 rpcz_store.cc:276] 0709 13:05:46.891767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.083667 (+191900us) service_pool.cc:224] Handling call
0709 13:05:47.084026 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:47.211458 (+127432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.211503 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:47.250220 (+ 38717us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.626695 (+4376475us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b18002aa8a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:05:51.786947 (+160252us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:51.813390 (+ 26443us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.841426 (+ 28036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.848815 (+  7389us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.848880 (+    65us) raft_consensus.cc:1685] finished
0709 13:05:51.862957 (+ 14077us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.867894 (+  4937us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31851,"prepare.queue_time_us":7159,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":193875,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":28725,"spinlock_wait_cycles":43279232,"thread_start_us":272545,"threads_started":3,"wal-append.queue_time_us":4471224}
I20260709 13:05:52.074607 15438 rpcz_store.cc:276] 0709 13:05:47.989534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.516197 (+3526663us) service_pool.cc:224] Handling call
0709 13:05:51.517003 (+   806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.517582 (+   579us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:51.564682 (+ 47100us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.580046 (+ 15364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.580102 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:51.580180 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.580256 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.580407 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46368,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":87197,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"thread_start_us":14795,"threads_started":1,"wal-append.queue_time_us":15257}
W20260709 13:05:52.116624 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 413541us
I20260709 13:05:52.064150 18766 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:52.105938 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 4.04302e+06us
I20260709 13:05:52.109944 15340 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:52.099942 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:52.114534 18674 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.126525 15340 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 6 to 7, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:52.089845 18821 raft_consensus.cc:476] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:05:52.114217 15511 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.116245 15509 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:52.132730 15584 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:52.140280 15441 raft_consensus.cc:2410] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:52.119977 18840 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:52.148646 15517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1732) took 5059 ms (client timeout 1657 ms). Trace:
W20260709 13:05:52.145416 15443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1753) took 5221 ms (client timeout 2229 ms). Trace:
I20260709 13:05:52.149573 15591 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:52.114977 18749 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.131230 18361 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.152885 15406 leader_election.cc:336] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.767s (SENT)
I20260709 13:05:52.161099 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:52.090042 18802 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.147420 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:52.132745 18640 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.163381 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.156201 15443 rpcz_store.cc:269] 0709 13:05:46.923669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.923807 (+   138us) service_pool.cc:224] Handling call
0709 13:05:52.129344 (+5205537us) spinlock_profiling.cc:243] Waited 4.88 s on lock 0x7b54002d0854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:52.145322 (+ 15978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11229854080}
I20260709 13:05:52.144133 18761 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:05:52.142273 18700 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.142367 18808 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.135722 18726 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.168938 15586 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:52.155293 15517 rpcz_store.cc:269] 0709 13:05:47.088923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.181468 (+ 92545us) service_pool.cc:224] Handling call
0709 13:05:52.141203 (+4959735us) spinlock_profiling.cc:243] Waited 4.55 s on lock 0x7b5400211e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:52.148562 (+  7359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10461767552}
I20260709 13:05:52.165894 18590 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.150753 18624 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.166906 15556 connection.cc:256] RPC call timeout handler was delayed by -2.6587724739999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 13:05:52.177932 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 239057us
I20260709 13:05:52.180003 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:52.183430 15556 connection.cc:256] RPC call timeout handler was delayed by -2.5669724739999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:05:52.184298 15556 connection.cc:256] RPC call timeout handler was delayed by -2.5324755530000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:05:52.184728 15556 connection.cc:256] RPC call timeout handler was delayed by -2.4406755530000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:05:52.185127 15556 connection.cc:256] RPC call timeout handler was delayed by -2.4316755529999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:05:52.185531 15556 connection.cc:256] RPC call timeout handler was delayed by -2.4136755529999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 13:05:52.185928 15556 connection.cc:256] RPC call timeout handler was delayed by -2.3956755530000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:05:52.186316 15556 connection.cc:256] RPC call timeout handler was delayed by -2.37485199799994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:05:52.186720 15556 connection.cc:256] RPC call timeout handler was delayed by -2.3389755529999547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:05:52.187114 15556 connection.cc:256] RPC call timeout handler was delayed by -2.1814755530000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:05:52.187512 15556 connection.cc:256] RPC call timeout handler was delayed by -2.0329755530000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 13:05:52.188277 15556 connection.cc:256] RPC call timeout handler was delayed by -1.9177755529999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
I20260709 13:05:52.174017 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:52.171772 15592 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.192546 15515 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:05:52.194146 18624 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.165419 18361 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.170893 18729 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.179757 18592 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:05:52.189431 18590 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.200524 18759 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:52.201480 18411 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.202181 18821 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:52.145511 18815 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:52.224071 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1750) took 4861 ms. Trace:
I20260709 13:05:52.223178 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:52.164129 18840 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.173645 18766 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:52.206009 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54834.3us
I20260709 13:05:52.176328 18696 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.208415 18691 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:52.209308 15555 leader_election.cc:336] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.772s (SENT)
I20260709 13:05:52.203078 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:52.213382 15511 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:52.141316 18695 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:52.205365 18361 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.224841 15515 rpcz_store.cc:276] 0709 13:05:47.331616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.141009 (+4809393us) service_pool.cc:224] Handling call
0709 13:05:52.188146 (+ 47137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.193055 (+  4909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.193343 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.206816 18751 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:52.221124 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:52.229193 15588 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:52.230301 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:52.147238 18755 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.231757 15591 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.232453 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:52.237813 15516 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:52.238258 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2166) took 4142 ms. Trace:
I20260709 13:05:52.238899 18726 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.234944 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:52.239667 15583 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:52.241519 15583 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:52.241840 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 592) took 4556 ms. Trace:
I20260709 13:05:52.242937 15583 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:52.243117 18766 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:52.243706 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 591) took 4586 ms. Trace:
I20260709 13:05:52.243778 18766 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:52.244621 18766 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.230701 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 589) took 4580 ms. Trace:
I20260709 13:05:52.245667 15509 rpcz_store.cc:276] 0709 13:05:47.650477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.141510 (+4491033us) service_pool.cc:224] Handling call
0709 13:05:52.178410 (+ 36900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.230333 (+ 51923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.230377 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.230426 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:52.230460 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.230523 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.230645 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.229502 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 588) took 4897 ms. Trace:
W20260709 13:05:52.236922 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.238271 15556 leader_election.cc:400] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:05:52.232928 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:52.247100 15556 leader_election.cc:403] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:05:52.247891 15588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2159) took 4166 ms (client timeout 1759 ms). Trace:
I20260709 13:05:52.242450 15511 rpcz_store.cc:276] 0709 13:05:47.685283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.240464 (+4555181us) service_pool.cc:224] Handling call
0709 13:05:52.240958 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.241205 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.241336 (+   131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.241461 (+   125us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:52.241519 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.241612 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.241760 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.245594 18590 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:52.252363 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 110801us
I20260709 13:05:52.254715 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 593) took 4553 ms. Trace:
I20260709 13:05:52.254843 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:52.259954 15443 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:52.261049 15443 pending_rounds.cc:85] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 6
I20260709 13:05:52.261420 15443 pending_rounds.cc:107] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:52.261502 18523 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:52.261860 15443 raft_consensus.cc:2889] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.224061 18700 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.262437 18523 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:52.262887 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.263600 15438 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:52.263862 18666 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:52.264362 18666 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:52.264674 18700 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.264961 18815 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:52.265509 18666 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.255815 18691 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:52.268507 18717 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:52.269203 18717 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:52.245098 15517 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:05:52.256583 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.257481 18802 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.257725 18674 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.258258 18761 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:52.259449 18755 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.261942 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.266155 18624 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.254899 18729 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:52.256255 15441 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:52.287827 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:52.252267 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:52.244253 15516 rpcz_store.cc:276] 0709 13:05:47.657664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.238704 (+4581040us) service_pool.cc:224] Handling call
0709 13:05:52.239097 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.239303 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.239328 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.239378 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:52.239438 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.239498 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.243625 (+  4127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.272696 15513 rpcz_store.cc:276] 0709 13:05:47.701661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.253578 (+4551917us) service_pool.cc:224] Handling call
0709 13:05:52.254041 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.254346 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.254372 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.254433 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:52.254471 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.254525 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.254649 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.247288 15518 rpcz_store.cc:276] 0709 13:05:47.327642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.138016 (+4810374us) service_pool.cc:224] Handling call
0709 13:05:52.188611 (+ 50595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.224311 (+ 35700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.224349 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.224399 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:52.224428 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.224499 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.224651 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:52.249454 15588 rpcz_store.cc:269] 0709 13:05:48.081849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.082004 (+   155us) service_pool.cc:224] Handling call
0709 13:05:52.234063 (+4152059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.257143 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:52.270404 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:52.286530 15589 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:52.286870 15512 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:05:52.289134 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.286639 15514 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:52.270229 18762 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:05:52.292202 18696 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:52.238708 15590 rpcz_store.cc:276] 0709 13:05:48.095442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.095972 (+   530us) service_pool.cc:224] Handling call
0709 13:05:48.096313 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.848038 (+3751725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.848095 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.849302 (+  1207us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.887060 (+ 37758us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:51.887124 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.910591 (+ 23467us) spinlock_profiling.cc:243] Waited 3.53 s on lock 0x7b54001de2d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:51.910639 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.225797 (+315158us) raft_consensus.cc:1685] finished
0709 13:05:52.225821 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.238059 (+ 12238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219808,"raft.queue_time_us":225105,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":8114669312,"thread_start_us":37150,"threads_started":1,"wal-append.queue_time_us":30517}
I20260709 13:05:52.288183 15441 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:52.271826 15340 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 3 to 5, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 5 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.291226 15438 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:52.299358 18674 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:52.307274 18674 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.307886 18674 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:52.310156 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 107241us
I20260709 13:05:52.312215 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:52.312131 15441 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:52.287644 18700 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:52.313555 15441 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:52.313444 18755 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:52.315752 18840 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.316351 18749 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.317833 18840 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:52.320484 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.321964 18696 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.228300 18640 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:52.323009 15585 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:52.325218 18640 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:52.326257 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:52.328195 15585 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:52.336351 15440 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:05:52.337914 18749 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:52.339799 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:52.340036 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 130830us
W20260709 13:05:52.342303 15555 connection.cc:256] RPC call timeout handler was delayed by -3.7123200999999426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.34620000000000006s for a response
W20260709 13:05:52.342785 15555 connection.cc:256] RPC call timeout handler was delayed by -3.5756919550000248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 13:05:52.343108 15555 connection.cc:256] RPC call timeout handler was delayed by -3.5372788429998536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 13:05:52.345000 18695 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:52.346057 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 89029.9us
I20260709 13:05:52.347898 18757 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:52.348351 18757 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.348676 18757 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.351783 18700 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.351972 18696 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:52.352511 18700 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.352779 18696 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:52.355741 15555 connection.cc:256] RPC call timeout handler was delayed by -2.5517127499999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 13:05:52.353334 15515 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:52.356968 18696 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.277781 18717 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.360956 18762 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:52.362133 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:52.365329 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 95135.5us
I20260709 13:05:52.368021 15583 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:52.368299 15556 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:52.369179 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.370728 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.373917 18624 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:52.376891 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.378760 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 594) took 4661 ms. Trace:
I20260709 13:05:52.355193 18700 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.379527 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.387097 18691 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:05:52.389134 15588 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:52.391013 15592 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
W20260709 13:05:52.392207 15555 connection.cc:256] RPC call timeout handler was delayed by -2.4734127499999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:05:52.410951 15555 connection.cc:256] RPC call timeout handler was delayed by -2.4314132239999253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:05:52.411320 15555 connection.cc:256] RPC call timeout handler was delayed by -2.3292057039999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:05:52.411672 15555 connection.cc:256] RPC call timeout handler was delayed by -2.3006127500000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 13:05:52.412073 15555 connection.cc:256] RPC call timeout handler was delayed by -2.2088127499999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 13:05:52.395671 15587 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:05:52.404156 15509 rpcz_store.cc:276] 0709 13:05:47.717234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.286232 (+4568998us) service_pool.cc:224] Handling call
0709 13:05:52.378131 (+ 91899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.378410 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.378435 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.378495 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:52.378525 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.378580 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.378692 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.404824 15441 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:05:52.407497 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 590) took 4751 ms. Trace:
I20260709 13:05:52.417382 15515 rpcz_store.cc:276] 0709 13:05:47.650844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.273030 (+4622186us) service_pool.cc:224] Handling call
0709 13:05:52.353127 (+ 80097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.400371 (+ 47244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.402354 (+  1983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.427608 15514 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:52.428820 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2190) took 4592 ms. Trace:
I20260709 13:05:52.429273 15514 rpcz_store.cc:276] 0709 13:05:47.837062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.294583 (+4457521us) service_pool.cc:224] Handling call
0709 13:05:52.415282 (+120699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.428401 (+ 13119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.428736 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.416898 15441 pending_rounds.cc:85] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 7
I20260709 13:05:52.433826 15441 pending_rounds.cc:107] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:05:52.434149 15441 raft_consensus.cc:2889] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.434880 15591 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
W20260709 13:05:52.436499 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74449.3us
I20260709 13:05:52.444168 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:52.409334 18840 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:52.447887 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 108238us
I20260709 13:05:52.479724 18840 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.485097 15509 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:52.485297 18840 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:52.485841 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2192) took 4578 ms. Trace:
I20260709 13:05:52.486200 15509 rpcz_store.cc:276] 0709 13:05:47.907254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.435065 (+4527811us) service_pool.cc:224] Handling call
0709 13:05:52.484680 (+ 49615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.485517 (+   837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.485773 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.487818 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1888) took 5101 ms. Trace:
I20260709 13:05:52.484298 15516 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:05:52.484297 18717 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.489472 15515 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:05:52.488333 15439 rpcz_store.cc:276] 0709 13:05:47.386295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.679225 (+292930us) service_pool.cc:224] Handling call
0709 13:05:47.679720 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.680012 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:47.912024 (+232012us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.286745 (+4374721us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.402110 (+115365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.409198 (+  7088us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:52.432783 (+ 23585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.479901 (+ 47118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.487753 (+  7852us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126195,"prepare.queue_time_us":326452,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":6257,"raft.queue_time_us":144153,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":8363,"thread_start_us":4513733,"threads_started":3,"wal-append.queue_time_us":346564}
I20260709 13:05:52.490082 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2193) took 4582 ms. Trace:
I20260709 13:05:52.490520 15515 rpcz_store.cc:276] 0709 13:05:47.907611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.418403 (+4510792us) service_pool.cc:224] Handling call
0709 13:05:52.489094 (+ 70691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.489808 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.490020 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:52.491179 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 53510.5us
I20260709 13:05:52.493080 18411 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:52.493615 18411 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.494035 18411 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:52.492985 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48921us
I20260709 13:05:52.495784 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:52.496869 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:52.497738 18624 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:52.498502 18624 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:52.445205 18640 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:52.499869 18624 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.500732 18640 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:52.500927 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.501196 18640 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:52.502435 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.500406 15514 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:52.503280 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2197) took 4559 ms. Trace:
I20260709 13:05:52.503628 15514 rpcz_store.cc:276] 0709 13:05:47.943475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.480607 (+4537132us) service_pool.cc:224] Handling call
0709 13:05:52.500099 (+ 19492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.503002 (+  2903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.503216 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.432502 18749 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:05:52.503527 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.506496 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.508486 15509 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:52.509341 15516 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.509745 15516 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.516984 15517 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:52.517532 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2198) took 4536 ms. Trace:
I20260709 13:05:52.517779 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2205) took 1283 ms. Trace:
W20260709 13:05:52.518080 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.517956 15509 rpcz_store.cc:276] 0709 13:05:47.973406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.487050 (+4513644us) service_pool.cc:224] Handling call
0709 13:05:52.487425 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.509189 (+ 21764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.509464 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.518793 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:52.520185 15515 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:52.517571 15443 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:05:52.522748 15509 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:52.518142 15517 rpcz_store.cc:276] 0709 13:05:51.234729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.514565 (+1279836us) service_pool.cc:224] Handling call
0709 13:05:52.516755 (+  2190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.517518 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.517726 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.533242 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2200) took 4520 ms. Trace:
I20260709 13:05:52.533699 15515 rpcz_store.cc:276] 0709 13:05:48.013218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.491412 (+4478194us) service_pool.cc:224] Handling call
0709 13:05:52.515203 (+ 23791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.524736 (+  9533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.533168 (+  8432us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:52.532896 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 368165us
W20260709 13:05:52.537786 16146 connection.cc:256] RPC call timeout handler was delayed by -3.484053925000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:05:52.538218 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44336.8us
W20260709 13:05:52.538277 16146 connection.cc:256] RPC call timeout handler was delayed by -3.4759539249999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:05:52.549343 16146 connection.cc:256] RPC call timeout handler was delayed by -3.3562539250000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260709 13:05:52.553289 15509 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:52.554950 15513 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:52.544009 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:52.560194 15517 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:52.563769 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2204) took 1330 ms. Trace:
I20260709 13:05:52.564401 15513 rpcz_store.cc:276] 0709 13:05:51.234156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.512725 (+1278569us) service_pool.cc:224] Handling call
0709 13:05:52.525212 (+ 12487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.563337 (+ 38125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.563674 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:52.532538 18761 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:05:52.554661 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd6a0 after lost signal to thread 14296
W20260709 13:05:52.580010 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08001b08e0 after lost signal to thread 15375
I20260709 13:05:52.444986 18757 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:52.582618 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.582841 15584 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:05:52.552744 18762 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:52.588184 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56300.5us
I20260709 13:05:52.553157 18749 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.600392 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:52.601204 18862 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:05:52.604527 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08002de2a0 after lost signal to thread 15467
W20260709 13:05:52.607481 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08002de2c0 after lost signal to thread 15468
I20260709 13:05:52.609972 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:52.607151 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:52.613457 18766 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:52.615489 15555 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 3.462s (SENT)
I20260709 13:05:52.623109 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:52.625828 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08000db680 after lost signal to thread 15542
W20260709 13:05:52.626264 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea100 after lost signal to thread 15543
I20260709 13:05:52.624567 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:52.562161 18691 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:05:52.634660 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.635251 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.617573 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:52.640997 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 126087us
I20260709 13:05:52.634783 15340 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 6 to 7, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:05:52.646493 16203 debug-util.cc:398] Leaking SignalData structure 0x7b0800354d60 after lost signal to thread 15616
W20260709 13:05:52.648485 16203 debug-util.cc:398] Leaking SignalData structure 0x7b080031b840 after lost signal to thread 16206
W20260709 13:05:52.648888 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf340 after lost signal to thread 16207
I20260709 13:05:52.615245 18808 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:05:52.616107 18766 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.617265 18592 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:52.635031 18751 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:52.666361 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.642688 18802 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:52.642938 18590 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:52.619668 18749 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:52.680395 18858 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:05:52.666831 18515 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:52.645934 18700 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.688941 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 97758.9us
I20260709 13:05:52.667961 18751 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.676785 18590 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:52.717118 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 70884.5us
I20260709 13:05:52.688725 18592 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:52.707144 18515 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.714504 18751 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:52.723851 18590 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:52.741509 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 163118us
I20260709 13:05:52.741194 18515 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:52.758327 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 142916us
W20260709 13:05:52.758050 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 98106us
I20260709 13:05:52.754601 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2195) took 4843 ms. Trace:
I20260709 13:05:52.747753 18666 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:52.764863 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 147470us
I20260709 13:05:52.736409 18700 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.761632 15518 rpcz_store.cc:276] 0709 13:05:47.921000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.428708 (+4507708us) service_pool.cc:224] Handling call
0709 13:05:52.487919 (+ 59211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.488191 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:52.586007 (+ 97816us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.754174 (+168167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.754230 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:52.754304 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.754389 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.754530 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":222569,"prepare.run_cpu_time_us":191,"prepare.run_wall_time_us":3722,"raft.queue_time_us":2576,"thread_start_us":214920,"threads_started":2}
W20260709 13:05:52.783299 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.752792 18761 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:52.783228 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1744) took 5571 ms. Trace:
W20260709 13:05:52.791221 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.787714 15510 rpcz_store.cc:276] 0709 13:05:47.211512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.090048 (+4878536us) service_pool.cc:224] Handling call
0709 13:05:52.144576 (+ 54528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.243963 (+ 99387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.243998 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.244556 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.409054 (+164498us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:52.409115 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.518240 (+109125us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b54003dca54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:52.518294 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.769082 (+250788us) raft_consensus.cc:1685] finished
0709 13:05:52.769105 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.783156 (+ 14051us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4558,"raft.queue_time_us":11540,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"spinlock_wait_cycles":186907392,"thread_start_us":163929,"threads_started":1,"wal-append.queue_time_us":295178}
I20260709 13:05:52.778115 18873 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:52.783053 18757 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.806186 15516 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.809578 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2172) took 1290 ms. Trace:
I20260709 13:05:52.810281 15586 rpcz_store.cc:276] 0709 13:05:51.519160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.198610 (+679450us) service_pool.cc:224] Handling call
0709 13:05:52.199340 (+   730us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:52.324204 (+124864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.324267 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:52.325129 (+   862us) log.cc:844] Serialized 52 byte log entry
0709 13:05:52.532016 (+206887us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:52.657995 (+125979us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.658303 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.687901 (+ 29598us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540015e5d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:52.687958 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.793637 (+105679us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b1800408760. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:52.809318 (+ 15681us) raft_consensus.cc:1685] finished
0709 13:05:52.809344 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.809502 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220469,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":4275,"raft.run_cpu_time_us":536,"raft.run_wall_time_us":8338,"spinlock_wait_cycles":292811008,"thread_start_us":313892,"threads_started":2,"wal-append.queue_time_us":343520}
I20260709 13:05:52.826898 18870 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:52.839162 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:52.862720 18726 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:52.870935 18592 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:52.849512 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:52.884537 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2201) took 4840 ms. Trace:
I20260709 13:05:52.885296 15514 rpcz_store.cc:276] 0709 13:05:48.046643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.504484 (+4457841us) service_pool.cc:224] Handling call
0709 13:05:52.504920 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.505695 (+   775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.505726 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.506291 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.689317 (+183026us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:52.689360 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.689434 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.884218 (+194784us) raft_consensus.cc:1685] finished
0709 13:05:52.884249 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.884450 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":182568,"threads_started":1,"wal-append.queue_time_us":235610}
I20260709 13:05:52.806113 18873 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:52.895715 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:52.895752 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:52.898519 15584 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:05:52.893602 18749 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:52.845376 18757 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:05:52.902731 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2203) took 4833 ms. Trace:
I20260709 13:05:52.903169 15511 rpcz_store.cc:276] 0709 13:05:48.069857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.506893 (+4437036us) service_pool.cc:224] Handling call
0709 13:05:52.507425 (+   532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:52.507989 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.508020 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:52.536746 (+ 28726us) log.cc:844] Serialized 52 byte log entry
0709 13:05:52.744574 (+207828us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:52.759662 (+ 15088us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.796911 (+ 37249us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.797179 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.797270 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.902502 (+105232us) raft_consensus.cc:1685] finished
0709 13:05:52.902523 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.902666 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41194,"prepare.queue_time_us":55882,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":1780,"raft.queue_time_us":3429,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":16338,"thread_start_us":134687,"threads_started":1,"wal-append.queue_time_us":306391}
I20260709 13:05:52.877686 18874 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:52.906006 18695 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:52.944283 18695 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:05:52.926327 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 90332.9us
W20260709 13:05:52.957123 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.962884 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:52.963348 18523 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:52.964066 18523 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:52.944324 18874 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:52.967013 18874 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.968020 18523 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:52.967410 18695 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:52.969182 18640 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:52.964584 18674 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.005s
W20260709 13:05:52.971165 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.970861 18674 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.938433 18590 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.973428 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:52.974697 16179 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:52.975387 18590 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.976472 16182 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:52.976823 18749 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.977370 18749 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.977548 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:52.936432 18761 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.980674 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:52.973665 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:52.981308 15443 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.983511 18877 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:52.980698 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:52.973759 18674 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:52.988484 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:52.993892 18873 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:52.984292 18766 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:05:53.030418 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2181) took 1507 ms. Trace:
W20260709 13:05:53.032285 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 162241us
I20260709 13:05:53.024670 15443 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
W20260709 13:05:53.034124 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.035032 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:53.026829 18411 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.005s
I20260709 13:05:53.030993 15589 rpcz_store.cc:276] 0709 13:05:51.522733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.291070 (+768337us) service_pool.cc:224] Handling call
0709 13:05:52.402767 (+111697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.407471 (+  4704us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:52.727846 (+320375us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.786935 (+ 59089us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b18004601e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a 00007fcf7bd61a2a
0709 13:05:53.028497 (+241562us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.028553 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:53.028607 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.030210 (+  1603us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.030359 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":298439,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2024,"raft.queue_time_us":6449,"spinlock_wait_cycles":11156352,"thread_start_us":513752,"threads_started":2}
I20260709 13:05:52.983352 18515 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:53.028950 18870 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:53.018149 18840 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.029502 18762 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:53.039568 18674 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:53.047190 18640 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:53.102283 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 317584us
I20260709 13:05:53.030068 18751 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:53.052448 18411 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:53.102810 18873 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:53.119982 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2191) took 5246 ms. Trace:
I20260709 13:05:53.128875 18515 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:53.129719 18515 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:53.103201 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 129640us
I20260709 13:05:53.100502 18870 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:53.144400 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.127206 15512 rpcz_store.cc:276] 0709 13:05:47.874103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.296863 (+4422760us) service_pool.cc:224] Handling call
0709 13:05:52.476638 (+179775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.496022 (+ 19384us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:52.743059 (+247037us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.119591 (+376532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.119646 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:53.119702 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.119775 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.119912 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26011,"prepare.queue_time_us":246011,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":71681,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":12834,"spinlock_wait_cycles":636032,"thread_start_us":574856,"threads_started":3,"wal-append.queue_time_us":364742}
I20260709 13:05:53.110427 18674 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:53.164140 18840 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:53.165038 18523 consensus_queue.cc:1059] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:53.166599 18523 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:53.169031 18757 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.172089 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:53.156423 18696 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:53.177371 18696 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.179801 18729 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:53.181310 18751 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:53.182168 18411 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:53.175652 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 128943us
I20260709 13:05:53.113622 18808 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:05:53.203467 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 91593.6us
W20260709 13:05:53.208036 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74066.5us
I20260709 13:05:53.208531 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:53.209225 15443 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:53.211612 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 84479.1us
I20260709 13:05:53.212779 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:53.216717 15589 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:53.219648 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:53.220286 15509 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.224823 15443 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:53.226694 18411 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:53.227355 18411 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:53.227583 18696 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:53.228690 15516 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:53.228423 18411 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.229202 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40676 (request call id 2196) took 5307 ms. Trace:
I20260709 13:05:53.229532 15516 rpcz_store.cc:276] 0709 13:05:47.921405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.446456 (+4525051us) service_pool.cc:224] Handling call
0709 13:05:53.227438 (+780982us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5400377dd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd4ea3d 00007fcf80d1ecd0 00007fcf7a2a3254 00007fcf7a2a31e2 00007fcf7a2a3111 00007fcf7a2a308c 00007fcf7a2a2342 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:53.229109 (+  1671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47541504}
I20260709 13:05:53.233108 18592 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:53.241976 15509 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:05:53.171425 18640 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:05:53.216506 18870 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:53.245640 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:53.247932 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.252815 15556 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:53.257787 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 50278.5us
I20260709 13:05:53.233649 18592 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:53.243913 18885 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:53.262611 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.249220 18815 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:53.269618 18674 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.268252 18881 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:53.234225 18762 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.267100 18882 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:53.261672 18808 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:53.292856 18808 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:53.288566 18592 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:53.272316 18815 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.297523 18592 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:53.265038 18885 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:53.291703 18515 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:53.296309 18882 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:05:53.310456 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48261.7us
I20260709 13:05:53.315691 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:53.317008 15589 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:53.317816 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.318645 15442 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:53.319284 18815 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:53.325201 18881 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:05:53.327780 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 63332us
I20260709 13:05:53.329389 18808 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:53.335098 18666 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:53.346290 18666 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:53.335628 18523 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:05:53.350039 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 83985.9us
I20260709 13:05:53.357894 15407 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:53.364290 18882 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.305624 18885 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.369217 18885 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.347472 18666 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.373584 18666 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:53.378814 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:53.380312 15589 raft_consensus.cc:2410] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:53.387012 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:53.388523 18902 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:53.394076 18881 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.401484 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:53.402747 15584 raft_consensus.cc:2410] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:05:53.405619 18871 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.633s	user 0.013s	sys 0.003s
I20260709 13:05:53.406736 18755 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:53.408596 18902 raft_consensus.cc:697] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:53.410787 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:53.412103 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:53.446055 15516 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:53.412444 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:53.447021 15511 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:53.413226 18886 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:53.448881 18886 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:53.449203 15585 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:53.449985 18886 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:53.452186 15584 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:53.414969 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:53.415524 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:53.415518 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.416209 15509 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:53.430161 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:53.451252 18886 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.405650 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:53.463195 15589 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:05:53.441219 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54309.7us
W20260709 13:05:53.419528 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.474691 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:53.481110 15512 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:53.477620 15555 leader_election.cc:336] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.542s (SENT)
I20260709 13:05:53.482738 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:53.479848 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:53.445281 18755 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:53.499820 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.497128 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:53.500882 15443 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:53.501083 15585 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.503305 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:53.504252 15516 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.424225 18761 consensus_queue.cc:1059] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:05:53.506003 16146 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:53.517261 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.512766 15442 raft_consensus.cc:1217] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 13:05:53.494985 18899 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:53.524031 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.525097 15443 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:53.536142 15442 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:05:53.545511 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.592192 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:53.595803 16176 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:05:53.600572 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 123024us
I20260709 13:05:53.601650 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:53.604669 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:53.607362 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:53.608234 16182 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:53.612741 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:53.616360 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.603s (SENT)
I20260709 13:05:53.616952 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:53.620774 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.521042 18674 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:53.592198 18815 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:05:53.533614 18899 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:53.621889 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:05:53.672887 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.673669 18624 raft_consensus.cc:3055] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:53.674122 18624 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:53.622743 18755 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.676779 18755 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:53.612214 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:53.636897 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.679474 15442 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:53.613526 16179 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:53.644577 15516 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:53.684969 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:53.686152 15516 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:05:53.637758 15482 connection.cc:256] RPC call timeout handler was delayed by -4.7059782050000649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 13:05:53.688333 15482 connection.cc:256] RPC call timeout handler was delayed by -4.647478205000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:05:53.689194 15482 connection.cc:256] RPC call timeout handler was delayed by -4.5394782050000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:05:53.689572 15482 connection.cc:256] RPC call timeout handler was delayed by -4.5295782050000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:05:53.689884 15482 connection.cc:256] RPC call timeout handler was delayed by -4.2647313940000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:05:53.690232 15482 connection.cc:256] RPC call timeout handler was delayed by -4.2406782050001084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 13:05:53.690541 15482 connection.cc:256] RPC call timeout handler was delayed by -4.2406782050001084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 13:05:53.520255 18872 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:53.694279 15585 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:53.697410 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:53.698271 15516 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:05:53.699077 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.675107 18624 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.701071 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.552783 18691 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:05:53.622792 18896 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:53.622879 18887 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:53.705293 15437 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:53.705912 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 104432us
I20260709 13:05:53.639247 18766 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:53.661484 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:53.683519 18808 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:53.637547 18894 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.704473 18815 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:53.665689 18899 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.709578 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:53.710155 15443 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:53.714304 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:53.724905 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:53.725126 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.727748 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:53.696350 18872 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.731433 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:53.739115 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.709600 18624 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.739250 15442 raft_consensus.cc:2368] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9.
I20260709 13:05:53.741693 15437 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:53.738552 15439 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:53.748360 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:53.746052 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 45946.5us
I20260709 13:05:53.753811 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:53.758258 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:53.762106 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.763458 15441 raft_consensus.cc:2368] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9.
I20260709 13:05:53.733819 18896 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:53.764441 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:53.740775 18872 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.736683 18887 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:53.742645 18808 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:53.782063 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:53.782348 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:53.782871 15437 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:53.783617 15442 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:53.786106 18700 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:53.751451 18695 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.743871 18894 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.807371 18894 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:53.807624 18899 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:53.792785 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.803267 18749 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:53.732398 18766 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.797924 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:53.799108 18869 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.799846 18874 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:53.804181 18887 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:53.804838 18896 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:53.816488 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 52147.5us
I20260709 13:05:53.860456 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:53.831427 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:53.834661 15435 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.839665 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:53.848917 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 136152us
I20260709 13:05:53.665223 18902 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:53.852357 18874 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:53.868197 18874 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:53.873028 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.878563 15590 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:53.862346 15591 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:05:53.882112 15555 leader_election.cc:336] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.661s (SENT)
I20260709 13:05:53.883828 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:53.884581 15588 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:53.886590 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:53.887301 15584 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:53.891249 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:53.893492 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:53.895108 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:53.896056 15583 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:53.867332 18912 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:05:53.917529 15586 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:53.892110 18411 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:53.919647 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 68447.7us
I20260709 13:05:53.903872 18815 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:53.932329 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:53.933475 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 70916.3us
I20260709 13:05:53.857788 18869 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:53.947817 15583 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:53.950825 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:53.954823 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:53.956082 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:53.923977 18411 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:53.965137 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:53.972173 18411 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.972537 15441 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:53.969368 16180 raft_consensus.cc:1217] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Deduplicated request from leader. Original: 7.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 13:05:53.975766 16180 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:05:53.939597 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:53.988478 18915 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:05:53.989439 18869 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:53.990298 15515 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:53.993119 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:53.994325 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:53.995990 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:54.012138 18870 raft_consensus.cc:3055] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:54.016508 18808 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:54.017241 18766 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:54.018205 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:54.020797 18885 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.648s	user 0.013s	sys 0.001s
I20260709 13:05:53.982929 18894 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:53.981228 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:54.063234 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:54.025382 15589 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:54.029454 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.066222 15441 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:54.025480 18695 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:54.032392 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51774us
I20260709 13:05:54.038741 15437 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
W20260709 13:05:54.055524 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.963795 18666 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:54.064242 15583 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:54.070940 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 137593us
I20260709 13:05:54.073390 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.080139 15437 raft_consensus.cc:2410] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:05:54.081041 15589 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:54.086328 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:54.037979 18870 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:54.089120 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:54.097503 18879 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:54.102183 18749 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:54.104502 18886 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.000s
I20260709 13:05:54.104813 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.186054 15517 raft_consensus.cc:2410] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:54.106681 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1921) took 1127 ms. Trace:
I20260709 13:05:54.107924 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.109196 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.111340 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.187566 15440 rpcz_store.cc:276] 0709 13:05:52.979407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.980364 (+   957us) service_pool.cc:224] Handling call
0709 13:05:54.106403 (+1126039us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54003ee254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:54.106572 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065121280}
I20260709 13:05:54.188418 15583 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:54.189425 15435 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:54.191700 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.194657 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:54.185225 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.073015 18666 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:54.200476 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 180669us
I20260709 13:05:54.206178 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:54.207489 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.694s (SENT)
I20260709 13:05:54.210179 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.211407 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.212074 15518 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.212628 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.213840 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.214502 15443 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:54.168473 18885 raft_consensus.cc:2764] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:54.210687 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.236229 15513 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.215181 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.234998 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.238502 15589 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:54.240056 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.241448 15514 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:54.181391 18879 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:54.249007 15588 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:05:54.253584 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56823.8us
I20260709 13:05:54.254643 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.255373 15517 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.209652 18666 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.259394 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.087018 18695 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:54.261103 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.789s (SENT)
I20260709 13:05:54.265247 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.262851 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.268210 15588 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:54.268805 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.266754 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.276438 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:54.258777 18905 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:54.280046 15589 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:54.256433 18815 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:54.287861 15517 raft_consensus.cc:2410] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:05:54.295348 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.300112 15436 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:05:54.304037 15442 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:05:54.303099 15437 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:54.336699 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.327731 18882 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.365558 15517 raft_consensus.cc:2410] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:54.344331 18815 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:05:54.390698 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.390729 16176 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:54.307622 18879 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.384500 18882 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.330283 18874 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:54.401842 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.431454 15509 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.417835 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.394377 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.420408 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.433678 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.418299 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.434558 15517 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.435164 15511 raft_consensus.cc:2368] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:05:54.433574 15515 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:54.442739 15518 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:54.444290 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:54.450044 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.449569 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.451282 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.284479 18870 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.454523 16179 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:54.456174 15518 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.457052 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.458674 15517 raft_consensus.cc:2368] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:54.458740 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:54.419142 18755 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.007s
W20260709 13:05:54.419770 18872 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.004s
I20260709 13:05:54.464398 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:54.412012 18925 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
W20260709 13:05:54.396427 18926 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:05:54.466449 15515 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.468901 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.474516 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:54.418301 18882 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:54.413259 18695 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:54.504339 15443 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:54.501158 15437 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:54.508143 15510 raft_consensus.cc:2368] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:05:54.527340 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.530112 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.534137 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:54.534888 15591 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:54.533391 15510 raft_consensus.cc:2368] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:05:54.541352 15513 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:54.542562 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.543232 15513 raft_consensus.cc:2376] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8. Re-sending same reply.
I20260709 13:05:54.477038 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:54.509155 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 254254us
I20260709 13:05:54.509217 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.501595 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.500924 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:54.552342 15555 leader_election.cc:336] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.830s (SENT)
I20260709 13:05:54.426214 18899 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:54.404168 18879 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.513149 15511 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
W20260709 13:05:54.455156 18624 consensus_meta.cc:287] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.703s	user 0.005s	sys 0.009s
W20260709 13:05:54.516160 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 107703us
I20260709 13:05:54.552860 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.551211 15515 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:05:54.517895 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:54.558233 15434 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:54.560168 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:54.560326 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.562376 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.563802 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:54.520279 18411 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.545s	user 0.014s	sys 0.000s
W20260709 13:05:54.569558 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.572501 15515 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:54.574235 15516 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.483196 18674 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.576264 18874 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:54.576112 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.589910 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:54.578751 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 60972.8us
I20260709 13:05:54.576177 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.580178 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.581148 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.582813 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:54.593271 15586 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:54.593840 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.595376 15513 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.596602 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.583766 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.584024 15406 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:54.600068 15510 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.584561 15591 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:05:54.583237 16178 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEARNER]: Advancing to term 5
I20260709 13:05:54.586239 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.586265 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.602437 15588 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:54.588604 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.591765 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:54.603384 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.603083 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.605221 15406 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.608816 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.609596 15588 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:05:54.610446 15511 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:54.587222 18592 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:54.587787 18899 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.609015 18902 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:54.618906 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66612.8us
I20260709 13:05:54.595042 18869 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:54.520337 18872 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:54.631819 15513 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:54.622473 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:54.651310 15555 leader_election.cc:336] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.834s (SENT)
I20260709 13:05:54.582912 18674 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.655014 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:54.661492 18874 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.656131 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.657253 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.692154 18874 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.693207 15509 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.693470 15439 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:54.661659 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.694568 15516 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.694738 18624 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:54.654222 15517 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:54.695503 15517 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:54.664851 16178 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:05:54.664985 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 73288.9us
I20260709 13:05:54.587342 18411 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:54.673079 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.604436 18951 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:54.675058 15592 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:54.676451 15584 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:54.677428 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.684569 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.684994 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.688159 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:54.690948 18872 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:54.693543 18674 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:54.663352 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.699621 15586 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:54.674252 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:54.699818 16146 leader_election.cc:400] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9.
I20260709 13:05:54.696578 15517 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.709038 15517 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:54.709436 16146 leader_election.cc:400] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9.
I20260709 13:05:54.709834 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:54.649766 18515 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:54.657191 18869 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.723029 15591 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:05:54.702694 18928 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.395s	user 0.002s	sys 0.002s
I20260709 13:05:54.725900 15588 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:54.702769 18946 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.701411 18951 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.728391 15584 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:54.700698 18899 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:05:54.740154 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134976us
I20260709 13:05:54.746652 15406 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:54.749281 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:54.750145 15589 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.755527 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1783) took 1052 ms. Trace:
I20260709 13:05:54.756091 15435 rpcz_store.cc:276] 0709 13:05:53.703777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.703953 (+   176us) service_pool.cc:224] Handling call
0709 13:05:54.755314 (+1051361us) spinlock_profiling.cc:243] Waited 97.4 ms on lock 0x7b5400069d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:54.755451 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223982848}
W20260709 13:05:54.757304 18937 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
I20260709 13:05:54.729246 18815 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.767009 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2239) took 1162 ms. Trace:
I20260709 13:05:54.769378 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1785) took 1024 ms. Trace:
I20260709 13:05:54.769877 15439 rpcz_store.cc:276] 0709 13:05:53.745149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.745291 (+   142us) service_pool.cc:224] Handling call
0709 13:05:54.769112 (+1023821us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400252954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:54.769259 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852101376}
W20260709 13:05:54.772575 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.722321 18869 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:54.784118 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:54.785945 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:54.786226 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.790733 15590 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:05:54.794267 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 143015us
I20260709 13:05:54.796801 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:54.779703 15512 rpcz_store.cc:276] 0709 13:05:53.604228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.062781 (+458553us) service_pool.cc:224] Handling call
0709 13:05:54.078731 (+ 15950us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:54.079324 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:54.210715 (+131391us) log.cc:844] Serialized 14 byte log entry
0709 13:05:54.332545 (+121830us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:54.338205 (+  5660us) log.cc:844] Serialized 52 byte log entry
0709 13:05:54.338385 (+   180us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:54.338643 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 13:05:54.364844 (+ 26201us) log.cc:844] Serialized 14 byte log entry
0709 13:05:54.766182 (+401338us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b1800454120. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78be4c0a 00007fcf82324219 00007fcf78c6ca40 00007fcf78c674e4 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd61716 00007fcf7bd72287 00007fcf7bd72208
0709 13:05:54.766466 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.766668 (+   202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:54.766716 (+    48us) raft_consensus.cc:1685] finished
0709 13:05:54.766732 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.766923 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52972,"prepare.queue_time_us":126009,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":3347,"raft.queue_time_us":434325,"raft.run_cpu_time_us":457,"raft.run_wall_time_us":40632,"spinlock_wait_cycles":76311040,"thread_start_us":65557,"threads_started":1,"wal-append.queue_time_us":258250}
W20260709 13:05:54.797564 15555 leader_election.cc:336] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.734s (SENT)
I20260709 13:05:54.797664 15510 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.798055 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.801923 15515 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:54.803242 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.799068 15517 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:05:54.806030 15517 pending_rounds.cc:85] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:05:54.806318 15517 pending_rounds.cc:107] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:05:54.806869 18749 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.807853 18749 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.808373 18749 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.811017 15511 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:54.811656 15515 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:54.812075 15515 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:54.812508 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.813478 15511 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:54.814489 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:54.810971 18749 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:54.815286 15511 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:54.799705 18755 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.779984 18695 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.818120 18755 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.818207 18695 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:54.818203 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44802.2us
I20260709 13:05:54.821022 18755 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:54.821467 18695 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:54.822100 18954 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:54.772914 18946 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.822822 18872 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:54.823160 15511 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:54.824513 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.772727 18951 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.828364 15517 raft_consensus.cc:2889] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:54.798054 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.843382 15512 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:54.799777 18902 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:54.842377 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44388.6us
I20260709 13:05:54.826884 18762 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:54.838729 15589 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:54.852989 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:54.850924 15406 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.853142 15513 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:05:54.856904 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 59373.1us
I20260709 13:05:54.849575 18902 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:54.859725 18902 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.859501 18956 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:54.862025 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.796172 18899 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:54.865201 18936 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 13:05:54.851747 18666 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.003s
I20260709 13:05:54.868140 18666 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:54.869329 15438 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:54.869484 18761 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:54.870002 18761 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.870353 18761 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.870417 18945 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:05:54.872936 18666 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:54.851981 15587 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:54.857124 18590 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:54.875694 18590 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:54.876298 18590 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:54.877380 18590 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.799568 18624 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:05:54.879524 15510 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:54.843703 18695 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.881814 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 485) took 1330 ms. Trace:
I20260709 13:05:54.879155 18700 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:54.842196 15511 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:54.845914 18523 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.880009 15407 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:54.900746 18666 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:54.889191 15585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.051s	sys 0.089s
W20260709 13:05:54.902379 15585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.051s	sys 0.090s
I20260709 13:05:54.886590 16177 rpcz_store.cc:276] 0709 13:05:53.551267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.592248 (+ 40981us) service_pool.cc:224] Handling call
0709 13:05:54.880740 (+1288492us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54005f0fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:54.881710 (+   970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422017408}
I20260709 13:05:54.897840 15511 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:54.915231 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:54.917956 15407 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:54.919180 18956 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:05:54.925904 18956 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:54.926399 18956 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.926970 18956 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:54.931247 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 276346us
I20260709 13:05:54.905344 18899 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:54.921692 15511 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:54.936959 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86221.2us
I20260709 13:05:54.898356 18695 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:54.922020 18885 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:54.949705 15511 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.958106 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:54.919595 18666 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:05:54.940810 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2240) took 1318 ms. Trace:
I20260709 13:05:54.960168 15514 rpcz_store.cc:276] 0709 13:05:53.622789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.278117 (+655328us) service_pool.cc:224] Handling call
0709 13:05:54.278440 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.278644 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:54.279189 (+   545us) log.cc:844] Serialized 14 byte log entry
0709 13:05:54.939867 (+660678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:54.939951 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:54.940399 (+   448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.940517 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.940711 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84618,"prepare.queue_time_us":162,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":93541,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":31991,"spinlock_wait_cycles":9628032,"thread_start_us":574805,"threads_started":2,"wal-append.queue_time_us":505316}
I20260709 13:05:54.938555 18954 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:54.939232 18411 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:54.935418 18523 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:05:54.979774 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:54.984344 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 126635us
W20260709 13:05:54.984967 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62448us
W20260709 13:05:54.985785 15555 leader_election.cc:336] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.969s (SENT)
I20260709 13:05:54.986538 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:54.988003 15440 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:54.975095 18749 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.992050 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:54.993486 15438 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:54.941097 18935 consensus_queue.cc:1059] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:05:54.970821 18885 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:54.941021 18755 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:05:54.999918 18870 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.007532 15511 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:05:55.008116 15511 pending_rounds.cc:85] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 3
I20260709 13:05:55.008376 15511 pending_rounds.cc:107] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:05:55.008665 15511 raft_consensus.cc:2889] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:54.967955 18808 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:05:55.012421 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:54.964448 18954 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.013989 18899 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:55.022955 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:55.032655 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46943.7us
W20260709 13:05:55.033818 15555 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.045s (SENT)
I20260709 13:05:55.034379 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:55.032891 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.042057 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:54.995604 18958 raft_consensus.cc:2764] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:55.042603 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:55.047878 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:55.049885 18674 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:05:55.054090 18674 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:55.054697 18674 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:55.055708 18674 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:55.056422 18885 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:55.057391 18674 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.039986 18957 raft_consensus.cc:2764] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:05:55.060400 18957 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:55.060854 18957 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.061224 18957 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:55.063884 18761 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:55.066994 18761 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:55.072220 18894 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:55.072973 18894 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:55.074065 18894 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:55.037580 18411 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:05:55.083833 18749 raft_consensus.cc:3055] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:55.084548 18749 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:55.085927 18749 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:05:55.088057 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.091128 18882 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:55.091878 18882 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:55.092705 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:55.093405 18957 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.102432 18957 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:55.107861 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 69529us
I20260709 13:05:55.044018 18815 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:55.093199 18882 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:55.095489 18897 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:55.097906 18695 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:55.103936 18899 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:55.160894 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 118366us
I20260709 13:05:55.181015 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:05:55.182734 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 148948us
I20260709 13:05:55.190804 15591 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:55.192456 15584 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:55.181824 15583 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:05:55.220445 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 244148us
W20260709 13:05:55.226352 15555 leader_election.cc:336] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.644s (SENT)
I20260709 13:05:55.229667 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:55.145881 18674 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:05:55.140350 18700 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:05:55.277269 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:55.278353 18882 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:55.272647 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:55.280129 15340 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 108) took 11784 ms (client timeout 15000 ms). Trace:
W20260709 13:05:55.262954 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 73366us
I20260709 13:05:55.176206 18958 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:55.280077 15586 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:55.175977 18749 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:55.289410 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:55.299238 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 72928.5us
W20260709 13:05:55.300438 15555 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.757s (SENT)
I20260709 13:05:55.301108 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:55.229223 18815 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.271328 18590 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:55.314409 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:55.316598 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.316686 16182 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:05:55.318157 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:55.319648 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:55.324116 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:55.324951 15586 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:55.326865 15583 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:55.317238 16182 pending_rounds.cc:85] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Aborting all ops after (but not including) 5
I20260709 13:05:55.314787 15515 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.281198 18874 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:55.337435 15555 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.775s (SENT)
W20260709 13:05:55.338207 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.295831 18946 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:55.302445 18523 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:55.345446 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.345039 16177 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEARNER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:05:55.316278 18899 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:55.343997 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 122291us
W20260709 13:05:55.280732 15340 rpcz_store.cc:269] 0709 13:05:43.495869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.496266 (+   397us) service_pool.cc:224] Handling call
0709 13:05:55.279990 (+11783724us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:53.179737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:53.180575 (+   838us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:53.180641 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:05:53.180681 (+    40us) tablet.cc:662] Decoding operations
0709 13:05:53.181691 (+  1010us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:53.181785 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:53.181817 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:05:53.184418 (+  2601us) tablet.cc:701] Row locks acquired
0709 13:05:53.208689 (+ 24271us) write_op.cc:260] PREPARE: finished
0709 13:05:53.232020 (+ 23331us) write_op.cc:270] Start()
0709 13:05:53.232229 (+   209us) write_op.cc:276] Timestamp: P: 1783602353231918 usec, L: 0
0709 13:05:53.232256 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:05:53.233126 (+   870us) log.cc:844] Serialized 2452 byte log entry
0709 13:05:53.779107 (+545981us) op_driver.cc:464] REPLICATION: finished
0709 13:05:53.971769 (+192662us) write_op.cc:301] APPLY: starting
0709 13:05:53.971946 (+   177us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:53.972227 (+   281us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:53.972428 (+   201us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:54.082256 (+109828us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:54.095961 (+ 13705us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:05:54.096039 (+    78us) write_op.cc:312] APPLY: finished
0709 13:05:54.096531 (+   492us) log.cc:844] Serialized 53 byte log entry
0709 13:05:54.096767 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:54.096933 (+   166us) write_op.cc:454] Released schema lock
0709 13:05:54.097022 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:54.097663 (+   641us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:54.097693 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1280736,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":153689,"apply.run_cpu_time_us":4804,"apply.run_wall_time_us":135785,"num_ops":6,"prepare.queue_time_us":232631,"prepare.run_cpu_time_us":16352,"prepare.run_wall_time_us":186566,"raft.queue_time_us":308725,"raft.run_cpu_time_us":46976,"raft.run_wall_time_us":120386,"replication_time_us":546640,"thread_start_us":634508,"threads_started":4,"wal-append.queue_time_us":216001,"wal-append.run_cpu_time_us":118819,"wal-append.run_wall_time_us":1849564}]]}
I20260709 13:05:55.351724 18897 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:55.360766 18897 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:55.335013 16182 pending_rounds.cc:107] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 13:05:55.363924 16182 raft_consensus.cc:2917] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 13:05:55.364497 16182 raft_consensus.cc:2889] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.368439 15591 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:55.370436 18976 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:55.371419 18976 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:55.371768 18976 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:55.372710 18976 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:55.374038 18976 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.381222 18700 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:55.381888 18700 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:55.385360 15515 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:55.386866 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.390672 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:55.394052 15555 leader_election.cc:336] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.799s (SENT)
I20260709 13:05:55.394690 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:55.322191 18815 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.409955 15515 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:05:55.410604 15515 pending_rounds.cc:85] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 4
I20260709 13:05:55.410917 15515 pending_rounds.cc:107] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:05:55.411237 15515 raft_consensus.cc:2889] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.416069 18885 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:55.417730 18972 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:55.418016 18973 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:55.418591 18972 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.421254 18972 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:55.423141 18980 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:55.307411 18958 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.328699 18902 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:55.436074 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 245432us
I20260709 13:05:55.437245 15516 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:55.438980 15516 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:05:55.439589 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 98460.8us
I20260709 13:05:55.440528 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:55.435468 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:55.382931 18700 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:55.446157 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 90967.1us
W20260709 13:05:55.446982 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.886s (SENT)
I20260709 13:05:55.447448 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:55.441429 15591 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:05:55.443473 15515 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:05:55.449774 15515 pending_rounds.cc:85] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:05:55.450059 15515 pending_rounds.cc:107] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:05:55.450325 15515 raft_consensus.cc:2889] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:55.450531 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.404284 18966 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.453226 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:55.457592 15516 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:55.458379 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:55.459115 15587 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:55.459275 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:55.390916 18523 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:55.465116 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.468797 18899 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:55.468891 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:55.469412 18967 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:05:55.471102 18958 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:55.472218 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:55.403775 18761 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:05:55.446053 18968 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.447417 18945 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:55.516906 18969 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:05:55.516799 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 48005.2us
I20260709 13:05:55.517699 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:55.518071 18978 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.455844 18808 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:05:55.518529 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:55.518854 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:55.519513 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:55.518860 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:55.447260 18885 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:05:55.531252 18978 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.531855 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:55.532680 15436 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:05:55.522642 15440 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:55.528502 15441 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:05:55.537417 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 65294.2us
I20260709 13:05:55.538570 15587 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
W20260709 13:05:55.548461 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.550611 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:55.594333 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.658385 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:05:55.659891 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 121639us
I20260709 13:05:55.671572 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:55.679869 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:55.679817 15443 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:55.659271 15436 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:55.474810 18965 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.219s
I20260709 13:05:55.702755 18965 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:55.708499 18411 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:55.711503 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:55.713814 18808 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:55.714923 18951 consensus_meta.cc:287] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.012s
I20260709 13:05:55.715415 18951 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.716907 18523 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:55.717619 18700 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:55.717872 18951 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:55.729162 15440 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
W20260709 13:05:55.719579 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 167221us
I20260709 13:05:55.525869 18980 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:55.778589 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 67180.7us
I20260709 13:05:55.779680 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:55.783130 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.725749 18956 consensus_meta.cc:287] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.784s	user 0.012s	sys 0.000s
W20260709 13:05:55.777261 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 243219us
I20260709 13:05:55.788486 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:55.814494 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.828505 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 381526us
W20260709 13:05:55.845942 15555 leader_election.cc:336] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.078s (SENT)
W20260709 13:05:55.857617 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45375.2us
I20260709 13:05:55.858007 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:55.698045 18872 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:55.786019 18935 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:55.825953 18980 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:55.885699 15436 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:05:55.787776 18762 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:05:55.833851 18978 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:55.892012 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.892513 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 370249us
I20260709 13:05:55.899919 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:55.900707 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:55.876430 18946 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:55.905175 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:55.900697 15587 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:55.800571 18956 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:55.903316 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:05:55.903687 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.881742 18980 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.902693 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:55.887745 18935 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:55.871663 18761 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:55.827824 18968 consensus_queue.cc:1059] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:05:55.920315 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:55.921021 16176 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEARNER]: Advancing to term 7
I20260709 13:05:55.929857 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:55.879796 18872 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:55.910162 18902 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:55.913937 18980 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.959026 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:55.982226 15585 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.985689 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:55.988421 15591 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:55.927973 18976 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.007s
I20260709 13:05:55.916507 18815 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:56.007186 16182 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.019039 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:56.005715 18986 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.020467 15516 raft_consensus.cc:2368] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10.
W20260709 13:05:56.023864 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.981608 18961 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.035326 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:56.037904 15516 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:56.038509 18975 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.492s	user 0.001s	sys 0.000s
I20260709 13:05:56.035647 18976 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.040380 18976 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:56.041976 18986 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:56.043113 18976 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:56.043597 15406 leader_election.cc:400] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10.
I20260709 13:05:56.043964 15406 leader_election.cc:403] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:05:56.044824 18984 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:05:56.046255 18951 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10.
I20260709 13:05:56.047436 18872 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:56.048866 18981 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:05:56.052075 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:56.053161 18960 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.053153 15509 raft_consensus.cc:2410] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:05:56.053902 18960 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:56.054598 18885 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:56.055075 18885 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:55.983809 18968 consensus_queue.cc:1243] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:05:56.055969 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.044824 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1942) took 1003 ms. Trace:
I20260709 13:05:56.058367 15516 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:05:56.021122 18983 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.510s	user 0.000s	sys 0.002s
I20260709 13:05:56.057689 15438 rpcz_store.cc:276] 0709 13:05:55.041477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.042134 (+   657us) service_pool.cc:224] Handling call
0709 13:05:55.042455 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.108068 (+ 65613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.108102 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:55.123071 (+ 14969us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.306471 (+183400us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:55.306522 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.306616 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.044555 (+737939us) raft_consensus.cc:1685] finished
0709 13:05:56.044579 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.044749 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88252,"raft.queue_time_us":89091,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":11320,"thread_start_us":126360,"threads_started":1,"wal-append.queue_time_us":284728}
W20260709 13:05:56.064929 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.067852 16176 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEARNER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:56.087745 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.680052 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:56.021327 18958 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:56.016491 18949 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:56.142999 15585 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:56.147187 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:56.115068 18985 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260709 13:05:56.077145 18957 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.243599 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:56.244731 15516 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:05:56.246735 15515 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:05:56.249047 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.253054 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:56.254267 15436 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:56.255103 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:56.256834 15440 raft_consensus.cc:2368] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7.
I20260709 13:05:56.256083 15438 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:56.259107 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:56.207181 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 125348us
I20260709 13:05:56.266889 15406 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:56.273212 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:56.277534 16146 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.544s (SENT)
W20260709 13:05:56.247443 18869 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.408s	user 0.012s	sys 0.004s
I20260709 13:05:56.092661 18961 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:56.298008 15438 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:56.299256 16146 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.565s (SENT)
I20260709 13:05:56.312361 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:56.228037 18957 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:56.321548 15438 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:56.301415 18755 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:56.303507 19000 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:56.307169 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 404545us
I20260709 13:05:56.350221 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:56.308410 18897 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:56.344635 15585 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:56.357237 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.013s
W20260709 13:05:56.358232 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.008s	sys 0.013s
W20260709 13:05:56.358701 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 571795us
I20260709 13:05:56.114723 18935 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:56.359727 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.304538 18869 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:56.364451 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:56.374806 15439 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
W20260709 13:05:56.365505 18749 consensus_meta.cc:287] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.061s	user 0.007s	sys 0.007s
I20260709 13:05:56.318681 18872 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:05:56.355190 18897 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.371168 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:56.383867 15585 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.372728 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:56.216349 18949 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:56.345852 18960 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:56.380661 15510 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:05:56.387961 15511 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:05:56.402931 16176 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:05:56.414929 15511 pending_rounds.cc:85] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 4
I20260709 13:05:56.415298 15511 pending_rounds.cc:107] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:05:56.415042 16176 pending_rounds.cc:85] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Aborting all ops after (but not including) 9
I20260709 13:05:56.415602 15511 raft_consensus.cc:2889] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:56.415831 16176 pending_rounds.cc:107] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:05:56.413980 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:56.416821 16176 raft_consensus.cc:2889] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:56.426831 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 67266us
I20260709 13:05:56.430331 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:56.434962 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:56.435360 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:56.436044 15512 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:56.371634 19000 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:56.444664 15439 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 7: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:56.447041 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:56.453003 16178 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:56.434633 18887 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:05:56.388975 18913 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.387355 18897 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.456825 15512 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:56.455585 19000 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:56.472157 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 46537us
W20260709 13:05:56.455619 18998 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:05:56.464788 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 188517us
I20260709 13:05:56.493201 16182 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:56.498031 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.501032 15585 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:56.500659 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:56.511737 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.480439 18749 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.526715 15588 raft_consensus.cc:2410] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:05:56.549922 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 52060us
I20260709 13:05:56.500955 18946 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:56.603621 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 156686us
I20260709 13:05:56.601693 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.605609 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:05:56.612119 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.614374 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:56.536324 19009 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.465935 18913 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:56.615694 15406 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:56.627496 18870 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.627s	user 0.012s	sys 0.005s
I20260709 13:05:56.638106 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:56.550839 18749 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:56.622457 18882 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.344s	user 0.015s	sys 0.003s
I20260709 13:05:56.612109 18945 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.602423 18949 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:56.621373 18674 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:56.672807 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71267.4us
I20260709 13:05:56.691576 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:56.692611 15510 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.661514 19005 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.671092 18986 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:56.706525 18946 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:56.810266 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.662680 18956 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:56.696691 18957 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:56.628589 19009 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:56.697021 18882 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:56.687388 19004 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:56.829586 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1946) took 1405 ms. Trace:
W20260709 13:05:56.804994 19019 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:05:56.696774 18907 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.378s
I20260709 13:05:56.837376 19007 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.836725 15434 rpcz_store.cc:276] 0709 13:05:55.424523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.424737 (+   214us) service_pool.cc:224] Handling call
0709 13:05:55.425354 (+   617us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:55.425873 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.425923 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:55.427036 (+  1113us) log.cc:844] Serialized 52 byte log entry
0709 13:05:55.707667 (+280631us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b18003c3ca0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:05:55.920753 (+213086us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:55.920817 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.920926 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.829201 (+908275us) raft_consensus.cc:1685] finished
0709 13:05:56.829223 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.829490 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6227,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":24515,"spinlock_wait_cycles":11216640,"thread_start_us":212850,"threads_started":1,"wal-append.queue_time_us":771987}
I20260709 13:05:56.839139 18957 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:56.839753 18993 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.840394 18993 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:56.840951 18869 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:56.841630 18989 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:05:56.843191 18987 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.310s	user 0.005s	sys 0.002s
I20260709 13:05:56.843343 18749 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:56.806784 19031 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:56.843932 19003 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:05:56.844165 19031 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:56.804975 18999 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.366s	user 0.001s	sys 0.001s
I20260709 13:05:56.844681 19031 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.845713 19032 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:56.821846 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 135094us
I20260709 13:05:56.846304 19032 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:56.804823 18995 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:56.848306 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.833724 18523 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:56.686472 18966 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:05:56.806360 18913 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:56.764662 19013 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:56.870486 15510 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:56.810480 19043 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:56.833438 19006 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:56.830476 19014 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:56.806890 18992 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.262s
I20260709 13:05:56.688444 18945 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:56.881454 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 243431us
I20260709 13:05:56.884737 18996 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 13:05:56.885401 19027 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:05:56.885666 19016 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
W20260709 13:05:56.886264 19015 log.cc:927] Time spent T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:05:56.886379 19038 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.887224 19012 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:05:56.887917 19032 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:56.894904 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:56.856508 18995 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:56.903951 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55772.5us
I20260709 13:05:56.921905 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:56.874483 19043 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:56.891937 18523 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:56.942495 19043 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.951052 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.952206 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.962669 19041 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:56.917307 19004 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:56.964922 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2234) took 1041 ms. Trace:
I20260709 13:05:56.966666 15584 rpcz_store.cc:276] 0709 13:05:55.923204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.923373 (+   169us) service_pool.cc:224] Handling call
0709 13:05:55.923932 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.280118 (+356186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.280168 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.328719 (+ 48551us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.496178 (+167459us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:56.496216 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.496282 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.964640 (+468358us) raft_consensus.cc:1685] finished
0709 13:05:56.964670 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.964847 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94363,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":15914,"thread_start_us":465541,"threads_started":2,"wal-append.queue_time_us":450268}
W20260709 13:05:56.969720 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74986us
I20260709 13:05:56.971397 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:56.973883 15513 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:05:56.977625 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 58281.6us
I20260709 13:05:56.969261 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.939069 18995 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.979188 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:56.966500 18749 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:56.988116 18749 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.988530 18749 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.992043 18899 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.995743 18977 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:56.996353 18977 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:56.997004 19043 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:57.001065 18700 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.283s	user 0.009s	sys 0.006s
I20260709 13:05:57.001503 19043 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:56.997421 18977 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.002418 18977 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:56.998440 19008 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.414s	user 0.001s	sys 0.001s
I20260709 13:05:57.004099 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2232) took 1083 ms. Trace:
I20260709 13:05:57.004469 15592 rpcz_store.cc:276] 0709 13:05:55.920600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.920724 (+   124us) service_pool.cc:224] Handling call
0709 13:05:55.981844 (+ 61120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.982249 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.982282 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.011927 (+ 29645us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.265516 (+253589us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:56.265564 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.265636 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.003845 (+738209us) raft_consensus.cc:1685] finished
0709 13:05:57.003867 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.004008 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36531,"spinlock_wait_cycles":26337664,"thread_start_us":253100,"threads_started":1,"wal-append.queue_time_us":448816}
I20260709 13:05:57.005867 18885 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.010926 18945 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:56.927995 19038 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.013634 19038 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.020254 18749 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.022142 19009 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.022640 18749 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.023491 19014 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:57.023989 19014 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:57.024395 19014 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:57.028039 18894 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:57.028505 18894 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:57.029510 18894 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.030720 18894 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.033299 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.034101 15584 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:05:57.036751 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.037847 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2241) took 1024 ms. Trace:
I20260709 13:05:57.038825 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:57.039486 15510 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:57.027329 18674 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:05:57.039865 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.040118 18674 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.943356 18523 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.043262 18590 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:57.043855 18590 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.038281 15585 rpcz_store.cc:276] 0709 13:05:56.013514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.501939 (+488425us) service_pool.cc:224] Handling call
0709 13:05:56.502374 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.723595 (+221221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.723629 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.785500 (+ 61871us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.877789 (+ 92289us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:56.877855 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.877966 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.037605 (+159639us) raft_consensus.cc:1685] finished
0709 13:05:57.037632 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.037782 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5413,"raft.queue_time_us":121759,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":28771,"thread_start_us":246266,"threads_started":2,"wal-append.queue_time_us":208541}
I20260709 13:05:57.046255 18590 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:56.974545 19040 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:56.991153 19005 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:57.058670 15586 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:57.055594 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:57.061655 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 82551.2us
I20260709 13:05:57.062911 15510 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:05:57.063920 19002 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:57.064376 19002 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:57.065327 19002 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.065896 15583 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:57.066475 19002 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.068545 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:57.069490 15585 raft_consensus.cc:2368] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10.
I20260709 13:05:57.071103 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.071587 18590 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:57.075773 18590 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.078248 18590 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:57.082505 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2240) took 1090 ms. Trace:
I20260709 13:05:57.072790 18993 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.084970 15585 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:05:57.069510 15338 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 211) took 15536 ms (client timeout 15000 ms). Trace:
I20260709 13:05:57.083026 15590 rpcz_store.cc:276] 0709 13:05:55.992028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.004791 (+ 12763us) service_pool.cc:224] Handling call
0709 13:05:56.015482 (+ 10691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.024181 (+  8699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.024214 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.045566 (+ 21352us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.377799 (+332233us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:56.378173 (+   374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.378407 (+   234us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.082144 (+703737us) raft_consensus.cc:1685] finished
0709 13:05:57.082179 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.082416 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2812,"raft.queue_time_us":47786,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":42155,"thread_start_us":325914,"threads_started":1,"wal-append.queue_time_us":546740}
I20260709 13:05:57.095255 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:57.007402 18885 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:57.099975 15584 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:57.102907 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:57.108145 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 128166us
W20260709 13:05:57.108008 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 122683us
W20260709 13:05:57.071607 18980 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.073s	user 0.007s	sys 0.007s
I20260709 13:05:57.131893 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2229) took 1223 ms. Trace:
I20260709 13:05:57.140244 15587 rpcz_store.cc:276] 0709 13:05:55.908052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.908272 (+   220us) service_pool.cc:224] Handling call
0709 13:05:55.908774 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.260885 (+352111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.260922 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.281127 (+ 20205us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.804223 (+523096us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:56.804280 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.828222 (+ 23942us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.131618 (+303396us) raft_consensus.cc:1685] finished
0709 13:05:57.131643 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.131827 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6086,"raft.queue_time_us":19599,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":57145,"thread_start_us":831103,"threads_started":2,"wal-append.queue_time_us":646880}
I20260709 13:05:57.130569 15592 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:05:57.144623 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 49467.8us
I20260709 13:05:57.137483 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:57.089514 18972 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:57.146042 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:57.102564 18666 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:57.171252 15517 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:05:57.171974 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.194808 15510 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:57.102802 18411 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.122421 18945 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.134831 19011 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:57.243966 18945 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.244385 19011 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:57.196420 19045 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:57.227591 19047 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.245664 19011 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.138159 18700 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:05:57.246685 19047 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.168138 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:05:57.222822 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.115715 19040 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:57.134059 18674 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.248996 19040 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.250723 18674 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:57.128696 18976 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:57.252018 18897 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.001s
I20260709 13:05:57.251857 18976 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.252524 18897 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.252926 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.254288 18976 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.254807 18897 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:57.228190 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.256494 19047 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.228689 18958 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.103355 18949 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.238691 19042 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.241489 18411 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.220623 18993 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:05:57.260970 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.506s (SENT) [suppressed 29 similar messages]
I20260709 13:05:57.134045 19031 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:57.263481 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 117584us
W20260709 13:05:57.091029 15338 rpcz_store.cc:269] 0709 13:05:41.532867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.533091 (+   224us) service_pool.cc:224] Handling call
0709 13:05:41.712969 (+179878us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:57.069238 (+15356269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:48.151197 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:48.545373 (+394176us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:48.546549 (+  1176us) write_op.cc:435] Acquired schema lock
0709 13:05:48.546589 (+    40us) tablet.cc:662] Decoding operations
0709 13:05:50.370869 (+1824280us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:50.370959 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:50.370997 (+    38us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:05:50.373610 (+  2613us) tablet.cc:701] Row locks acquired
0709 13:05:50.373636 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:05:50.373892 (+   256us) write_op.cc:270] Start()
0709 13:05:50.374067 (+   175us) write_op.cc:276] Timestamp: P: 1783602350373804 usec, L: 0
0709 13:05:50.374090 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:50.420878 (+ 46788us) log.cc:844] Serialized 6464 byte log entry
0709 13:05:51.066809 (+645931us) op_driver.cc:464] REPLICATION: finished
0709 13:05:51.068666 (+  1857us) write_op.cc:301] APPLY: starting
0709 13:05:51.068894 (+   228us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:51.069393 (+   499us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:51.069620 (+   227us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:51.076663 (+  7043us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:51.077101 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:05:51.077170 (+    69us) write_op.cc:312] APPLY: finished
0709 13:05:51.077675 (+   505us) log.cc:844] Serialized 113 byte log entry
0709 13:05:51.077880 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:51.078102 (+   222us) write_op.cc:454] Released schema lock
0709 13:05:51.078172 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:51.868395 (+790223us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd52e28 00007fcf7f78d581 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d 000000000038f354 000000000038f199
0709 13:05:51.890434 (+ 22039us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:51.890484 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":479229,"reported_tablets":50,"spinlock_wait_cycles":379906944,"child_traces":[["op",{"apply.queue_time_us":1402,"apply.run_cpu_time_us":9295,"apply.run_wall_time_us":10025,"num_ops":16,"prepare.queue_time_us":330336,"prepare.run_cpu_time_us":56941,"prepare.run_wall_time_us":3771208,"raft.queue_time_us":634085,"raft.run_cpu_time_us":1744,"raft.run_wall_time_us":1849,"replication_time_us":692497,"spinlock_wait_cycles":104440064,"thread_start_us":1064878,"threads_started":4,"wal-append.queue_time_us":7766,"wal-append.run_cpu_time_us":34663,"wal-append.run_wall_time_us":1870862}]]}
W20260709 13:05:57.268586 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 100571us
I20260709 13:05:57.231262 18666 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:57.155529 18980 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.273516 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:57.283337 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:57.285952 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:57.292116 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 462518us
I20260709 13:05:57.262918 18968 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.294112 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.301481 15406 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:05:57.297456 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:57.304697 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:57.305392 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:57.262931 18972 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:57.291786 18993 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:57.318073 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:57.264832 18958 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.303400 18897 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:57.310102 18894 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:57.331517 18874 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:57.134572 19004 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.268889 18949 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:57.360535 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.330772 18956 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:57.343143 18897 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:57.364738 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:57.365581 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.369817 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:57.330729 18935 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:05:57.372862 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.295433 19042 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.358057 18874 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.346763 19056 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:57.374603 15434 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:57.357662 18894 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:57.385661 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:57.375919 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 114981us
I20260709 13:05:57.372080 18897 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.386284 18956 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:57.403054 18894 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.403131 18956 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.383697 16174 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:05:57.361948 18666 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:57.412355 19059 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:57.414932 18958 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.417964 15407 leader_election.cc:400] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10.
W20260709 13:05:57.408109 19054 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:57.422463 16179 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:05:57.388062 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.674s (SENT)
I20260709 13:05:57.438473 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:57.382948 18874 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:57.447813 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.450639 15439 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:57.450932 15590 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:05:57.452332 19060 log.cc:927] Time spent T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:05:57.455039 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:57.456259 15518 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:57.459682 18980 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.462365 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2228) took 1557 ms. Trace:
I20260709 13:05:57.400449 18972 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:57.467617 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79599.9us
W20260709 13:05:57.467599 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45560.1us
I20260709 13:05:57.469429 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.463032 15583 rpcz_store.cc:276] 0709 13:05:55.904634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.904867 (+   233us) service_pool.cc:224] Handling call
0709 13:05:57.462027 (+1557160us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001de7d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:57.462218 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2520058240}
I20260709 13:05:57.412461 18411 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.472790 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.462821 19014 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.483532 15585 raft_consensus.cc:1217] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Deduplicated request from leader. Original: 3.2->[4.3-6.4]   Dedup: 6.4->[]
I20260709 13:05:57.487803 15585 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:05:57.489006 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:57.492174 15585 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:05:57.483994 15555 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.932s (SENT)
I20260709 13:05:57.483264 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:57.496968 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.498379 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:57.499876 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:57.502701 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:57.506309 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:57.506027 18523 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:57.507181 15434 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:57.508081 18978 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:57.509384 18894 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.509691 19042 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:57.510026 18894 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.512895 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:57.481252 19005 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:57.517117 15515 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:57.514377 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:57.523747 19055 log.cc:927] Time spent T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:05:57.524255 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:57.527693 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:57.528162 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:57.528652 15583 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:57.533069 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.542907 15583 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:57.546644 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.548635 19050 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.549957 19050 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.552327 19048 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:57.557332 18942 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:57.448894 18993 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.455292 18995 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:57.560685 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.567662 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:57.568359 15587 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:57.571416 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.531302 19031 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.572309 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:57.544832 19000 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:57.576397 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:57.578693 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:57.588044 15438 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:05:57.589715 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:57.590785 18977 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:57.590926 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:57.591399 18977 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.588269 15442 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 4: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:57.596158 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:57.565861 18870 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.563352 19005 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:57.600467 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:57.601280 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:57.605475 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:57.603050 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:57.569582 18935 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:57.567159 18958 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:57.618242 16146 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:57.558316 18942 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.636816 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:57.639778 15435 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.634335 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.640931 15509 raft_consensus.cc:2376] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8. Re-sending same reply.
I20260709 13:05:57.656795 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.599457 19000 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:57.663026 15585 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:05:57.658793 15509 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:57.664211 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:05:57.665150 19072 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:57.666309 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.620988 19048 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:57.662060 15587 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:05:57.667642 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.609419 18959 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.643483 18977 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.646600 18411 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.636353 18958 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.693579 18942 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:57.691452 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.612367 18870 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.706339 15435 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
W20260709 13:05:57.712379 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 177596us
I20260709 13:05:57.619514 19005 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.721524 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.725232 15516 raft_consensus.cc:2410] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:05:57.726481 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.672819 19048 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:57.697086 19007 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.852s	user 0.014s	sys 0.000s
I20260709 13:05:57.742687 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.735970 15516 raft_consensus.cc:2410] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:57.642856 18935 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.718849 18891 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:57.749493 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.732200 18894 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.757273 18870 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.739634 19048 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:57.707428 18959 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.748319 19007 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:57.771586 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 87559us
I20260709 13:05:57.783263 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:57.773048 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9193371680000837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2629s for a response
I20260709 13:05:57.764525 15509 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:05:57.719365 18411 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.765612 19014 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:57.785279 15482 connection.cc:256] RPC call timeout handler was delayed by -1.913937168000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2635s for a response
I20260709 13:05:57.771028 18994 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:57.787358 19014 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:57.788018 19014 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.789711 19005 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:57.791257 15590 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:05:57.781073 18870 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.796003 18870 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.798609 18870 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:57.793445 19002 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.010s
I20260709 13:05:57.799804 16173 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:05:57.800060 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.803913 15509 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:57.805869 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.808135 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.809659 15517 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:57.813838 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:05:57.816182 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.808065 18995 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.806051 18870 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:57.821272 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.822536 15517 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:05:57.776198 19000 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.834534 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:57.835374 15516 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:05:57.820606 19050 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:57.841187 19065 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:05:57.841261 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.841727 18958 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.842305 15585 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:05:57.843339 18411 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.846267 18959 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:57.847750 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.850545 18968 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 13:05:57.851293 18968 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:57.866142 19081 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:05:57.868647 18945 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:57.869052 18935 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:57.873667 15517 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:57.885648 19062 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.221s	user 0.000s	sys 0.003s
W20260709 13:05:57.888038 19001 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.670s	user 0.004s	sys 0.002s
I20260709 13:05:57.890378 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2264) took 2368 ms. Trace:
I20260709 13:05:57.891049 15514 rpcz_store.cc:276] 0709 13:05:55.521997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.522180 (+   183us) service_pool.cc:224] Handling call
0709 13:05:55.673988 (+151808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.674532 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:55.718954 (+ 44422us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.911296 (+192342us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:55.913280 (+  1984us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.913653 (+   373us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:55.913704 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.913782 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.832342 (+1918560us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:57.890033 (+ 57691us) raft_consensus.cc:1685] finished
0709 13:05:57.890137 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.890304 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76828,"prepare.queue_time_us":203195,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":5284,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":46308,"spinlock_wait_cycles":6505728,"thread_start_us":191545,"threads_started":1,"wal-append.queue_time_us":303212}
W20260709 13:05:57.876369 19075 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:05:57.903971 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:57.904917 15514 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:05:57.905424 15514 pending_rounds.cc:85] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 3
I20260709 13:05:57.905646 15514 pending_rounds.cc:107] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:05:57.905690 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2242) took 1886 ms. Trace:
I20260709 13:05:57.905944 15514 raft_consensus.cc:2889] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:57.909336 15514 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:57.906329 15588 rpcz_store.cc:276] 0709 13:05:56.019732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.596578 (+576846us) service_pool.cc:224] Handling call
0709 13:05:56.626212 (+ 29634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.818529 (+192317us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:56.951210 (+132681us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.386901 (+435691us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.439385 (+ 52484us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.439640 (+   255us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:57.439691 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.439807 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.884740 (+444933us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:57.902813 (+ 18073us) raft_consensus.cc:1685] finished
0709 13:05:57.905377 (+  2564us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.905597 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115708,"prepare.queue_time_us":144798,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":95931,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":87509,"spinlock_wait_cycles":9279360,"thread_start_us":395172,"threads_started":2,"wal-append.queue_time_us":467352}
I20260709 13:05:57.895179 19007 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.904455 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:57.918262 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:57.917285 18993 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:57.921164 18993 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.921548 18993 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:57.903528 18411 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.933866 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.940187 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:57.947016 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:57.948465 15588 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:57.954828 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:57.925020 19007 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.950218 18959 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:57.975565 15588 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:57.975978 18945 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.976688 18945 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:57.978551 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.979677 15588 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:57.982841 19007 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:57.987802 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:57.944391 18411 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:57.988902 18874 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.007s
I20260709 13:05:57.989022 15588 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:57.989540 18874 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:57.990832 18411 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:57.990969 15588 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:57.993481 15440 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:05:58.005950 18897 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.002s
I20260709 13:05:58.006536 18897 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.007051 18993 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.020205 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2254) took 2581 ms. Trace:
I20260709 13:05:58.020597 15511 rpcz_store.cc:276] 0709 13:05:55.439088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.441155 (+  2067us) service_pool.cc:224] Handling call
0709 13:05:55.441492 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.416731 (+975239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.019973 (+1603242us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b5400213754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:58.020146 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175563136}
I20260709 13:05:58.016130 16175 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 4.
I20260709 13:05:58.024722 19000 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:58.025537 19048 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.030819 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.030161 18968 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.032888 15592 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:58.032210 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.018628 18874 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.033344 18935 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.036736 19050 raft_consensus.cc:2764] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:58.036455 18968 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.036947 18935 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:58.037575 19041 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:58.038038 19041 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:58.038889 18968 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.035173 18958 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.041337 18961 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.041615 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.039247 18935 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.046417 16177 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:58.047248 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.048883 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.049474 18958 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:58.050271 16178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 494) took 2117 ms (client timeout 1579 ms). Trace:
W20260709 13:05:58.050856 16178 rpcz_store.cc:269] 0709 13:05:55.928640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.928887 (+   247us) service_pool.cc:224] Handling call
0709 13:05:58.046065 (+2117178us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400520154. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:58.046206 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072490752}
I20260709 13:05:58.051970 18968 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:58.052256 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2233) took 2130 ms. Trace:
I20260709 13:05:58.052433 18968 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.052881 18968 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:58.054951 18978 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.056069 18978 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.032199 18993 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.058847 18978 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.060252 18945 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:58.061079 18935 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:58.061491 18935 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.061852 18935 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:58.062086 19087 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.092s	user 0.000s	sys 0.003s
I20260709 13:05:58.052659 15589 rpcz_store.cc:276] 0709 13:05:55.921409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.921566 (+   157us) service_pool.cc:224] Handling call
0709 13:05:55.921953 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.121622 (+199669us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:56.311734 (+190112us) log.cc:844] Serialized 14 byte log entry
0709 13:05:56.323134 (+ 11400us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.351390 (+ 28256us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.351653 (+   263us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:56.351707 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.351805 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.867312 (+515507us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b18004373e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78be4c0a 00007fcf82324219 00007fcf7fc2b58f 00007fcf78c6a571 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd
0709 13:05:57.042964 (+175652us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b48001c0158. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf80c80aa1 00007fcf80c77b37 00007fcf80c779ca 00007fcf80d6f26f 00007fcf80d6ef37 00007fcf80d8355c 00007fcf80d83508 00007fcf80d83488 00007fcf80d83443 00007fcf80d826ec 00007fcf7fcaca96
0709 13:05:58.049905 (+1006941us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18004373e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:58.052008 (+  2103us) raft_consensus.cc:1685] finished
0709 13:05:58.052038 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.052197 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28688,"prepare.queue_time_us":225679,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":8239,"raft.queue_time_us":112605,"raft.run_cpu_time_us":13083,"raft.run_wall_time_us":1039577,"spinlock_wait_cycles":71950080,"thread_start_us":300674,"threads_started":3,"wal-append.queue_time_us":102638}
I20260709 13:05:58.073200 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.074309 18958 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:58.075906 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.076746 18958 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.049197 18897 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.083612 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.084262 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.085443 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:58.087069 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.088029 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.089826 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.090435 15439 raft_consensus.cc:2368] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:58.091703 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.092069 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.093927 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.093773 19007 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:58.095275 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.096153 15589 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:58.095599 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.097158 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:58.095705 15439 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:58.096935 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.110143 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.112078 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.112394 18815 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:58.113698 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.114509 15435 raft_consensus.cc:2368] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:05:58.114761 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2249) took 2033 ms. Trace:
I20260709 13:05:58.115167 15591 rpcz_store.cc:276] 0709 13:05:56.081059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.609981 (+528922us) service_pool.cc:224] Handling call
0709 13:05:56.610332 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.933357 (+323025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.933395 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:56.933444 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:56.933479 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.114481 (+1181002us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540015e5d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:58.114539 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.114697 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742359808}
I20260709 13:05:58.116072 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:58.116685 16182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 491) took 2214 ms (client timeout 1798 ms). Trace:
W20260709 13:05:58.117098 16182 rpcz_store.cc:269] 0709 13:05:55.902628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.903052 (+   424us) service_pool.cc:224] Handling call
0709 13:05:58.116497 (+2213445us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b5400510254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:58.116612 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223739776}
I20260709 13:05:58.118978 19041 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.120332 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.121764 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.122776 15439 raft_consensus.cc:2410] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:05:58.123776 19007 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:58.124549 19007 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.128108 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.130057 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.132143 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2282) took 1628 ms. Trace:
I20260709 13:05:58.132395 19048 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.132673 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.133399 18935 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.135032 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.136049 15439 raft_consensus.cc:2410] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:05:58.139000 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.139036 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.132638 15513 rpcz_store.cc:276] 0709 13:05:56.503937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.504261 (+   324us) service_pool.cc:224] Handling call
0709 13:05:56.546364 (+ 42103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.974338 (+427974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.131859 (+1157521us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54003dcf54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:58.132073 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982297472}
I20260709 13:05:58.142740 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.143523 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.144083 15512 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:05:58.145025 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.146090 15511 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:05:58.145181 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.151702 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.154034 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.156101 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.156479 15511 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:05:58.157773 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.158948 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.152401 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.160669 15511 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:58.161267 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.155855 15509 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:58.169672 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.169312 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.174119 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.175185 15517 raft_consensus.cc:2410] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:58.174811 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.176453 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:58.177368 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.138401 19007 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:58.179205 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:58.181427 18894 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:05:58.154410 18945 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.180721 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.154253 19005 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.191274 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.188205 15514 raft_consensus.cc:2368] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7.
I20260709 13:05:58.192441 19011 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:58.181780 19050 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:58.182941 19042 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:58.178936 18942 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.178632 18972 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.198064 15439 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:58.168437 18958 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:05:58.184599 18869 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:05:58.202294 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.205809 16182 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:58.206761 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:58.173738 18755 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:05:58.194554 19007 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.211887 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:58.212826 18945 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:58.217417 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:58.213601 18755 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:58.213892 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:05:58.219659 15592 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:58.199637 19042 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.220958 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.217032 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.223913 15436 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:05:58.224345 15585 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:58.224836 19005 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:58.225381 18942 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:58.227998 19007 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:58.239692 15584 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:58.231739 18870 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:58.238395 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:58.245219 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:58.245613 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.208150 19050 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:58.250627 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:05:58.252679 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.253322 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.253512 15436 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:58.253491 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.254995 15591 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:58.257565 16182 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEARNER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:05:58.261335 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.219775 18755 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:05:58.241936 19042 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:58.239674 18815 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:58.268282 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:58.289211 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.242960 18894 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:58.289702 16176 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:05:58.270334 15436 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
W20260709 13:05:58.272099 19079 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.482s	user 0.004s	sys 0.000s
I20260709 13:05:58.257120 18956 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:05:58.268875 18958 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.266515 19048 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:58.282549 18949 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.283603 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2296) took 1112 ms. Trace:
W20260709 13:05:58.284511 19086 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.325s	user 0.002s	sys 0.002s
I20260709 13:05:58.312399 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:58.242061 19005 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:58.252446 18870 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.270222 18666 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:58.268162 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:58.297230 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.305581 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:58.263060 18965 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:58.339956 18965 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:58.340593 18755 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:58.341140 18965 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.342164 18755 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:58.344038 19050 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.347600 19041 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.302243 18902 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:05:58.348903 18902 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:58.349356 18902 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:58.321345 19048 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:58.350399 18902 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.350533 19048 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.325500 18666 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.352021 18666 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:58.310853 18977 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:05:58.307674 18894 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.308185 15515 rpcz_store.cc:276] 0709 13:05:57.171090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.171246 (+   156us) service_pool.cc:224] Handling call
0709 13:05:57.171611 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.517787 (+346176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.283303 (+765516us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400296654. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:58.283509 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793925888}
W20260709 13:05:58.360683 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 63609.4us
I20260709 13:05:58.268718 18967 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:58.287318 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.384546 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1820) took 1046 ms. Trace:
I20260709 13:05:58.385002 15518 rpcz_store.cc:276] 0709 13:05:57.337980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.588365 (+250385us) service_pool.cc:224] Handling call
0709 13:05:58.287128 (+698763us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:05:58.384475 (+ 97347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87878912}
I20260709 13:05:58.312454 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:58.310407 18958 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.294333 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:05:58.307384 19093 log.cc:927] Time spent T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:05:58.321205 19005 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:58.367691 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 52862us
I20260709 13:05:58.371697 15515 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:58.372550 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.372740 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:58.367142 15589 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
W20260709 13:05:58.391265 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 97094.3us
I20260709 13:05:58.406175 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.321044 18935 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.407497 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.409139 15517 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:58.360610 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134129us
I20260709 13:05:58.397722 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:58.325258 18870 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:58.414073 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:58.411621 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:58.406883 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.400583 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.415942 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.420303 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:58.421357 15591 raft_consensus.cc:2393] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:05:58.383446 18967 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.394487 19007 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:58.443827 19007 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:58.436450 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.402437 19041 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.437335 18958 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.437649 15585 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:05:58.463431 15509 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:58.407413 18902 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:58.432812 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 458) took 2190 ms. Trace:
I20260709 13:05:58.450685 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.464023 15586 rpcz_store.cc:276] 0709 13:05:56.242084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.933367 (+691283us) service_pool.cc:224] Handling call
0709 13:05:56.960143 (+ 26776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.059190 (+ 99047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.432371 (+1373181us) spinlock_profiling.cc:243] Waited 92.4 ms on lock 0x7b54000c0654. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:58.432709 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212409216}
W20260709 13:05:58.437016 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.467670 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.463215 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.468510 15515 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:58.443919 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:58.469193 15513 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:58.470440 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.391700 18968 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.423954 18897 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:58.427047 19095 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:58.480720 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.402205 18879 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:05:58.428645 19026 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:58.445595 18967 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:58.490830 18949 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:58.493432 18949 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:58.490839 19026 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:58.496956 19026 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.462431 19007 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.500231 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:58.506321 15509 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:58.510040 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:05:58.513159 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 99134.6us
I20260709 13:05:58.476683 18966 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:58.483306 19014 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:58.514070 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 1818) took 1032 ms. Trace:
I20260709 13:05:58.526749 15590 rpcz_store.cc:276] 0709 13:05:57.468937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.469127 (+   190us) service_pool.cc:224] Handling call
0709 13:05:58.501248 (+1032121us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400055fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:58.501401 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738172288}
I20260709 13:05:58.502604 19095 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.484764 18762 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:58.519107 15511 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 6: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:05:58.467777 18993 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 13:05:58.558687 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.533954 19096 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:58.537971 19097 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:05:58.540664 15513 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:58.553279 16181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 497) took 1017 ms. Trace:
W20260709 13:05:58.554032 19088 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.512s	user 0.000s	sys 0.002s
I20260709 13:05:58.557288 18968 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.523940 18966 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.565171 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1817) took 1067 ms. Trace:
I20260709 13:05:58.546804 19042 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.570154 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.567987 16181 rpcz_store.cc:276] 0709 13:05:57.535833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.554801 (+ 18968us) service_pool.cc:224] Handling call
0709 13:05:58.285712 (+730911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.286201 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.286240 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.286763 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.408196 (+121433us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:58.408249 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.408323 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.551407 (+143084us) raft_consensus.cc:1685] finished
0709 13:05:58.551432 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.552965 (+  1533us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54005f0fd0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:58.553200 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2037,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":1652141952,"thread_start_us":121017,"threads_started":1,"wal-append.queue_time_us":238624}
W20260709 13:05:58.590715 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.562572 18762 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.569191 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:58.582564 18966 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:58.599967 15591 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:58.589438 18808 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.561991 19095 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:58.567272 19096 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:05:58.604980 18967 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.680929 18967 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.607986 18808 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.526434 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:58.577215 15440 rpcz_store.cc:276] 0709 13:05:57.497910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.498092 (+   182us) service_pool.cc:224] Handling call
0709 13:05:58.564921 (+1066829us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400302ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:58.565099 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132012928}
I20260709 13:05:58.579496 15509 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:05:58.572956 18894 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:05:58.683738 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 71576.4us
I20260709 13:05:58.696082 15509 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:58.610545 18762 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:58.603444 19042 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:58.680204 19106 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:58.709556 15509 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:58.711452 15509 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:58.568553 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 154570us
I20260709 13:05:58.615373 19096 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:58.715263 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 645) took 1465 ms. Trace:
I20260709 13:05:58.716578 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.715781 15516 rpcz_store.cc:276] 0709 13:05:57.250322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.836538 (+586216us) service_pool.cc:224] Handling call
0709 13:05:57.854867 (+ 18329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.870385 (+ 15518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.870419 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.877034 (+  6615us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.953147 (+ 76113us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:57.953188 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.953264 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.553377 (+600113us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:05:58.703048 (+149671us) raft_consensus.cc:1685] finished
0709 13:05:58.703072 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.715193 (+ 12121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8080,"raft.queue_time_us":18343,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":14576,"spinlock_wait_cycles":4397312,"thread_start_us":56094,"threads_started":1,"wal-append.queue_time_us":119738}
I20260709 13:05:58.725620 18869 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:05:58.728353 19104 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:05:58.729229 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.730695 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.732335 18951 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.728425 15518 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:58.734498 15434 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:58.734557 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.730078 18762 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.736310 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.738463 18762 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.739176 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.742645 18902 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.744091 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:58.745361 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.746742 18966 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.747272 18902 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:58.752681 15406 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.698216 18956 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:58.757088 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.761883 18808 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.713498 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.783529 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.784963 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:58.754231 18869 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:58.715533 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 197417us
I20260709 13:05:58.819187 15442 raft_consensus.cc:606] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.819744 15442 raft_consensus.cc:614] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:58.820081 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:05:58.824019 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 110558us
I20260709 13:05:58.824934 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.827140 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.831770 15439 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:05:58.832791 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.834018 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:58.834383 15440 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:05:58.834793 15440 pending_rounds.cc:85] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 4
I20260709 13:05:58.834987 15440 pending_rounds.cc:107] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:05:58.835140 15440 raft_consensus.cc:2889] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:58.808964 18762 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:58.841076 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.845887 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.846637 15440 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
W20260709 13:05:58.833025 19011 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.640s	user 0.013s	sys 0.001s
I20260709 13:05:58.828218 18879 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.853565 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:05:58.810338 19005 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.857146 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.860754 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:05:58.768167 19106 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:05:58.816069 18956 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.848497 18942 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:58.826056 19007 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.835436 18978 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:05:58.848081 19042 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:58.829547 18965 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:05:58.870656 15555 leader_election.cc:400] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7.
W20260709 13:05:58.946460 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 75928us
I20260709 13:05:58.947741 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:58.920054 19107 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:58.858091 19103 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:05:58.923919 19102 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:58.926491 19106 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:58.848387 19108 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:58.923003 19096 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.961287 18869 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:58.962031 19096 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:05:58.933502 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 221070us
I20260709 13:05:58.858745 19011 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:58.963590 19114 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:05:58.940543 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 388) took 2879 ms. Trace:
I20260709 13:05:58.964130 16177 rpcz_store.cc:276] 0709 13:05:56.053168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.059405 (+  6237us) service_pool.cc:224] Handling call
0709 13:05:58.046226 (+1986821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.046857 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.932702 (+885845us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400520150. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:58.932919 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4397177216}
I20260709 13:05:58.972218 18978 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:58.972769 18978 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:58.973812 18978 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:58.974627 18411 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:58.975009 18978 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:58.935212 18666 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260709 13:05:58.954624 16175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 501) took 1055 ms. Trace:
I20260709 13:05:58.975772 18666 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:58.975790 16175 rpcz_store.cc:276] 0709 13:05:57.898936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.901406 (+  2470us) service_pool.cc:224] Handling call
0709 13:05:58.944326 (+1042920us) spinlock_profiling.cc:243] Waited 92.8 ms on lock 0x7b54004b8cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:05:58.951564 (+  7238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213362560}
I20260709 13:05:58.978407 18666 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:58.986582 19007 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:58.864847 18762 raft_consensus.cc:697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:58.928479 18942 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.975039 18411 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:58.958544 19102 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:58.957806 19103 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:58.992043 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 586063us
W20260709 13:05:58.993274 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.113016 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:58.987499 15337 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:05:59.082166 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:59.269047 15511 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:05:59.171377 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54645us
I20260709 13:05:59.278206 15583 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:59.277489 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1834) took 1077 ms. Trace:
I20260709 13:05:59.281121 15592 rpcz_store.cc:276] 0709 13:05:58.200247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.200375 (+   128us) service_pool.cc:224] Handling call
0709 13:05:58.200722 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.220133 (+ 19411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.277074 (+1056941us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b54000555d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:59.277386 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42628352}
W20260709 13:05:58.950969 18870 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.003s
I20260709 13:05:59.232483 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:59.268306 15439 raft_consensus.cc:2368] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5.
I20260709 13:05:59.286927 15435 raft_consensus.cc:606] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.113740 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:05:59.129560 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:59.290899 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.293313 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.306027 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:05:59.307945 15589 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:59.315375 15590 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:59.140242 18977 raft_consensus.cc:1064] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:05:58.991179 19005 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:58.993602 19050 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:59.217675 19095 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.000s
I20260709 13:05:58.996498 18966 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:59.085002 18942 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:59.334622 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.318306 18894 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:59.295084 15337 catalog_manager.cc:5697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.282866 19102 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:58.991849 18935 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:59.356725 15585 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:05:59.356976 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 409363us
I20260709 13:05:59.315214 19040 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:59.129380 19037 consensus_queue.cc:1059] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.209s
I20260709 13:05:59.301441 19007 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.366925 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.377168 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.350726 19043 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:59.387045 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:59.350564 18968 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:58.998195 18762 consensus_queue.cc:237] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.395062 15589 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:59.398350 15482 leader_election.cc:400] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7.
I20260709 13:05:59.399355 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.396647 15440 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:59.317405 18870 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:59.405105 15583 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
W20260709 13:05:59.392439 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66654us
I20260709 13:05:59.391889 15435 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:59.400051 15556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.018s	sys 0.047s
I20260709 13:05:59.391462 15585 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:59.408310 15556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.018s	sys 0.047s
W20260709 13:05:59.389667 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47447.3us
W20260709 13:05:59.408674 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 538168us
I20260709 13:05:59.412058 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:59.412761 15435 raft_consensus.cc:606] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.344399 19050 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:59.413528 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:59.417855 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.417585 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.401055 18961 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:59.366592 18411 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.387710 18935 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:59.419910 18961 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.405634 18879 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:59.405750 18968 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.421314 18879 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:59.343881 19095 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:59.429247 15591 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:05:59.430454 19095 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:59.410893 19041 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:59.406462 19005 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:59.432427 19005 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.434705 19005 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:59.351382 19115 consensus_queue.cc:1059] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:05:59.437460 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:05:59.441177 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:59.430639 19112 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 13:05:59.447358 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:05:59.436151 15337 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 5, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.449863 15337 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.452382 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:59.452628 18968 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:59.453176 15583 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:59.454015 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:59.454712 15435 raft_consensus.cc:606] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.455130 15435 raft_consensus.cc:614] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:59.459704 18815 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:59.462384 19050 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:59.467360 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:59.475124 15592 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.475968 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:59.476611 15514 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:59.478283 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:59.478997 15515 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
W20260709 13:05:59.482738 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 83451.5us
I20260709 13:05:59.485821 15585 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:05:59.480823 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:05:59.487915 15585 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:59.488092 15588 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:59.490815 15482 leader_election.cc:400] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:05:59.500180 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:59.502095 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:59.504540 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:59.525490 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:05:59.526155 15512 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:59.506877 15510 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:59.384439 19007 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:05:59.511219 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 71992.6us
I20260709 13:05:59.514415 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:05:59.529932 15518 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:05:59.532326 15510 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:59.533056 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:05:59.537789 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52014.4us
I20260709 13:05:59.438555 18879 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:59.551877 15517 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:59.474365 19048 raft_consensus.cc:3055] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:59.553992 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53903.9us
I20260709 13:05:59.564188 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.565852 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.569353 15583 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:05:59.581786 15337 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.435418 19037 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:05:59.445271 18945 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:05:59.584857 18755 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:59.560833 18935 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:59.591763 19095 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:05:59.592639 19095 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.594395 16173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 505) took 1076 ms. Trace:
W20260709 13:05:59.594815 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62217.9us
I20260709 13:05:59.596231 18966 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:59.594866 16173 rpcz_store.cc:276] 0709 13:05:58.517816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.520934 (+  3118us) service_pool.cc:224] Handling call
0709 13:05:58.588617 (+ 67683us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:58.607180 (+ 18563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.607223 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:58.608913 (+  1690us) log.cc:844] Serialized 590 byte log entry
0709 13:05:58.856159 (+247246us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:58.860049 (+  3890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.864336 (+  4287us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.593946 (+729610us) raft_consensus.cc:1685] finished
0709 13:05:59.593997 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.594287 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11738,"raft.queue_time_us":13483,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":236861,"threads_started":1,"wal-append.queue_time_us":382198}
I20260709 13:05:59.600387 18945 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:59.579869 18965 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:05:59.601056 18945 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:05:59.601398 18965 consensus_queue.cc:1243] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:59.602020 18945 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.603327 19095 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:59.600445 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:05:59.604641 15435 raft_consensus.cc:606] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.605034 15435 raft_consensus.cc:614] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:59.515381 19041 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:59.608297 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 58186.2us
I20260709 13:05:59.609077 18874 raft_consensus.cc:993] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
W20260709 13:05:59.610967 19116 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.478s	user 0.006s	sys 0.007s
I20260709 13:05:59.531244 19050 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:05:59.611881 19111 raft_consensus.cc:1081] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:59.611503 18874 raft_consensus.cc:993] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:05:59.617256 15585 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:59.583119 15514 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:59.618928 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:59.620966 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 91620.4us
I20260709 13:05:59.603288 18945 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.622081 15583 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:59.471757 18949 consensus_queue.cc:1059] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:05:59.618029 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:05:59.634672 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 68902.3us
I20260709 13:05:59.636502 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:05:59.621044 15337 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 5, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 5 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:05:59.576808 19048 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:05:59.631008 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:59.642102 15406 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:05:59.629779 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 184653us
I20260709 13:05:59.649124 15556 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.650525 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.627027 18965 raft_consensus.cc:1081] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
W20260709 13:05:59.756678 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 106231us
W20260709 13:05:59.758136 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.758970 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.760311 15512 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:05:59.744270 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 107857us
I20260709 13:05:59.761577 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.763038 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.764794 15588 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:05:59.776254 19007 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:59.647488 19000 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:59.648140 18935 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:59.784570 15337 catalog_manager.cc:5697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.799837 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1956) took 1071 ms. Trace:
I20260709 13:05:59.800530 15436 rpcz_store.cc:276] 0709 13:05:58.728368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.735569 (+  7201us) service_pool.cc:224] Handling call
0709 13:05:58.735860 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.832903 (+ 97043us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:59.148931 (+316028us) log.cc:844] Serialized 14 byte log entry
0709 13:05:59.355147 (+206216us) log.cc:844] Serialized 14 byte log entry
0709 13:05:59.355363 (+   216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.355411 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:59.355463 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.453123 (+ 97660us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b18003dde00. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a522 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:05:59.799261 (+346138us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b54002260d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:05:59.799416 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.799720 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":224,"prepare.queue_time_us":22928,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":107,"raft.queue_time_us":15088,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7411,"spinlock_wait_cycles":284048128,"thread_start_us":485012,"threads_started":2,"wal-append.queue_time_us":287954}
I20260709 13:05:59.822840 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2320) took 1248 ms. Trace:
I20260709 13:05:59.754508 19004 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:59.775830 18515 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.835923 18515 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:59.838907 18515 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:59.764901 19042 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:59.754199 19107 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:59.846561 19107 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.639750 18942 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.849376 18942 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:59.785763 18968 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:59.767146 19111 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:59.804006 19040 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.861065 19040 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:59.829851 18874 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.863982 18874 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:59.866286 19048 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:59.805486 19000 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.867681 19000 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:59.871731 18968 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.872480 18968 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:05:59.880997 19095 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.881909 19095 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.882081 15337 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 9 to 10, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:59.885566 19102 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.514s	user 0.003s	sys 0.008s
I20260709 13:05:59.886196 19102 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.856796 19111 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:05:59.888948 19111 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:59.888248 15590 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:59.847460 18978 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 13:05:59.893931 19004 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:59.894681 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 298176us
I20260709 13:05:59.924785 19119 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:59.850486 19107 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:05:59.928808 18965 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:59.938252 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.943665 18869 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:59.944381 18869 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:59.945431 18869 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.866683 18874 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:59.931180 18965 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:59.915591 18942 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:59.979678 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.912206 19042 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:05:59.967419 19048 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:59.990167 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 342874us
W20260709 13:05:59.990473 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.972080 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:05:59.992061 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:05:59.979485 18965 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:05:59.995370 19095 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:05:59.997861 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.970140 18808 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:05:59.911810 19004 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:05:59.997282 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:00.019030 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.992663 18968 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:05:59.996683 19040 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:05:59.885620 15337 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.002691 18994 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:59.991389 19042 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:05:59.910427 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 151526us
I20260709 13:05:59.748878 15592 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 5.
I20260709 13:06:00.081744 15337 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 5 to 7, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.827533 15513 rpcz_store.cc:276] 0709 13:05:58.574024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.587760 (+ 13736us) service_pool.cc:224] Handling call
0709 13:05:58.652543 (+ 64783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.994087 (+341544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.994121 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.994613 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.389720 (+395107us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:59.819877 (+430157us) log.cc:844] Serialized 14 byte log entry
0709 13:05:59.821524 (+  1647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.822377 (+   853us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.822448 (+    71us) raft_consensus.cc:1685] finished
0709 13:05:59.822468 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.822735 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":341036,"prepare.queue_time_us":40454,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":348669,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":800448,"threads_started":2,"wal-append.queue_time_us":596955}
I20260709 13:05:59.845067 18977 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:05:59.999374 18993 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:06:00.084227 15337 catalog_manager.cc:5697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.070253 18874 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:00.062755 18935 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:00.091362 15511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.025s	sys 0.058s
W20260709 13:06:00.106158 15511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.025s	sys 0.058s
W20260709 13:06:00.084437 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 321477us
I20260709 13:06:00.082125 18966 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:00.089886 18942 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.069824 18951 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:06:00.061065 19119 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:00.089532 19040 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.089459 18994 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:00.111968 18935 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.103053 18874 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:00.090934 19095 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:06:00.127413 16147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.001s	sys 0.014s
W20260709 13:06:00.132932 16147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.002s	sys 0.014s
W20260709 13:06:00.128607 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 502826us
I20260709 13:06:00.098026 15556 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:00.137271 18515 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:00.137715 19103 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:00.138396 19103 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:00.139442 19103 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.136015 19113 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:00.137979 18515 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.142711 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.111275 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:00.141733 19113 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.144829 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:00.144688 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:00.158341 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:00.158951 15436 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:00.145574 19113 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:00.145859 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:00.146348 18894 raft_consensus.cc:2764] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:06:00.147439 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:00.142383 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.141788 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.148326 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.114001 19102 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:00.148571 18515 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.152107 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:00.152762 16177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.014s	sys 0.009s
I20260709 13:06:00.120282 18966 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:00.121408 19107 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:00.151290 16146 leader_election.cc:400] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5.
I20260709 13:06:00.130172 18874 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.182472 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:00.155563 15337 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:00.157733 15589 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.005s	sys 0.016s
W20260709 13:06:00.184279 15589 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.005s	sys 0.016s
I20260709 13:06:00.115372 18968 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:06:00.119414 18942 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:00.195739 19132 log.cc:927] Time spent T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:06:00.177991 16177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.014s	sys 0.010s
I20260709 13:06:00.178048 15441 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:06:00.094049 18965 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.128418 18967 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:00.183949 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.159121 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:00.193917 15592 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:00.172991 19040 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:00.200345 15585 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:00.199515 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:00.173676 18993 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:00.206231 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:00.208609 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 49484.1us
I20260709 13:06:00.205997 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:00.210105 16180 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.210616 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:00.221746 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.196828 18949 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:06:00.225549 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:00.197320 19026 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:00.223605 15337 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 5 to 6, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.490206 19041 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.490190 19102 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:00.425493 16145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.010s	sys 0.026s
W20260709 13:06:00.420578 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 416069us
W20260709 13:06:00.492370 16145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.011s	sys 0.027s
I20260709 13:06:00.206041 19050 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:06:00.448520 18897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.003s	sys 0.018s
I20260709 13:06:00.249912 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.291088 18411 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.249984 19043 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.514782 19043 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.515837 15518 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:00.516273 15518 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:00.517283 15518 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.518678 15518 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.503531 19050 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:00.448148 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 450897us
I20260709 13:06:00.524478 19050 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.284185 18956 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.238420 15436 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:00.249447 19095 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.246s
I20260709 13:06:00.340088 18935 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.303778 18870 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:00.338572 19143 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 13:06:00.260543 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:00.197113 18907 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:00.488693 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 263220us
W20260709 13:06:00.351119 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 110032us
I20260709 13:06:00.276067 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:00.448385 18762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.014s	sys 0.029s
W20260709 13:06:00.414132 19111 consensus_meta.cc:287] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.002s
I20260709 13:06:00.280714 16180 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:00.210466 18968 raft_consensus.cc:476] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Not starting pre-election -- already a leader
W20260709 13:06:00.504616 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.517660 19043 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.197536 19005 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.329691 18872 raft_consensus.cc:3055] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:00.491321 19102 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.559896 18872 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:00.542855 18935 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.560631 18935 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.561082 18872 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.561728 19102 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:00.508664 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:00.283138 18966 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.221345 18894 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:00.251674 18942 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:00.562726 18872 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:00.303239 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.564029 18935 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.564615 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:00.250072 19007 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:00.565704 19007 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.310367 18879 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:00.567777 18879 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:00.494338 19000 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.626s	user 0.017s	sys 0.002s
I20260709 13:06:00.568775 19000 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.571110 19000 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.272702 18815 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.206498 18994 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.571833 18815 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.514149 15513 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:00.574855 15434 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:00.524080 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:00.191696 19107 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.330718 19042 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:00.581715 15586 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:06:00.582199 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44329.7us
I20260709 13:06:00.582325 18978 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:00.583074 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:00.583676 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.584080 18978 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:00.584717 18978 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:00.585842 18978 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.586515 16177 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:00.587035 18907 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:00.588441 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.589555 18907 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.590344 16182 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:06:00.591741 19139 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.592348 19139 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.558920 19005 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:06:00.594696 19139 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.595974 19005 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:00.596566 18874 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.597291 19107 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:00.597995 15439 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:00.599036 18874 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.599464 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:00.600174 18879 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.601408 18879 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.210870 18993 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:00.620424 15518 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:06:00.620936 15518 pending_rounds.cc:85] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 7
I20260709 13:06:00.621165 15518 pending_rounds.cc:107] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:06:00.621650 15518 raft_consensus.cc:2889] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.491808 15337 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.623839 15337 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 5, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.208670 19113 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.300s
W20260709 13:06:00.508419 18897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.005s	sys 0.019s
I20260709 13:06:00.482053 19040 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:00.525851 19050 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:00.628453 16181 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:00.508073 19041 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.283269 19037 consensus_queue.cc:1059] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.246s
I20260709 13:06:00.540203 15556 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:00.542687 15442 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:00.548748 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:00.549669 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:00.630800 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 90697.4us
I20260709 13:06:00.550395 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:00.414289 18945 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.784s	user 0.015s	sys 0.000s
I20260709 13:06:00.544883 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.554700 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.554517 19111 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:00.555958 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.261862 18965 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.562727 15511 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:00.574225 18815 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:00.577872 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.577698 19152 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:00.642663 18874 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:00.283893 19004 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.643319 18874 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:00.643910 19004 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.644446 19004 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.644485 18874 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.646955 19004 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:00.544314 18762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.015s	sys 0.031s
W20260709 13:06:00.604142 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.604007 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.604359 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:00.649493 15590 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:00.600310 16177 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.651594 19156 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.652230 19156 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.654832 19156 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.621071 16175 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.655714 18755 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.655841 18993 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.656411 18755 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.657310 18993 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.658743 18755 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.282332 18961 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.536851 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:00.633405 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:00.660828 16180 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
W20260709 13:06:00.660984 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 124262us
I20260709 13:06:00.633885 15584 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:00.662667 18961 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:00.663040 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:00.528201 15435 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:00.663596 18961 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:00.709260 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:00.636454 19107 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:00.711994 18977 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:00.714529 18411 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.715183 18411 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.664011 19113 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:00.665346 19111 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:00.665649 18897 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:00.665810 19127 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:00.634068 15556 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:00.670703 15592 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:00.643071 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.672343 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.676597 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.676914 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.678354 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.679050 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:00.679330 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.686934 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.690812 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.648820 18874 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.694458 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.719285 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2306) took 1285 ms. Trace:
I20260709 13:06:00.785496 15518 pending_rounds.cc:85] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:06:00.785880 15518 pending_rounds.cc:107] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:06:00.730003 15515 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:06:00.673512 18968 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.736289 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:00.733923 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45674.1us
I20260709 13:06:00.747184 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:00.636256 19041 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.751987 15586 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:00.800570 15518 raft_consensus.cc:2889] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.690645 19152 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:00.787036 15439 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
W20260709 13:06:00.786280 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68920.3us
I20260709 13:06:00.811888 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.813495 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.655462 19156 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.725039 19151 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:00.822407 16175 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:06:00.823083 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.799046 15515 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.824555 15515 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.824864 16177 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:00.793918 15591 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:00.784569 15589 rpcz_store.cc:276] 0709 13:05:59.434231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.435125 (+   894us) service_pool.cc:224] Handling call
0709 13:05:59.435409 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.435761 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:00.184902 (+749141us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.710588 (+525686us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.718715 (+  8127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.718812 (+    97us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:00.718901 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.719031 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.719222 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7598,"prepare.queue_time_us":543179,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":6155,"raft.queue_time_us":34820,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6460,"spinlock_wait_cycles":62250240,"thread_start_us":1252562,"threads_started":3,"wal-append.queue_time_us":451673}
I20260709 13:06:00.749514 15509 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:00.802424 15512 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:00.804065 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:06:00.819290 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.826706 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:00.827049 15438 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:00.827386 15512 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:00.828061 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.829339 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.804632 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.717835 19107 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:00.831858 19107 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.823879 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.794260 15592 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:00.652243 19040 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.724237 19118 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:00.792460 15588 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:00.835289 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:00.844197 15509 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:00.845232 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:00.845839 15509 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.786479 18902 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:00.839314 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:00.842010 15512 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:00.785967 18870 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:00.731210 19113 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:00.756914 18897 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:00.804915 19007 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:00.806962 19111 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.872247 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:00.873519 15512 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:00.856483 19158 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:06:00.843297 19005 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.840626 19159 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:00.879022 19136 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:06:00.819798 18968 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.883706 18870 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.905241 19159 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:00.836719 19156 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:00.906420 19113 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.860394 19128 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.937492 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:00.882982 18978 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.825734 19152 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.859826 19151 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:00.860034 19148 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:06:00.880402 18902 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.896703 19139 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:06:00.948819 19165 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:00.996573 19160 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:00.996017 19165 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.950466 18942 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.908041 18897 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:00.998736 18942 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:06:00.987100 19119 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.002518 19119 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.975353 18762 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:01.003858 18762 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:01.004459 18762 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:01.005677 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:00.882323 19111 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.957861 19159 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:00.871201 15509 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:00.976481 15513 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.933458 19007 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:01.027827 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:00.993659 19161 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:06:01.007227 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:00.992081 19151 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:01.040563 19164 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:01.040674 18894 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:01.030195 15509 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:00.988445 19113 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:01.027384 15513 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:01.050273 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 112943us
W20260709 13:06:01.053238 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.054783 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:01.055626 15586 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:01.055337 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:01.058854 19119 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:01.059751 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 151776us
I20260709 13:06:01.061774 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:01.063046 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:01.042137 18894 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.028802 19155 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.949599 18945 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.977257 18978 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.072674 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:01.072988 15512 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:01.034220 19118 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.931026 19005 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:01.069581 19166 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:06:01.067708 19000 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.048610 18897 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:01.069253 18995 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:01.130939 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.089849 18966 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:01.153818 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 519789us
I20260709 13:06:01.156370 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:01.094424 19042 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:00.975652 19128 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:01.033456 19007 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.142617 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:01.165099 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:01.151947 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.152626 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:01.159685 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.169117 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.156519 15556 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:01.069504 18808 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:06:01.103953 18879 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:01.099802 19172 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:01.106580 18902 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:01.105214 19041 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.176592 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:01.174803 15513 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.176914 15515 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.144754 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:01.154585 18995 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.178580 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:01.234915 15510 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:01.214462 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:01.096853 18945 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.094655 19155 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:01.161038 19168 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.163842 19111 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.250322 15515 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.197999 18949 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:01.166718 19156 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:06:01.206823 18942 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:01.177902 18968 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.195824 16146 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:01.272367 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 76683.6us
I20260709 13:06:01.155531 19000 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.195905 18870 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:01.242091 18995 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:01.214605 19185 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:01.207824 19165 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.235076 15586 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:01.276032 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:01.300606 15587 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:01.173475 19042 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.173022 19162 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:06:01.147717 19118 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.291293 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:01.422271 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 277369us
I20260709 13:06:01.427616 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.429661 15406 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:01.430604 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:01.430768 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:01.424546 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.242553 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 97093.6us
I20260709 13:06:01.431867 15518 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:01.432765 15515 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:01.434899 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.435415 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:01.441176 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:01.442704 15515 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:01.452530 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 295907us
I20260709 13:06:01.456773 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:01.460469 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:01.328068 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 54719.6us
W20260709 13:06:01.467249 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.266448 18815 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:01.486057 18815 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:01.486892 18815 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:01.487114 18872 consensus_meta.cc:287] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.867s	user 0.012s	sys 0.011s
I20260709 13:06:01.337168 18907 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:01.303205 18879 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:01.496063 16173 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
W20260709 13:06:01.330485 18965 consensus_meta.cc:287] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.671s	user 0.016s	sys 0.002s
I20260709 13:06:01.497198 18942 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.350797 18894 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.495739 18879 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.504961 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:01.507258 15583 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 10: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:01.495030 18945 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:01.274566 18966 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:01.548758 18945 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.549896 18945 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:01.339761 18993 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.682s	user 0.015s	sys 0.002s
I20260709 13:06:01.309000 19005 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:01.557348 19005 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:01.292133 19037 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:01.560319 19037 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:01.561347 19037 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:01.255045 19041 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:01.295476 19111 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:06:01.565667 19005 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:01.304337 19152 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:01.359351 19000 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.491350 18808 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:01.519685 19118 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:01.498389 18942 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:01.644629 18942 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:01.359875 19050 consensus_meta.cc:287] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.015s
I20260709 13:06:01.356611 19128 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.378760 19155 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.264649 19168 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.236445 19170 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:06:01.200131 19172 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.656116 15440 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:01.656674 19170 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:01.657058 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:01.657178 19170 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:01.307150 19177 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:06:01.357861 19178 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.152s	user 0.000s	sys 0.002s
W20260709 13:06:01.373926 19169 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:06:01.377046 19173 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.386s	user 0.000s	sys 0.003s
I20260709 13:06:01.672454 15330 maintenance_manager.cc:419] P 7478e1667cd24e1eb33dcbc8ac104877: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033354
I20260709 13:06:01.513825 19007 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:01.316725 19189 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:06:01.484648 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:01.624306 15409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.008s	sys 0.008s
I20260709 13:06:01.641554 18945 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:01.550336 18966 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.648164 18808 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:01.648568 15512 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:01.654584 19168 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:01.655167 19159 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:01.688999 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 473408us
I20260709 13:06:01.698791 19042 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:01.775875 18978 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:01.785368 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.677196 19005 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:01.837968 18815 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.838923 19200 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:01.695016 15589 raft_consensus.cc:2410] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:01.846552 19152 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:01.846823 18874 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.051s	user 0.041s	sys 0.009s
W20260709 13:06:01.824234 15435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.013s	sys 0.017s
I20260709 13:06:01.847695 19172 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:01.848996 19170 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.853585 15518 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:01.871800 15515 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:01.873430 19000 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:01.880270 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2328) took 1175 ms. Trace:
I20260709 13:06:01.854933 19095 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:01.886200 19050 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.886049 18808 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.894234 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2360) took 1115 ms. Trace:
I20260709 13:06:01.894902 18978 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.895910 19199 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:01.897344 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 388) took 1220 ms. Trace:
I20260709 13:06:01.903714 18894 raft_consensus.cc:2764] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:06:01.904080 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 469045us
I20260709 13:06:01.904564 18935 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:01.907169 15509 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:01.912623 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2350) took 1174 ms. Trace:
I20260709 13:06:01.912289 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:01.926929 15435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.014s	sys 0.018s
I20260709 13:06:01.858721 19205 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.912396 19007 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:01.939419 15511 rpcz_store.cc:276] 0709 13:06:00.719334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.719583 (+   249us) service_pool.cc:224] Handling call
0709 13:06:00.719927 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.843159 (+123232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.843210 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.843274 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:00.843583 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.692730 (+849147us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400294854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:01.857060 (+164330us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.893717 (+ 36657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282839808}
I20260709 13:06:01.936133 15442 rpcz_store.cc:276] 0709 13:06:00.676516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.676667 (+   151us) service_pool.cc:224] Handling call
0709 13:06:01.896745 (+1220078us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54002d0d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:01.897026 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908710144}
I20260709 13:06:01.927999 19095 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:01.949157 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.916355 19037 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:01.953370 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 469003us
I20260709 13:06:01.954620 19050 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:01.955624 19107 consensus_meta.cc:287] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.106s	user 0.008s	sys 0.026s
I20260709 13:06:01.955711 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.956291 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1844) took 1196 ms. Trace:
I20260709 13:06:01.978333 15438 rpcz_store.cc:276] 0709 13:06:00.747116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.830312 (+ 83196us) service_pool.cc:224] Handling call
0709 13:06:00.830678 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.830922 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.830947 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:00.831443 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.073988 (+242545us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:01.074040 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.074133 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:01.930336 (+856203us) raft_consensus.cc:1685] finished
0709 13:06:01.935041 (+  4705us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.943938 (+  8897us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":191223,"threads_started":1,"wal-append.queue_time_us":315723}
I20260709 13:06:01.956832 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.956560 19205 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:01.943930 19007 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:01.943519 19000 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.960110 19152 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:01.961346 18968 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:01.961429 18755 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:01.962828 18978 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:01.963943 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2370) took 1124 ms. Trace:
W20260709 13:06:01.964913 18762 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.960s	user 0.016s	sys 0.015s
I20260709 13:06:01.930531 15517 rpcz_store.cc:276] 0709 13:06:00.741946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.742092 (+   146us) service_pool.cc:224] Handling call
0709 13:06:00.742450 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.742859 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.742889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:00.743421 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.058421 (+315000us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:01.058466 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.058544 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:01.373395 (+314851us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:01.674757 (+301362us) raft_consensus.cc:1685] finished
0709 13:06:01.674810 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.856931 (+182121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1067,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":40923,"spinlock_wait_cycles":13932928,"thread_start_us":314458,"threads_started":1,"wal-append.queue_time_us":415753}
I20260709 13:06:01.964792 19095 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:01.968804 19103 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:01.970221 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.974269 15514 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:01.982261 15511 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:01.982533 19007 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:01.987818 15510 rpcz_store.cc:276] 0709 13:06:00.839831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.033467 (+193636us) service_pool.cc:224] Handling call
0709 13:06:01.033790 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.236024 (+202234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.963271 (+727247us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400203ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:01.963703 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447052032}
I20260709 13:06:02.002168 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2361) took 1141 ms. Trace:
I20260709 13:06:02.004508 15516 rpcz_store.cc:276] 0709 13:06:00.742241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.742408 (+   167us) service_pool.cc:224] Handling call
0709 13:06:00.742817 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.989535 (+246718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.989584 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.989629 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:00.989660 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.695050 (+705390us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54002a1054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:01.852804 (+157754us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.883723 (+ 30919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566779136}
I20260709 13:06:02.015772 19170 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:02.016693 18995 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.715s	user 0.013s	sys 0.017s
I20260709 13:06:02.015695 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:02.015103 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.017395 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.994154 19103 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:02.026796 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.925302 15585 rpcz_store.cc:276] 0709 13:06:00.705066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.725031 (+ 19965us) service_pool.cc:224] Handling call
0709 13:06:00.725590 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.726160 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:00.944492 (+218332us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b1800437bc0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78be4c0a 00007fcf82324219 00007fcf78c6ca40 00007fcf78c674e4 00007fcf78c67455 00007fcf7f74f3c7 00007fcf7bd619a7 00007fcf7bd710bf 00007fcf7bd71038
0709 13:06:00.959134 (+ 14642us) log.cc:844] Serialized 14 byte log entry
0709 13:06:01.464922 (+505788us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.466406 (+  1484us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.466841 (+   435us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:01.466905 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.467123 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:01.878083 (+410960us) raft_consensus.cc:1685] finished
0709 13:06:01.879786 (+  1703us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.880015 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15812,"prepare.queue_time_us":156308,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":90182,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":31632,"spinlock_wait_cycles":30127360,"thread_start_us":497756,"threads_started":2,"wal-append.queue_time_us":310810}
I20260709 13:06:02.026657 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.032446 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:01.983412 19107 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.040659 15517 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:02.043813 15515 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:02.045404 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.040831 15516 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:02.009356 18762 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.048842 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.050015 18762 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.050726 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.054814 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:01.992530 18935 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.030007 19095 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.017246 18995 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.061002 15510 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:02.076737 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.071410 18755 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:02.075744 18894 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:02.089874 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56002.7us
I20260709 13:06:02.086653 15511 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:02.088621 19037 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:02.093390 18993 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:06:02.096575 15513 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:02.094993 19206 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:06:02.096909 15514 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:02.098256 15518 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.084537 19172 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:02.098166 18894 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.093816 19209 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:02.106112 15517 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:06:02.103091 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.106928 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40676 (request call id 2353) took 1378 ms. Trace:
I20260709 13:06:02.079692 19050 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.079698 18815 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:02.114284 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1850) took 1053 ms. Trace:
I20260709 13:06:02.115327 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1847) took 1180 ms. Trace:
I20260709 13:06:02.116008 18755 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.119697 18978 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.117342 19191 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:02.122354 19191 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:02.111856 19172 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.118641 15514 rpcz_store.cc:276] 0709 13:06:00.930296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.079131 (+1148835us) service_pool.cc:224] Handling call
0709 13:06:02.096556 (+ 17425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.110913 (+ 14357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.111089 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.125998 19142 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.126986 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:02.126786 19142 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.127974 15517 rpcz_store.cc:276] 0709 13:06:01.060867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.991203 (+930336us) service_pool.cc:224] Handling call
0709 13:06:02.114210 (+123007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.114202 15513 rpcz_store.cc:276] 0709 13:06:00.728371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.730880 (+  2509us) service_pool.cc:224] Handling call
0709 13:06:02.094661 (+1363781us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540036b0d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd4ea3d 00007fcf80d1ecd0 00007fcf7a2a3254 00007fcf7a2a31e2 00007fcf7a2a3111 00007fcf7a2a308c 00007fcf7a2a2342 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:02.106778 (+ 12117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344869248}
I20260709 13:06:02.139022 19103 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.140962 19103 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.142597 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:02.143528 15516 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.143702 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.125037 19191 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.144418 15517 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:02.145227 19191 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.146709 15517 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
W20260709 13:06:02.147716 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.117645 19152 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.153168 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:02.153996 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.149700 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1849) took 1087 ms. Trace:
I20260709 13:06:02.131502 18935 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.159358 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:02.160223 15441 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:02.161132 18993 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:02.161497 15510 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:02.161872 18993 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.162431 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1845) took 1233 ms. Trace:
I20260709 13:06:02.156332 15517 rpcz_store.cc:276] 0709 13:06:01.060581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.145508 (+1084927us) service_pool.cc:224] Handling call
0709 13:06:02.146257 (+   749us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:02.147251 (+   994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.147480 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.129755 19209 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.162878 15510 rpcz_store.cc:276] 0709 13:06:00.929637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.093162 (+1163525us) service_pool.cc:224] Handling call
0709 13:06:02.155506 (+ 62344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:02.162077 (+  6571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.162329 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.161257 15407 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:02.162343 18993 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.168900 15584 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:02.169366 19205 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.172024 18995 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:02.175014 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45607.5us
W20260709 13:06:02.175882 18897 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 1.014s	user 0.021s	sys 0.021s
I20260709 13:06:02.176240 19107 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:02.176184 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:02.176741 19026 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.177932 19204 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:02.177663 19026 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.178562 19204 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:02.184458 19204 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.185479 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:02.185889 18894 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.186607 18894 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:02.187052 18894 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.176755 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1852) took 1115 ms. Trace:
I20260709 13:06:02.187469 18894 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.194643 19172 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.195081 18902 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:02.207893 18902 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:02.208297 18902 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.188494 15511 rpcz_store.cc:276] 0709 13:06:01.061689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.157765 (+1096076us) service_pool.cc:224] Handling call
0709 13:06:02.176040 (+ 18275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.176343 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.176376 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.176435 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:02.176480 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.176552 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.176682 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.202477 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:02.211237 19026 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.211964 15406 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:02.189124 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.189916 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 679) took 1019 ms. Trace:
I20260709 13:06:02.206166 19107 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.262974 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:02.158133 19000 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.213671 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.203773 19037 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.288028 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.213191 19138 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:02.214339 15513 rpcz_store.cc:276] 0709 13:06:01.170480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.188688 (+1018208us) service_pool.cc:224] Handling call
0709 13:06:02.189161 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.189424 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.189457 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.189531 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:02.189579 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.189645 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.189796 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:02.281793 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68355us
I20260709 13:06:02.209903 19209 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.202543 18815 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.193369 18755 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.199186 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:02.288026 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.187773 18978 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:02.304396 15518 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:02.305435 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1856) took 1242 ms. Trace:
I20260709 13:06:02.308156 19172 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.309010 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.308894 19172 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.309753 15513 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:02.310016 15510 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:02.310673 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1866) took 1167 ms. Trace:
I20260709 13:06:02.311722 19037 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.314244 19037 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.314352 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.304113 18978 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:02.315939 18978 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.316219 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.317217 15434 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:02.317150 19000 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:02.318056 19000 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.318785 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.320132 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.320272 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:02.298413 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.618s (SENT) [suppressed 25 similar messages]
I20260709 13:06:02.323426 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.325021 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.306020 15518 rpcz_store.cc:276] 0709 13:06:01.062750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.005834 (+943084us) service_pool.cc:224] Handling call
0709 13:06:02.305341 (+299507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.311000 15510 rpcz_store.cc:276] 0709 13:06:01.143333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.213608 (+1070275us) service_pool.cc:224] Handling call
0709 13:06:02.309621 (+ 96013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.310374 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.310595 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.288398 19142 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.299816 19138 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.342900 15586 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:06:02.334009 19170 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.345113 19000 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.345512 15434 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:02.346401 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.347697 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.348353 19189 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:02.349080 16175 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:02.338510 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.305989 19026 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.363679 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.357318 16175 pending_rounds.cc:85] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Aborting all ops after (but not including) 5
I20260709 13:06:02.364784 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.355175 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:02.366381 15514 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:02.357009 19189 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:02.373806 19172 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.364830 16175 pending_rounds.cc:107] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:02.382936 16175 raft_consensus.cc:2889] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:02.367883 19168 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.384678 19168 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.356705 18995 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:02.371228 19189 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:02.358371 19138 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.392424 15518 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.396075 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.334599 19107 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.402290 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:02.399420 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.407291 15514 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:02.341663 18815 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.409534 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.415352 15587 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:06:02.430932 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.368075 19159 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.439114 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.444868 15592 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:02.435791 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:02.393616 18995 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:02.444538 15406 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:02.410614 19168 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:02.458461 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62646.9us
I20260709 13:06:02.403532 19026 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.468593 15514 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:02.451701 18995 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.473867 15585 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.472666 15583 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:02.445222 19170 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.480582 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:02.472167 15512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1860) took 1402 ms (client timeout 1592 ms). Trace:
I20260709 13:06:02.479017 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:02.483116 15512 rpcz_store.cc:269] 0709 13:06:01.064040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.151625 (+ 87585us) service_pool.cc:224] Handling call
0709 13:06:02.458147 (+1306522us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54002e2a54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:02.466276 (+  8129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103497472}
I20260709 13:06:02.468189 19205 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:02.468427 19142 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:02.496218 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:02.501309 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:02.514240 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1846) took 1766 ms. Trace:
I20260709 13:06:02.497110 19205 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:02.500525 19037 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.498697 19142 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.474046 18993 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.501748 19172 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.525395 19043 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.530193 15584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2320) took 1858 ms (client timeout 1610 ms). Trace:
I20260709 13:06:02.463342 19159 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.533461 15518 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:02.535279 15515 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:02.531469 18411 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.541702 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1859) took 1478 ms. Trace:
W20260709 13:06:02.541172 15584 rpcz_store.cc:269] 0709 13:06:00.671839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.672013 (+   174us) service_pool.cc:224] Handling call
0709 13:06:02.529803 (+1857790us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400114254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:02.530045 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3026595712}
I20260709 13:06:02.542111 15515 rpcz_store.cc:276] 0709 13:06:01.063721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.044908 (+981187us) service_pool.cc:224] Handling call
0709 13:06:02.532040 (+487132us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b5400203428. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b34924 00007fcf80d1d227 00007fcf80d1cab8 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:02.541630 (+  9590us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15429504}
I20260709 13:06:02.535310 19142 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.514832 15435 rpcz_store.cc:276] 0709 13:06:00.747681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.832291 (+ 84610us) service_pool.cc:224] Handling call
0709 13:06:00.832660 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:01.009595 (+176935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.009631 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.010184 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.957824 (+947640us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:01.957898 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.099217 (+141319us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b180014d820. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c382a6 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419
0709 13:06:02.513753 (+414536us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003a6454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:02.513828 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:02.513885 (+    57us) raft_consensus.cc:1685] finished
0709 13:06:02.513907 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.514155 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":731,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"spinlock_wait_cycles":450429568,"thread_start_us":929553,"threads_started":1,"wal-append.queue_time_us":937801}
I20260709 13:06:02.550509 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.533993 19205 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.539986 18755 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.564325 15436 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:02.564221 15591 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:02.575065 19213 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 13:06:02.574797 18755 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.582513 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.585441 15515 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:02.586097 15515 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:02.537560 19037 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.571170 19168 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.613950 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.559170 19172 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:02.662173 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 185792us
W20260709 13:06:02.616912 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 132442us
I20260709 13:06:02.620694 18967 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:06:02.621692 18755 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.613519 19107 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:02.628388 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.570099 18978 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.631735 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.632473 15513 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:02.627022 18894 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.638432 18935 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.644061 19026 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.641822 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:02.646019 19037 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:02.646884 19095 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.586s	user 0.014s	sys 0.000s
W20260709 13:06:02.669487 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.600740 19209 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.568015 19043 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:02.661317 19007 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.639s	user 0.013s	sys 0.001s
I20260709 13:06:02.691569 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.692410 15590 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:02.703449 15437 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:02.707615 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.712458 15585 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:02.610159 19168 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.685688 18755 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.704993 18411 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.692323 15515 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:02.719075 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.721585 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.721760 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.722612 15583 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:06:02.722991 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 82577.9us
W20260709 13:06:02.701229 19204 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.006s
I20260709 13:06:02.719753 18411 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.727685 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.729691 15514 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:02.726325 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:02.731688 15590 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.734624 18411 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.700343 19007 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.743348 15515 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:02.744681 18894 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.718290 19107 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.745496 18894 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:02.745783 19107 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.732789 19209 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.748209 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.773855 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:02.736861 18935 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.733163 19204 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:02.736444 19170 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:02.795663 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:02.777099 15516 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.000s
I20260709 13:06:02.783473 15442 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:02.779938 15510 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:03.113838 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.822177 15515 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:06:03.115370 15515 pending_rounds.cc:85] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 6
W20260709 13:06:03.017117 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.962373 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:02.928292 15583 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:02.973891 19227 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 13:06:03.115456 15516 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:03.119285 15517 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:03.120177 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 2399) took 1004 ms. Trace:
I20260709 13:06:03.120705 15516 rpcz_store.cc:276] 0709 13:06:02.116185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.142211 (+ 26026us) service_pool.cc:224] Handling call
0709 13:06:03.120072 (+977861us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.121032 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.122406 15516 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:03.123018 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2396) took 1166 ms. Trace:
I20260709 13:06:02.917629 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.976811 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1842) took 2230 ms. Trace:
W20260709 13:06:03.123943 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 385216us
W20260709 13:06:02.795821 18902 consensus_meta.cc:287] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.007s
I20260709 13:06:03.125751 15516 rpcz_store.cc:276] 0709 13:06:01.957045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.121599 (+1164554us) service_pool.cc:224] Handling call
0709 13:06:03.122036 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.122756 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.122964 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.155206 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.154551 15443 rpcz_store.cc:276] 0709 13:06:00.745986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.747824 (+  1838us) service_pool.cc:224] Handling call
0709 13:06:00.810531 (+ 62707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.810863 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.810913 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:00.838488 (+ 27575us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.066816 (+228328us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:01.066856 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.068093 (+  1237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:01.672154 (+604061us) raft_consensus.cc:1685] finished
0709 13:06:01.672197 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.976189 (+1303992us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b54003edd50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:02.976551 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8623872,"thread_start_us":175568,"threads_started":1,"wal-append.queue_time_us":280888,"wal-append.run_cpu_time_us":5076,"wal-append.run_wall_time_us":1523630}
I20260709 13:06:03.156348 19235 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:03.156791 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2397) took 1199 ms. Trace:
I20260709 13:06:03.157256 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:03.157472 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.135950 15515 pending_rounds.cc:107] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:06:02.806546 18993 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.779834 19224 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.084832 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2385) took 1208 ms. Trace:
W20260709 13:06:02.779675 19103 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.004s
W20260709 13:06:03.038018 19189 consensus_meta.cc:287] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.003s
I20260709 13:06:03.139770 15590 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
W20260709 13:06:02.926781 19207 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.019s	user 0.001s	sys 0.002s
I20260709 13:06:02.795770 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:02.796841 19026 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:03.158424 15515 raft_consensus.cc:2889] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:03.163568 15512 rpcz_store.cc:276] 0709 13:06:01.876384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.488440 (+612056us) service_pool.cc:224] Handling call
0709 13:06:02.504258 (+ 15818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:02.547977 (+ 43719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.548010 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:02.573832 (+ 25822us) log.cc:844] Serialized 26 byte log entry
0709 13:06:02.683457 (+109625us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:02.683528 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.684372 (+   844us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.084531 (+400159us) raft_consensus.cc:1685] finished
0709 13:06:03.084555 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.084746 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5039,"raft.queue_time_us":7387,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":17260,"thread_start_us":67613,"threads_started":1,"wal-append.queue_time_us":476662}
I20260709 13:06:02.785573 19223 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:03.021914 18995 consensus_meta.cc:287] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.008s
I20260709 13:06:03.172142 19209 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:02.741439 18755 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:02.779675 19230 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:02.965966 18935 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:02.877957 18894 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:03.164425 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:03.154914 18902 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.125150 19159 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:03.165524 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.157967 15443 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:02.980346 16173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52910 (request call id 422) took 2420 ms (client timeout 1862 ms). Trace:
I20260709 13:06:03.157230 15516 rpcz_store.cc:276] 0709 13:06:01.957418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.155790 (+1198372us) service_pool.cc:224] Handling call
0709 13:06:03.156195 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.156407 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.156434 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.156487 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:03.156516 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.156580 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.156712 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.162307 19208 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.273s	user 0.004s	sys 0.000s
W20260709 13:06:03.165882 19142 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.595s	user 0.014s	sys 0.000s
I20260709 13:06:03.173110 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:02.918292 19138 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.172355 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:03.177754 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2386) took 1301 ms. Trace:
I20260709 13:06:03.180907 15583 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:03.186554 15515 rpcz_store.cc:276] 0709 13:06:01.876911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.546081 (+669170us) service_pool.cc:224] Handling call
0709 13:06:02.560767 (+ 14686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.177533 (+616766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.177701 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.187345 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:03.187513 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.189320 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.189714 15515 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:03.190501 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.181157 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.164300 16175 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:03.172304 18995 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.186053 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.194710 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.195515 15585 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:06:03.197790 15516 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:03.183382 18978 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:03.199157 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.199391 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.167676 19189 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.199625 15438 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:03.201638 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.204068 18907 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:03.204782 15585 raft_consensus.cc:2393] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:03.205775 15435 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:03.203965 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2398) took 1219 ms. Trace:
I20260709 13:06:03.206952 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:03.207676 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.206480 15512 rpcz_store.cc:276] 0709 13:06:01.984538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.170589 (+1186051us) service_pool.cc:224] Handling call
0709 13:06:03.183929 (+ 13340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.198941 (+ 15012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.198984 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.203593 (+  4609us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:03.203649 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.203715 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.203878 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.207785 16175 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:03.210590 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.204972 15590 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:03.211349 15442 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:03.180796 19026 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.173316 19224 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:03.185827 16173 rpcz_store.cc:269] 0709 13:06:00.563380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.564249 (+   869us) service_pool.cc:224] Handling call
0709 13:06:02.979814 (+2415565us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54005c3fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:02.980184 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139442560}
W20260709 13:06:03.215754 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 494004us
I20260709 13:06:03.217959 15439 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:03.219753 15592 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:03.220590 15434 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:03.202831 18894 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:03.191715 19142 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.221256 16180 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:03.225210 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:03.226976 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.227934 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.228173 19172 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.228809 19204 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:03.240739 18755 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.242496 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:03.243659 16173 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:03.246287 19026 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.248049 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.249116 19200 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:03.183610 19230 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:03.232326 15589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2344) took 2067 ms (client timeout 2101 ms). Trace:
W20260709 13:06:03.255743 15589 rpcz_store.cc:269] 0709 13:06:01.165396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.176162 (+ 10766us) service_pool.cc:224] Handling call
0709 13:06:03.231897 (+2055735us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540024ac54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:03.232219 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019602176}
I20260709 13:06:03.236569 18935 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.238077 19095 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.230103 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:03.253580 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.258013 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.263836 15583 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:03.260178 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:03.254684 15436 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:06:03.261215 18935 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.263633 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:03.265250 15590 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:03.265759 19200 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:03.266726 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 678) took 2161 ms. Trace:
I20260709 13:06:03.267004 18935 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.267822 19151 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:03.268187 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.268303 19151 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.268949 19151 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:03.269194 19043 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.267208 15517 rpcz_store.cc:276] 0709 13:06:01.105816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.163972 (+1058156us) service_pool.cc:224] Handling call
0709 13:06:03.119007 (+955035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:03.119704 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.266488 (+146784us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400294d50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:03.266653 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097835392}
I20260709 13:06:03.271351 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:03.273530 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2395) took 1316 ms. Trace:
I20260709 13:06:03.251756 18902 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.275167 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.279410 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.280184 15590 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:03.284571 18995 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:03.288595 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.274232 15513 rpcz_store.cc:276] 0709 13:06:01.956713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.681500 (+724787us) service_pool.cc:224] Handling call
0709 13:06:02.695227 (+ 13727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.785330 (+ 90103us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:03.161162 (+375832us) log.cc:844] Serialized 14 byte log entry
0709 13:06:03.273112 (+111950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.273188 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:03.273243 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.273324 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.273463 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":391717,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"thread_start_us":348315,"threads_started":2}
I20260709 13:06:03.290082 15442 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.290239 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.292553 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.293576 15590 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:03.294778 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:03.296085 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.296887 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.301087 19168 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:03.302757 15434 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:03.304390 15434 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:03.305639 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.306300 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.305712 15434 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:03.307000 15583 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:03.308171 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:03.308689 15434 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:03.308869 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.308578 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:03.308249 16173 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:03.277704 19204 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:03.308934 15583 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:03.315825 19204 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.316102 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:03.306596 15588 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:03.319990 19142 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.305732 15442 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:06:03.312496 15589 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:03.296139 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:03.316367 19204 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:03.323414 15590 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:03.270768 19095 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.325878 19095 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:03.281561 19043 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:03.312027 19224 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.328598 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:03.328907 19237 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:06:03.329669 15589 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:03.318204 16176 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:03.332008 15585 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:03.332111 15583 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:03.332882 15587 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:03.333357 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1844) took 2404 ms. Trace:
I20260709 13:06:03.333755 15509 rpcz_store.cc:276] 0709 13:06:00.928976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.045965 (+116989us) service_pool.cc:224] Handling call
0709 13:06:01.046453 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:01.958237 (+911784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.333031 (+1374794us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54001e55d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:03.333265 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513864448}
I20260709 13:06:03.334730 15587 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:03.333675 15585 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:03.338567 15583 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:03.341307 19168 consensus_queue.cc:1059] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:03.347014 18815 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:03.350735 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 82682.3us
I20260709 13:06:03.357723 19005 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:03.358431 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:03.358532 19005 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.359247 16181 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:06:03.359863 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:03.357769 19095 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:03.360737 19095 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.361354 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.362555 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.362913 19007 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:03.363394 15440 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 1971) took 3223 ms (client timeout 1839 ms). Trace:
I20260709 13:06:03.363519 15443 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:03.371042 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.371861 15517 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:06:03.379315 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.363826 15440 rpcz_store.cc:269] 0709 13:06:00.140177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.145542 (+  5365us) service_pool.cc:224] Handling call
0709 13:06:03.363165 (+3217623us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540028ffd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:03.363301 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3074727680}
I20260709 13:06:03.377703 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:03.388573 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:03.383793 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:03.373873 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:03.390147 15509 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:03.397604 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.400352 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.409617 18411 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:03.410796 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:03.365172 19205 consensus_meta.cc:287] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.795s	user 0.012s	sys 0.000s
I20260709 13:06:03.412714 18411 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:03.422861 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.425060 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.369037 19189 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:03.389217 19005 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:03.434250 15440 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:03.362941 19095 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:03.444447 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:03.446004 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.446708 15509 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:03.420173 19103 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:03.447017 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:03.452785 19107 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:03.455076 15440 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:03.456830 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 79253us
I20260709 13:06:03.465911 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.438817 19043 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:03.470880 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:03.415504 18815 consensus_queue.cc:1059] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:03.411412 19151 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:03.486030 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 75347.6us
I20260709 13:06:03.428114 19205 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.483834 18411 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.497092 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:03.499894 16177 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:03.503906 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.504964 15518 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:03.510218 19151 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:03.511996 15434 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:03.502350 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.514699 15516 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.517318 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.518059 15509 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
W20260709 13:06:03.523768 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.522974 19026 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:06:03.525853 19026 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:03.526321 19240 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:06:03.528348 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.528640 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.473809 19200 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:03.532202 15436 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:03.537009 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:03.536250 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:03.545444 16177 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:03.547128 15509 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:03.542300 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:03.550513 15512 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
W20260709 13:06:03.550557 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50332us
I20260709 13:06:03.518633 18815 consensus_queue.cc:1243] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:03.559235 15516 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:03.526367 19026 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:03.532037 19043 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:03.517218 18966 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:06:03.564663 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:03.562842 15518 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:03.567353 18815 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:03.568917 19229 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:03.534807 19230 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:03.570920 16145 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:03.588032 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 273954us
I20260709 13:06:03.589888 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.588781 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:03.610780 15512 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:03.611220 15556 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:03.610630 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:03.589672 18815 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:03.629500 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 161684us
I20260709 13:06:03.560702 18902 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:06:03.552620 19204 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.630966 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:03.631242 18872 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:03.636389 18872 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.636857 18872 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.637693 19172 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:03.638039 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.639236 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2360) took 1034 ms. Trace:
I20260709 13:06:03.585966 19151 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:03.585685 18993 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:06:03.669257 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.839s (SENT)
I20260709 13:06:03.639684 15591 rpcz_store.cc:276] 0709 13:06:02.605362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.605517 (+   155us) service_pool.cc:224] Handling call
0709 13:06:03.610435 (+1004918us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b5800104a98. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:06:03.639151 (+ 28716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21480320}
I20260709 13:06:03.673527 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:03.680419 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 78223.8us
I20260709 13:06:03.680933 19095 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:03.635524 18815 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.689491 18978 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:03.639922 19199 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:03.697154 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:03.667495 19037 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:03.675071 19142 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:03.699244 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.887s (SENT)
I20260709 13:06:03.703361 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:03.678032 19005 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:03.631220 19230 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:06:03.712603 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:03.714663 15592 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:03.639657 18995 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:06:03.717228 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:03.673310 18894 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:03.715222 15592 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:03.717473 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 128734us
I20260709 13:06:03.672606 18935 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:06:03.695086 19229 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:03.706136 19199 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.698431 18978 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:03.702515 19095 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:03.707062 18966 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:03.732753 19205 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:03.732969 19199 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:03.740051 18993 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:03.735286 19251 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:06:03.693990 19026 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:03.748908 19252 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:06:03.749053 19026 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.735915 19095 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.751823 19007 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:03.752364 19007 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:03.744513 19159 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:03.746827 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.723315 19142 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:03.727599 19200 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:03.788671 15441 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:03.789507 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 2000) took 1061 ms. Trace:
I20260709 13:06:03.778954 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.786624 18872 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:03.791235 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 262650us
I20260709 13:06:03.789969 15441 rpcz_store.cc:276] 0709 13:06:02.732840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.746447 (+1013607us) service_pool.cc:224] Handling call
0709 13:06:03.789413 (+ 42966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.799669 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:03.797894 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 69506.6us
I20260709 13:06:03.771831 18894 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:03.740994 19005 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:03.770509 19095 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:03.788362 19200 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.816668 15592 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:03.823060 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 135242us
I20260709 13:06:03.814728 18993 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:03.824942 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 186953us
I20260709 13:06:03.825667 18993 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.803198 19172 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:03.830016 19172 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.753482 19007 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.832953 19007 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:03.834342 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.835001 15555 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.592s (SENT)
I20260709 13:06:03.836364 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:03.822443 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:03.838245 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:03.805677 19265 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.805142 18966 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:03.815559 18894 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.844432 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.847029 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:03.823665 19200 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:03.851248 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2364) took 1222 ms. Trace:
I20260709 13:06:03.856580 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:03.868964 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:03.941817 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 97479.7us
I20260709 13:06:03.848557 19103 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:03.846784 18894 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.856994 15588 rpcz_store.cc:276] 0709 13:06:02.629147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.320476 (+691329us) service_pool.cc:224] Handling call
0709 13:06:03.320812 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.321103 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:03.477284 (+156181us) log.cc:844] Serialized 14 byte log entry
0709 13:06:03.848161 (+370877us) log.cc:844] Serialized 14 byte log entry
0709 13:06:03.850774 (+  2613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.850847 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:03.850914 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.851010 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.851175 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194591,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":11829,"raft.queue_time_us":246,"thread_start_us":477076,"threads_started":2}
I20260709 13:06:03.853608 19142 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.973320 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:04.063066 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.083281 15518 raft_consensus.cc:2376] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11. Re-sending same reply.
I20260709 13:06:04.044783 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 1991) took 1668 ms. Trace:
I20260709 13:06:04.041741 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2007) took 1031 ms. Trace:
I20260709 13:06:04.065601 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:04.055068 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 220072us
I20260709 13:06:04.084568 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:03.871775 19231 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:03.981242 18966 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.850008 19265 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:03.999120 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1865) took 1264 ms. Trace:
I20260709 13:06:04.122309 15518 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:04.084213 15438 rpcz_store.cc:276] 0709 13:06:02.376428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.376641 (+   213us) service_pool.cc:224] Handling call
0709 13:06:02.402108 (+ 25467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.204228 (+802120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.044500 (+840272us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54003eec54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:04.044707 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833558912}
W20260709 13:06:04.048375 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 105323us
I20260709 13:06:04.125404 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:04.123723 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 58242.4us
I20260709 13:06:04.126914 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:03.848982 18978 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:04.122282 15555 leader_election.cc:336] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.693s (SENT)
I20260709 13:06:04.140650 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:04.123020 15439 rpcz_store.cc:276] 0709 13:06:02.734606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.739435 (+  4829us) service_pool.cc:224] Handling call
0709 13:06:03.998829 (+1259394us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54003034d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:03.999012 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010816896}
I20260709 13:06:04.126236 15518 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:04.142663 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.143635 15518 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:04.124745 15434 rpcz_store.cc:276] 0709 13:06:03.010186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.420086 (+409900us) service_pool.cc:224] Handling call
0709 13:06:03.420550 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.512549 (+ 91999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.041353 (+528804us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b5400120054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:04.041650 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209679232}
I20260709 13:06:03.981673 19005 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.867444 19259 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:03.872413 19262 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:04.127614 19037 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.168917 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:04.166915 19103 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:04.046283 19043 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:04.151681 19159 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:04.152127 18978 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.153731 19026 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:04.154287 19095 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:04.157363 19265 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.157970 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:04.170063 18815 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:03.866377 19204 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:04.159672 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:04.160683 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:04.161700 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:04.162385 19253 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.474s	user 0.000s	sys 0.003s
I20260709 13:06:04.126909 18872 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.189496 16177 raft_consensus.cc:2368] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:06:03.872139 19268 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:04.171290 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 49048.3us
I20260709 13:06:04.190515 19268 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:04.191044 15555 leader_election.cc:336] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.770s (SENT)
I20260709 13:06:04.040119 19138 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.177258 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:04.192543 15585 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.193143 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:04.172096 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.191463 19268 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.196166 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:04.138214 19257 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:06:04.194345 15518 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:06:04.166915 19262 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.201128 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.202060 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.204640 15518 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:04.173708 19043 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:04.207108 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:04.207304 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:04.204994 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:04.207455 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:04.208088 15584 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.208441 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:04.205621 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.179452 19026 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:04.214030 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:03.862155 19229 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:04.212010 15556 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:04.210860 15518 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:04.215029 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.218775 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.220355 15442 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:04.221418 15437 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:04.221858 15437 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:04.224061 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.225013 15518 raft_consensus.cc:2410] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:04.226401 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.227118 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:04.206058 19230 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.226864 15586 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
W20260709 13:06:04.230312 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.778s (SENT)
I20260709 13:06:04.181612 19170 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:04.206439 19262 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.219589 19026 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.235175 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.229779 18411 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:04.221982 19007 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.238554 19263 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:06:04.241312 19199 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.002s
I20260709 13:06:04.242491 19043 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.185949 19259 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:04.249847 15556 leader_election.cc:400] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:06:04.250286 15518 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:04.228753 18879 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.250974 15407 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:04.254336 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:04.333506 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 82628us
I20260709 13:06:04.334410 19205 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:04.335038 19205 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:04.255317 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:04.256517 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:04.257339 19159 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:04.257877 19189 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:04.262903 19272 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:06:04.265033 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.236138 19005 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.273743 18815 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:04.274478 19199 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.247123 18995 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:06:04.278044 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.303855 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 73559us
I20260709 13:06:04.304818 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:04.310652 19278 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:06:04.316998 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1861) took 1660 ms. Trace:
I20260709 13:06:04.319109 16146 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:04.368084 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49061.3us
I20260709 13:06:04.317682 19043 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.323879 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 394) took 1595 ms. Trace:
I20260709 13:06:04.380069 15435 rpcz_store.cc:276] 0709 13:06:02.728743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.737730 (+  8987us) service_pool.cc:224] Handling call
0709 13:06:02.767873 (+ 30143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.206206 (+438333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.323462 (+1117256us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400069854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:04.323803 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006517504}
I20260709 13:06:04.337085 19159 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:04.324774 15556 leader_election.cc:403] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.385390 19159 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:04.396435 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 159057us
I20260709 13:06:04.397289 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:04.403714 18907 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:04.404311 18907 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.404677 18907 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.406481 19159 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.389062 19268 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:04.332010 15584 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:04.335137 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:04.412194 19005 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
W20260709 13:06:04.412684 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 77637.9us
I20260709 13:06:04.414752 18762 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:04.416180 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:04.417135 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.417800 15516 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:06:04.418748 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.421339 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2375) took 2741 ms. Trace:
I20260709 13:06:04.344704 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2393) took 2388 ms. Trace:
I20260709 13:06:04.423859 15514 rpcz_store.cc:276] 0709 13:06:01.955979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.638028 (+682049us) service_pool.cc:224] Handling call
0709 13:06:02.638453 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.730131 (+ 91678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.344433 (+1614302us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b54000ec254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:04.344633 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202244992}
I20260709 13:06:04.390494 19199 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.425284 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.425554 19005 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:04.426108 15514 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:04.426326 19005 consensus_queue.cc:1243] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:04.426981 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.427570 19005 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:04.427963 19005 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:04.327849 15437 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.431988 19107 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:04.431887 19257 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:04.432507 19107 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:04.433619 19107 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:04.434840 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.435015 19107 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.351426 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.435652 19170 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.436147 19170 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.436462 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.437698 19103 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.352809 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.438422 19170 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:04.438350 19103 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.353969 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.439430 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.355079 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 400) took 1478 ms. Trace:
I20260709 13:06:04.440408 15512 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:04.440893 15436 rpcz_store.cc:276] 0709 13:06:02.876296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.314239 (+437943us) service_pool.cc:224] Handling call
0709 13:06:03.314587 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.534762 (+220175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.354815 (+820053us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400059954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:04.355013 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494763776}
I20260709 13:06:04.355075 19200 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.443527 15592 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.444777 19200 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.367723 15589 rpcz_store.cc:276] 0709 13:06:02.660376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.322442 (+662066us) service_pool.cc:224] Handling call
0709 13:06:03.322741 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.330111 (+  7370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.316640 (+986529us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b54001f4854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:04.316919 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15387008}
I20260709 13:06:04.447855 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:04.448670 15584 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:06:04.386418 19205 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.408170 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.408615 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:04.452257 15435 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.338267 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.456252 15518 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:04.440446 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.441787 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.437649 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.457647 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.458355 15518 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:06:04.350101 19189 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:04.435124 15437 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:04.459712 19189 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:04.461046 19189 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:04.373059 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.032s (SENT)
W20260709 13:06:04.471275 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 98300.5us
W20260709 13:06:04.472678 15555 leader_election.cc:336] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.153s (SENT)
I20260709 13:06:04.473152 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:04.462836 19189 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.457254 15509 raft_consensus.cc:2376] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5. Re-sending same reply.
I20260709 13:06:04.421824 15511 rpcz_store.cc:276] 0709 13:06:01.680465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.357244 (+676779us) service_pool.cc:224] Handling call
0709 13:06:03.374722 (+1017478us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:06:03.374928 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.375142 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:03.375477 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 13:06:04.419953 (+1044476us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b180001be20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a
0709 13:06:04.420492 (+   539us) log.cc:844] Serialized 14 byte log entry
0709 13:06:04.420814 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:06:04.420970 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:04.421017 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:04.421070 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.421150 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.421275 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9383,"prepare.queue_time_us":738,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":3959,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":244,"spinlock_wait_cycles":16206720,"thread_start_us":59320,"threads_started":1,"wal-append.queue_time_us":156208}
I20260709 13:06:04.480247 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.480929 15511 raft_consensus.cc:2376] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9. Re-sending same reply.
I20260709 13:06:04.481959 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.483115 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.484405 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.386149 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.486708 15513 raft_consensus.cc:2376] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8. Re-sending same reply.
I20260709 13:06:04.464519 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.488503 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.489262 15512 raft_consensus.cc:2368] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
I20260709 13:06:04.490127 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.459136 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.492055 15517 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:04.419289 18808 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:04.467840 19264 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.494489 19264 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.459287 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.499305 19142 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:06:04.497009 19264 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.419443 15516 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:04.507758 19274 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:04.508368 19274 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.505499 15338 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.507301 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.491225 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.510820 19274 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.504467 18872 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:06:04.513890 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.473049 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.515503 15514 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:06:04.509873 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.526170 15512 raft_consensus.cc:2410] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 12 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:04.325181 15585 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:04.505360 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:04.534190 15437 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
W20260709 13:06:04.535631 15437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1866) took 1800 ms (client timeout 2098 ms). Trace:
I20260709 13:06:04.536345 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.513075 18872 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:04.552230 15586 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:04.553188 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:04.554045 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:04.554504 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:04.555869 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:04.556581 19196 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.556907 19224 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:04.557152 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.558018 15438 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:04.557615 19224 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:04.554657 15590 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:04.559906 18994 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:04.560351 18994 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:04.560763 18994 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.512461 15338 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 6 to 8, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 8 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.418889 19268 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.572989 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:04.575681 16176 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.541189 15518 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:04.599412 15587 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:06:04.599399 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.601003 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:04.602031 15584 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:04.606216 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:04.607276 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:04.559366 19185 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.609752 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:04.614565 18879 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:04.614976 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.600005 15587 pending_rounds.cc:85] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 4
I20260709 13:06:04.617676 15587 pending_rounds.cc:107] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:06:04.618058 15587 raft_consensus.cc:2889] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:04.622182 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:04.625464 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.633658 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:04.640676 15592 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:04.641827 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2375) took 1354 ms. Trace:
I20260709 13:06:04.634954 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:04.676621 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 203956us
W20260709 13:06:04.536037 15437 rpcz_store.cc:269] 0709 13:06:02.734942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.192472 (+1457530us) service_pool.cc:224] Handling call
0709 13:06:04.307200 (+114728us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b4c000afe00. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a023a20 00007fcf7a034a29 00007fcf79ffa644 00007fcf7a021f2d 00007fcf7a021b93 00007fcf7bd5218b 00007fcf7bd52cb5 00007fcf7bd4df30 00007fcf7bd4f7de 00007fcf7bd5b27c 00007fcf80d1cb17
0709 13:06:04.434689 (+127489us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b54004e1720. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccca1d 00007fcf7bcb31a4 00007fcf7bd35447 00007fcf7bd4dfe7 00007fcf7bd4f7de 00007fcf7bd5b27c 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591
0709 13:06:04.535558 (+100869us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15777024}
I20260709 13:06:04.680483 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.680891 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.681427 15440 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:04.623106 15590 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:04.688252 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:04.689762 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 71896.4us
I20260709 13:06:04.695405 16176 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:04.697783 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.392622 18894 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:04.728112 15518 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:04.727628 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:04.729751 15584 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.642560 15592 rpcz_store.cc:276] 0709 13:06:03.287454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.342998 (+ 55544us) service_pool.cc:224] Handling call
0709 13:06:03.343315 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.714545 (+371230us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b54004b08a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd591c0 00007fcf7bd5a231 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c
0709 13:06:04.442970 (+728425us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b580085f4d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd4dfe7 00007fcf7bd4f7de 00007fcf7bd59b49 00007fcf7bd5a416 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4
0709 13:06:04.641442 (+198472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.641741 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157847168}
I20260709 13:06:04.600073 19103 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:04.605913 18815 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.704674 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:04.712113 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:04.740764 15437 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:04.741133 15440 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:04.698504 19168 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:06:04.743013 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:04.746645 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:04.767840 19119 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:06:04.769145 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.770882 18872 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:04.774446 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.557152 19196 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:04.785169 15441 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:04.787565 15515 raft_consensus.cc:2368] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8.
W20260709 13:06:04.736107 15482 connection.cc:256] RPC call timeout handler was delayed by -2.0254929359999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:06:04.795284 15435 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:04.790030 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
W20260709 13:06:04.804579 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.805569 15443 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:04.807379 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:04.839591 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:04.815603 19103 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:04.773510 19191 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:04.844095 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54163.8us
W20260709 13:06:04.854545 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.862816 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69741us
I20260709 13:06:04.868228 15434 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:04.796425 19200 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:04.871770 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:04.605072 19005 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:04.879125 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.812019 19224 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:04.891060 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.892040 15518 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.889443 18907 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:04.900388 18907 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.860042 18762 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:04.860555 19260 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.860940 19268 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:04.877452 18872 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:04.887416 18978 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.706s	user 0.027s	sys 0.000s
I20260709 13:06:04.914618 18894 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:04.888568 19026 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.002s
I20260709 13:06:04.890357 19007 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.939746 19026 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:04.958752 19026 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.960291 18894 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.876991 19103 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:04.961585 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:04.912017 19235 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.963645 16177 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:04.969332 15512 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.977538 15436 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
W20260709 13:06:04.923300 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 83868.6us
I20260709 13:06:04.980022 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:04.941023 19274 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.981881 19103 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:04.966383 19043 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.588s	user 0.015s	sys 0.002s
I20260709 13:06:04.931387 18762 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:05.003979 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:04.974141 15584 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:05.012341 19196 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:04.926205 19260 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.016333 19260 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:04.931886 19268 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.019189 19268 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:05.020172 19043 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:05.020982 19292 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:05.021785 18762 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.023737 19043 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:05.024173 19043 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.024581 19043 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:05.005733 19286 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:06:05.032380 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:05.041708 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.042711 15515 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:05.044641 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.046303 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:05.048444 15518 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:04.942006 19007 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:05.005437 19189 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.001s
I20260709 13:06:05.044713 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:05.070541 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:05.059389 16177 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:04.984676 18894 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.056042 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2394) took 3099 ms. Trace:
I20260709 13:06:05.057816 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.082648 15510 rpcz_store.cc:276] 0709 13:06:01.956354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.660277 (+703923us) service_pool.cc:224] Handling call
0709 13:06:02.682837 (+ 22560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.779777 (+ 96940us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:03.253605 (+473828us) log.cc:844] Serialized 14 byte log entry
0709 13:06:04.276528 (+1022923us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b1800347440. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7f74f3c7 00007fcf7bd619a7 00007fcf7bd710bf 00007fcf7bd71038
0709 13:06:04.534011 (+257483us) log.cc:844] Serialized 14 byte log entry
0709 13:06:04.908815 (+374804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:04.908883 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:04.908942 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.055726 (+146784us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b5400296154. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:05.055789 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.055958 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70760,"prepare.queue_time_us":35465,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":1309,"raft.queue_time_us":86616,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":13221,"spinlock_wait_cycles":166747136,"thread_start_us":721436,"threads_started":3,"wal-append.queue_time_us":228924}
I20260709 13:06:05.058982 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:05.089699 15555 leader_election.cc:336] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.692s (SENT)
I20260709 13:06:05.047295 15515 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:05.098224 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:05.101598 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.104604 15509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.032s	sys 0.043s
W20260709 13:06:05.092281 19262 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.846s	user 0.012s	sys 0.002s
I20260709 13:06:05.081861 19260 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:05.111155 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 244123us
I20260709 13:06:05.036783 18994 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.095690 19168 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.117537 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:05.129695 15515 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
W20260709 13:06:05.111817 19107 consensus_meta.cc:287] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.005s
I20260709 13:06:05.111779 19260 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:05.105754 15509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.032s	sys 0.043s
I20260709 13:06:05.144490 15438 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:05.160818 15583 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:06:05.161389 15583 pending_rounds.cc:85] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 5
I20260709 13:06:05.161689 15583 pending_rounds.cc:107] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:06:05.162024 15583 raft_consensus.cc:2889] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.112135 19262 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:05.158066 19231 consensus_meta.cc:287] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.037s	user 0.007s	sys 0.010s
I20260709 13:06:05.158427 19260 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.225688 15518 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:05.248751 16174 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:05.266961 16178 raft_consensus.cc:2368] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9.
I20260709 13:06:05.270999 16175 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:05.213022 19231 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:05.287609 19007 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:05.287951 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2425) took 1566 ms. Trace:
I20260709 13:06:05.288662 15509 rpcz_store.cc:276] 0709 13:06:03.726806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.511466 (+784660us) service_pool.cc:224] Handling call
0709 13:06:04.511836 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:04.512310 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.512337 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:04.512925 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.146061 (+633136us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:05.146100 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.146162 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.287600 (+141438us) raft_consensus.cc:1685] finished
0709 13:06:05.287635 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.287858 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2412,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":24315,"thread_start_us":630944,"threads_started":1,"wal-append.queue_time_us":758174}
I20260709 13:06:05.290901 19262 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.193222 19185 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:06:05.295423 19043 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.298925 15515 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:05.301812 18894 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.302513 18894 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.303179 18894 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:05.312263 15512 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:05.321040 16145 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:05.304342 19300 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:06:05.315477 19289 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:06:05.297830 19274 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:05.337822 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.338562 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 235316us
W20260709 13:06:05.327196 18808 consensus_meta.cc:287] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.833s	user 0.015s	sys 0.002s
W20260709 13:06:05.341885 15555 leader_election.cc:336] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.111s (SENT)
I20260709 13:06:05.325513 19268 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:05.364694 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 248928us
I20260709 13:06:05.368402 16179 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:05.369344 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2422) took 1648 ms. Trace:
I20260709 13:06:05.362498 19268 raft_consensus.cc:697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:05.375765 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:05.389957 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.393460 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51615.8us
W20260709 13:06:05.398281 15555 leader_election.cc:336] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.188s (SENT)
I20260709 13:06:05.398734 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:05.367769 19294 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:05.417201 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:05.418510 19313 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.419075 19313 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:05.419498 19313 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.420547 18894 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:05.420514 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:05.421701 18894 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.422601 18894 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.422817 19306 raft_consensus.cc:2764] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:05.425361 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:05.427477 19306 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:05.427670 19317 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.427990 19306 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.428486 19306 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.428392 19317 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.428908 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:05.430775 19305 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:05.430902 19317 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.431432 19305 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:05.431474 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:05.433050 18994 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:05.432580 19305 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.434553 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:05.436342 19043 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:05.436721 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.437034 19043 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:05.437739 19043 raft_consensus.cc:2764] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:05.438371 19043 consensus_queue.cc:1059] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:05.439713 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:05.440238 19268 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:05.445179 19281 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.745s	user 0.006s	sys 0.000s
I20260709 13:06:05.450157 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:05.453142 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.461020 15338 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 5 to 7, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:06:05.450551 19301 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:06:05.453181 19274 raft_consensus.cc:3055] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:05.470194 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 71954.4us
W20260709 13:06:05.477052 19308 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:06:05.479014 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2428) took 1675 ms. Trace:
I20260709 13:06:05.470191 19007 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.473060 18815 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.479480 15511 rpcz_store.cc:276] 0709 13:06:03.803652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.549174 (+745522us) service_pool.cc:224] Handling call
0709 13:06:04.624472 (+ 75298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:04.678947 (+ 54475us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:05.001029 (+322082us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.325860 (+324831us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.326554 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.326739 (+   185us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:05.326785 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.326883 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.478747 (+151864us) raft_consensus.cc:1685] finished
0709 13:06:05.478771 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.478941 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29885,"prepare.queue_time_us":290124,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":83,"raft.queue_time_us":72888,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":50672,"thread_start_us":549574,"threads_started":2,"wal-append.queue_time_us":375321}
I20260709 13:06:05.480785 18815 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.472450 19274 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:05.484577 19274 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.485972 19274 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.488009 19095 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.488756 19095 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:05.490201 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.493422 19316 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.494143 19316 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.495082 19231 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.495702 19231 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.498147 19231 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:05.499210 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2426) took 1699 ms. Trace:
I20260709 13:06:05.499698 15514 rpcz_store.cc:276] 0709 13:06:03.800013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.516288 (+716275us) service_pool.cc:224] Handling call
0709 13:06:04.516700 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:04.545553 (+ 28853us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:05.005841 (+460288us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.334716 (+328875us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:05.351387 (+ 16671us) log.cc:844] Serialized 52 byte log entry
0709 13:06:05.361683 (+ 10296us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:05.362111 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.366325 (+  4214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.366436 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.498897 (+132461us) raft_consensus.cc:1685] finished
0709 13:06:05.498930 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.499141 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91307,"prepare.queue_time_us":364019,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":37948,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":16162,"spinlock_wait_cycles":93665152,"thread_start_us":572539,"threads_started":2,"wal-append.queue_time_us":433823}
I20260709 13:06:05.501201 18894 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.503355 19316 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.504269 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:05.505857 19306 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.439249 19043 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:05.467095 19317 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:05.483296 18815 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:05.521469 19043 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:05.522545 19316 raft_consensus.cc:2764] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:05.522137 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.522677 19043 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:05.522243 19317 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.503523 18894 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.528190 19043 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.522143 19095 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:05.530606 19317 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.528627 19313 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.531992 19043 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.534504 19313 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:05.541254 15510 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:05.542421 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.542996 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.567162 15511 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:05.542207 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.541818 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.567657 15591 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:05.543330 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.549705 15515 raft_consensus.cc:1240] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:05.568148 15588 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
W20260709 13:06:05.546847 16146 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.043s	sys 0.039s
W20260709 13:06:05.569023 16146 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.044s	sys 0.039s
I20260709 13:06:05.567579 15584 raft_consensus.cc:2410] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 10 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:05.569486 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 1.19965e+06us
I20260709 13:06:05.569124 15592 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:05.542862 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.570744 15587 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:05.572894 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.573697 15512 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:05.577016 18994 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.577929 19313 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.577745 15512 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:05.577725 18994 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.544023 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:05.527283 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 53861.4us
I20260709 13:06:05.583566 15585 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
W20260709 13:06:05.588292 15555 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.883s (SENT)
I20260709 13:06:05.588184 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.588918 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:05.589159 15585 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:05.590828 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.582909 15514 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:05.594162 15583 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:05.591884 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:05.568331 15586 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:05.541138 19306 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.620643 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:05.617002 16146 connection.cc:256] RPC call timeout handler was delayed by -1.0095362959999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:06:05.633052 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.633059 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:05.636747 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.637763 15583 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:05.623905 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:05.645326 15585 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:05.651080 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.651371 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:05.652366 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 64098.8us
I20260709 13:06:05.653568 15585 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
W20260709 13:06:05.654377 15555 leader_election.cc:336] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.618s (SENT)
I20260709 13:06:05.655053 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:05.587729 15587 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:05.593405 19107 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.594592 18815 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:05.657272 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.666147 15588 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.578624 19313 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.621688 18762 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:05.662325 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:05.664083 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.674126 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.683089 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.684419 15592 raft_consensus.cc:2368] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 10. Current term is 11.
I20260709 13:06:05.688382 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:05.689347 16176 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:06:05.636698 19262 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.647533 19103 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:05.659410 19306 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.660817 19257 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:05.661166 18894 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.665118 19305 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.673981 19007 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.716095 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.734272 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.647579 19260 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.660988 19316 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:05.702392 19191 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:05.745155 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.696385 19315 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.673683 19264 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:06:05.746460 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:05.747306 19288 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.632s	user 0.002s	sys 0.000s
I20260709 13:06:05.747555 19026 consensus_queue.cc:1059] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:05.747839 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:05.676779 18815 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.735232 15511 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:05.773168 15511 raft_consensus.cc:1217] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[7.4-7.4]   Dedup: 7.4->[]
I20260709 13:06:05.745746 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.757651 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.669698 19107 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.702171 18762 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:05.700918 19268 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.774185 15511 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:05.748693 19257 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:05.775702 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:05.772468 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 75523.9us
I20260709 13:06:05.713363 19262 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.730813 19306 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.788153 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:05.787511 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.791923 15518 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:05.773725 19319 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:05.771783 19313 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.797855 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.798524 15583 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.820150 15591 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.825639 19336 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:05.826174 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.828722 15518 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:06:05.829576 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.830531 19103 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.831064 19103 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.833307 15583 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:05.833787 19327 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.834352 19327 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.835474 15438 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:05.836922 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.837359 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.837672 15592 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.838317 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.817181 19191 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:05.840765 19191 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.840886 19333 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:05.841470 19333 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:05.844141 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2423) took 2122 ms. Trace:
I20260709 13:06:05.844063 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.845595 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.844681 15516 rpcz_store.cc:276] 0709 13:06:03.721197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.508514 (+787317us) service_pool.cc:224] Handling call
0709 13:06:04.508897 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.519309 (+ 10412us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:04.917672 (+398363us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.383193 (+465521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:05.383249 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:05.383293 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.843877 (+460584us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54001e5ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:05.843928 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.844075 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2029,"prepare.queue_time_us":323100,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":176557,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":8808,"spinlock_wait_cycles":48987392,"thread_start_us":802635,"threads_started":3,"wal-append.queue_time_us":433838}
I20260709 13:06:05.846865 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.817178 19172 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.848759 19328 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:06:05.851859 18994 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:05.852157 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:05.852754 19329 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:06:05.852077 19172 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:05.854324 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2427) took 2051 ms. Trace:
I20260709 13:06:05.854640 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.855520 15585 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.854722 15513 rpcz_store.cc:276] 0709 13:06:03.803282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.517054 (+713772us) service_pool.cc:224] Handling call
0709 13:06:04.517548 (+   494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:04.541793 (+ 24245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.541843 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:04.590393 (+ 48550us) log.cc:844] Serialized 52 byte log entry
0709 13:06:05.601215 (+1010822us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b180037b4c0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:05.646853 (+ 45638us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:05.646921 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.647019 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.842775 (+195756us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b480021e7d8. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf80c80aa1 00007fcf80c77b37 00007fcf80c779ca 00007fcf80d6f26f 00007fcf80d6ef37 00007fcf80d8355c 00007fcf80d83508 00007fcf80d83488 00007fcf80d83443 00007fcf80d826ec 00007fcf7fcaca96
0709 13:06:05.854061 (+ 11286us) raft_consensus.cc:1685] finished
0709 13:06:05.854087 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.854249 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22629,"raft.queue_time_us":38291,"raft.run_cpu_time_us":4735,"raft.run_wall_time_us":1285603,"spinlock_wait_cycles":38120064,"thread_start_us":45300,"threads_started":1,"wal-append.queue_time_us":1102010}
I20260709 13:06:05.858948 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.859405 15516 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:05.855060 19172 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.863575 19262 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:05.863785 19185 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:05.849174 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.785470 16174 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:05.873208 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.873765 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:05.836971 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.841372 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.842684 19333 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.851933 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.882443 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:05.883376 15509 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:05.881021 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:05.871479 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 87080.6us
I20260709 13:06:05.874908 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:05.841272 19191 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:05.878751 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.374256 15517 rpcz_store.cc:276] 0709 13:06:03.720987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.492647 (+771660us) service_pool.cc:224] Handling call
0709 13:06:04.492972 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.493202 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:04.773460 (+280258us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.166379 (+392919us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.364756 (+198377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:05.365010 (+   254us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:05.367323 (+  2313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.368518 (+  1195us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.369003 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5909,"prepare.queue_time_us":249361,"prepare.run_cpu_time_us":167,"prepare.run_wall_time_us":11646,"raft.queue_time_us":291781,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":11711,"spinlock_wait_cycles":332416,"thread_start_us":855602,"threads_started":4,"wal-append.queue_time_us":165820}
I20260709 13:06:05.892781 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1872) took 1271 ms. Trace:
I20260709 13:06:05.893554 15436 rpcz_store.cc:276] 0709 13:06:04.621401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.633350 (+ 11949us) service_pool.cc:224] Handling call
0709 13:06:05.892551 (+1259201us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540026be54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:05.892693 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677367680}
I20260709 13:06:05.879856 19231 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:05.881011 19260 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:05.796787 19319 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:05.886158 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:05.888218 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:05.879733 19324 log.cc:927] Time spent T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:06:05.896062 15585 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:06:05.897951 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:05.899072 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:05.907397 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.878713 19306 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:05.916306 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.914601 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:05.918529 19107 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:05.863826 19204 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:06:05.921018 19119 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:05.903921 19043 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.790886 19268 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:05.929629 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:05.930482 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:05.798895 18808 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:06:05.889995 19235 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:05.951076 15511 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:05.971570 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:05.893028 19142 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:06:05.965965 15512 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:05.968391 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:05.987867 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 107568us
W20260709 13:06:05.974337 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.933976 19172 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:05.990178 19172 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:05.988148 15584 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:05.990497 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.990868 19172 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:05.991353 15438 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:05.992177 15584 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:05.994323 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:05.996138 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:05.996819 15585 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:05.989439 19235 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.998085 15585 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:05.967096 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:06.001101 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:06.003891 15556 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:05.950264 19107 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:06:06.003229 15434 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
W20260709 13:06:06.012897 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 237323us
I20260709 13:06:06.017408 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:06.018837 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 51873.9us
I20260709 13:06:06.021883 15438 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:06.023772 15592 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:05.947652 19264 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:06:05.987201 19306 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:06.031971 19306 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:06.032656 19306 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.938397 19260 consensus_queue.cc:1059] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:05.998454 19168 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:06.005632 19235 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:05.950989 19200 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:06:06.015796 19313 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:05.932950 18762 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:06.058038 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.061493 15586 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:06.027333 19209 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:06.098232 15585 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:06.027761 18994 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:06:06.048360 19317 consensus_meta.cc:287] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.000s
I20260709 13:06:05.972762 19119 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:06.099635 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 79955.1us
I20260709 13:06:06.049780 19168 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.120252 15586 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:06.148803 15588 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:06.154453 15588 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:06:06.126861 19337 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 13:06:06.165613 15586 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:06.150496 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 136636us
I20260709 13:06:06.043035 19138 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
W20260709 13:06:06.168542 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 142900us
I20260709 13:06:06.159878 15407 leader_election.cc:400] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9.
I20260709 13:06:06.204084 15407 leader_election.cc:403] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.096978 19231 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:06.174813 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 153178us
I20260709 13:06:06.060767 19264 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:06:06.177915 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:06.001003 19257 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.167758 19317 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.168820 19339 raft_consensus.cc:2764] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:06:06.160211 19313 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:06.217379 15338 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:06.220793 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 76559.6us
I20260709 13:06:06.208698 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:06.159742 18994 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:06.093618 19305 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:06:06.173668 18815 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:06.118742 19142 consensus_queue.cc:1059] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:06:06.224897 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:06.228142 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:06.230034 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52217.6us
I20260709 13:06:06.237380 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:06.244007 16178 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:06.245136 16146 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.205868 19274 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:06.023820 19319 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.208230 19231 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:06.254899 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:06.255234 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:06.258486 15407 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:06.256141 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:06.234556 19138 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.260874 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:06.225886 19348 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:06.249251 19315 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:06.267306 19342 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:06.267881 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:06.269215 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:06.295207 15443 raft_consensus.cc:2376] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8. Re-sending same reply.
I20260709 13:06:06.270061 19334 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:06.272220 19355 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:06.280184 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.502s (SENT)
I20260709 13:06:06.324905 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:06.344331 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.294029 19342 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.357402 16176 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.260114 19274 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.266734 19348 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:06.386772 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 149432us
W20260709 13:06:06.482028 15591 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.003s
I20260709 13:06:06.482455 15591 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:06.483351 15584 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:06.388139 19357 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:06.482599 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:06.389493 19331 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
W20260709 13:06:06.392045 19338 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:06:06.392768 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 134352us
I20260709 13:06:06.404124 19231 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.348591 19264 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.387921 19352 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:06.413617 19347 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.416468 15517 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:06.422134 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 141977us
W20260709 13:06:06.506735 15555 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.655s (SENT)
I20260709 13:06:06.507346 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.390023 19346 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:06:06.280156 19316 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:06:06.352797 19329 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:06:06.370893 19342 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:06.484696 19168 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:06.456769 19317 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.367888 19313 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.453689 18978 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:06.458694 19191 consensus_meta.cc:287] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:06:06.502314 19204 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:06:06.337553 19142 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:06.475746 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:06.441262 19306 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.486390 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:06.491236 16176 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:06.455677 19119 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:06.485523 18894 consensus_meta.cc:287] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.004s
I20260709 13:06:06.417795 18994 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.505863 19352 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:06.456347 19356 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:06.516944 15591 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:06.519245 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:06.495072 19305 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:06.521413 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:06.521667 15555 leader_election.cc:336] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.749s (SENT)
I20260709 13:06:06.566962 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.512388 19347 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.453704 19268 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.510281 19231 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.553517 15513 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
W20260709 13:06:06.563759 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 77427.4us
I20260709 13:06:06.552488 19168 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.585371 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:06.536685 19359 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:06.506832 19264 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.587142 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2399) took 1002 ms. Trace:
I20260709 13:06:06.582998 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:06.587884 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:06.580138 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:06.597561 15440 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
W20260709 13:06:06.588191 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66565.3us
I20260709 13:06:06.589288 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:06.599248 15555 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.867s (SENT)
I20260709 13:06:06.599844 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.601001 19107 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:06.601485 15555 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.891s (SENT)
I20260709 13:06:06.602113 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.583585 15438 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:06.603190 19107 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:06.520390 18879 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:06:06.585667 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:06.604332 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 109716us
W20260709 13:06:06.604970 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.605455 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.605605 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:06.584085 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:06.606588 15591 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:06.607132 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:06.537492 18978 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:06.598359 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:06.608011 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:06.609380 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:06.609889 15591 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:06.610186 15517 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:06.611459 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:06.612463 15435 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:06.597724 15583 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:06.595680 15590 rpcz_store.cc:276] 0709 13:06:05.584946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.585068 (+   122us) service_pool.cc:224] Handling call
0709 13:06:05.585470 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.593657 (+  8187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.593713 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.609217 (+ 15504us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.776990 (+167773us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:05.777030 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.777098 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.586790 (+809692us) raft_consensus.cc:1685] finished
0709 13:06:06.586827 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.587057 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20065,"raft.queue_time_us":15837,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11822,"thread_start_us":79642,"threads_started":1,"wal-append.queue_time_us":157528}
W20260709 13:06:06.594144 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 349078us
I20260709 13:06:06.564850 18894 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:06.612412 15517 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:06.569147 19142 raft_consensus.cc:697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:06.634754 15440 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:06.638506 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:06.634764 16146 leader_election.cc:400] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 10. Current term is 11.
I20260709 13:06:06.636178 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:06.639217 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:06.596876 19235 consensus_meta.cc:287] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.004s
I20260709 13:06:06.639847 16146 leader_election.cc:403] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.639897 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.572714 19358 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:06.591881 19196 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.557436 19191 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.570947 19364 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:06.590128 19305 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:06.594332 19357 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:06.641355 19317 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:06.620242 19356 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:06.585752 18808 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:06:06.643503 19138 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9.
I20260709 13:06:06.680037 15439 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:06.681723 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.572213 19352 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.652379 19107 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:06.687963 19264 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:06.613843 19168 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.696882 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.562716 19348 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.678498 19356 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.690037 19346 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.694051 19268 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 10. Current term is 11.
I20260709 13:06:06.691622 19317 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:06.688946 19209 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:06.650682 19315 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:06:06.666801 19196 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.650933 19235 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.744244 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2450) took 1186 ms. Trace:
I20260709 13:06:06.744776 15509 rpcz_store.cc:276] 0709 13:06:05.557752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.557893 (+   141us) service_pool.cc:224] Handling call
0709 13:06:05.558363 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.883835 (+325472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.735284 (+851449us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400377dd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:06.735523 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706291456}
I20260709 13:06:06.739037 15440 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:06.674599 18978 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.711612 19306 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.773142 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:06.729001 19348 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:06.749344 15442 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:06.729408 19209 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.777271 15441 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:06.709254 19359 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:06.710458 19356 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.673182 19358 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:06.730007 18894 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:06.711812 19339 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.813241 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:06.746515 19364 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:06.791647 19346 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:06.792320 19371 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:06:06.792948 19172 consensus_meta.cc:287] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.801s	user 0.013s	sys 0.000s
I20260709 13:06:06.792728 19365 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:06:06.790035 19306 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.794814 19347 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:06.795138 19372 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.090s
W20260709 13:06:06.796020 19370 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:06:06.797291 19366 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:06:06.798054 19358 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:06.798394 19367 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:06:06.799010 19317 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.804838 19235 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.806007 19191 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.806602 19168 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:06.779136 19368 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:06:06.819120 18894 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.900516 18894 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.855727 19339 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.901170 19209 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.721246 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.821044 15513 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:06.905085 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:06.853626 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.856101 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 216967us
I20260709 13:06:06.906586 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:06.711930 19274 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.711338 19142 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:06.863730 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 360381us
I20260709 13:06:06.856225 19138 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.928669 19168 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:06.928465 19138 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.930054 19005 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.930975 19138 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.859789 18762 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:06.880700 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.866901 19257 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:06.877070 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 230891us
I20260709 13:06:06.942267 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:06.742791 19357 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:06:06.866583 19346 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.749675 19305 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.888797 19379 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.894968 19196 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:06.909960 19339 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:06.968632 19336 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.969233 19336 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.872817 19172 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.971639 19379 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.972525 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:06.973233 19172 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.973980 19379 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.915983 19380 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.975461 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:06.975805 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:06.975862 19380 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:06.914960 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.886229 19365 consensus_queue.cc:1243] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:06.947428 19257 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.926990 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:06.924440 18872 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:06:06.978976 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 52074.3us
I20260709 13:06:06.925638 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:06.916250 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 195096us
W20260709 13:06:06.980161 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54671.4us
I20260709 13:06:06.980293 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:06.980486 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:06.982265 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:06.983228 19231 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:06.984143 19196 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:06.947099 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:06.985373 19196 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.960655 19209 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.985814 19196 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.986254 19209 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:06.986411 19319 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.867048 19364 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.964038 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:06.955650 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:06.978484 19380 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:06.988085 16179 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:06:06.988129 19026 raft_consensus.cc:3055] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:06.988672 19026 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:06.974020 15518 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:06.989609 19364 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:06.876945 19306 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.989673 19026 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:06.990551 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2459) took 1031 ms. Trace:
I20260709 13:06:06.984599 19365 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:06.983605 19360 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:06.956458 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.992290 19360 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.992323 19306 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.933887 19235 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:06.992862 19360 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:06.993328 19235 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:06.994546 19235 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:06.995343 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:06.996156 19384 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:06.997311 15583 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:06.998106 19374 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:06.998531 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:06.998994 15513 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:06:06.999231 15591 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:06:06.945894 16178 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:06.974826 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:06.944293 18762 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.002936 18762 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:06.986678 19209 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:07.003250 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.003594 19209 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:07.003964 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.004686 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.005241 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.006508 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.007874 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.008621 15438 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:07.000813 16173 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:06.996239 15590 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:06.979177 19257 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:06.990989 15518 rpcz_store.cc:276] 0709 13:06:05.959233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.969421 (+ 10188us) service_pool.cc:224] Handling call
0709 13:06:06.002236 (+ 32815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.989682 (+987446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.990304 (+   622us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54000ec254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:06.990485 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234384768}
I20260709 13:06:06.991750 16174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 543) took 1736 ms. Trace:
I20260709 13:06:06.984408 19231 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:07.018688 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.020004 15555 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.027479 19357 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.955356 19355 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:07.034397 15588 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:07.041648 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.044770 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.048985 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.019490 19336 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:07.051355 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:07.026043 19231 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:07.063686 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.046659 19357 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:07.069689 19231 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:07.023824 19191 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:06:07.048892 19339 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:07.091333 15589 raft_consensus.cc:2410] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:07.079980 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.080597 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.096040 18872 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.097769 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:07.099151 18872 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:07.052381 19382 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.100730 16146 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.102378 18872 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:07.102958 18872 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:07.103909 19382 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.104141 18872 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.052016 19268 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:06:07.070672 19095 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:07.092157 19007 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.057086 19196 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:07.123657 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 106791us
I20260709 13:06:07.130509 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:07.132304 15438 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:07.082044 19168 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.024077 16174 rpcz_store.cc:276] 0709 13:06:05.255389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.265695 (+ 10306us) service_pool.cc:224] Handling call
0709 13:06:05.343135 (+ 77440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.890310 (+547175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.991406 (+1101096us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400540bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:06.991651 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972606848}
I20260709 13:06:07.136019 15518 raft_consensus.cc:1240] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.129127 19355 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:07.138872 19355 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.074956 19348 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:07.083532 19360 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.117949 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.143778 19168 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:07.143921 19360 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.145555 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.062772 19356 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.123041 19095 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.148849 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:07.149536 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.154207 19346 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:07.155966 19260 raft_consensus.cc:3055] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:07.158283 18994 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:07.162076 19209 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.162528 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:07.174304 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.170290 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.176795 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:07.168257 19342 consensus_meta.cc:287] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.002s
W20260709 13:06:07.183145 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 95001.2us
I20260709 13:06:07.168955 19372 consensus_queue.cc:1059] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:06:07.185273 19360 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:07.172224 19095 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:07.189284 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.190076 15514 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:07.152134 19235 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:07.186923 19360 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.191558 19379 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:07.193619 19196 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.131918 19007 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.182235 19346 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.196090 19209 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.175302 19339 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:07.199179 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:07.199530 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:07.173539 19319 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:07.176591 19260 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:07.185186 19361 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.222849 15514 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:07.217762 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:07.197266 19334 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:07.207806 19364 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:07.235917 19348 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:07.205300 19357 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:07.207949 19191 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:07.241887 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:07.229001 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.254033 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1925) took 1410 ms. Trace:
I20260709 13:06:07.261353 15511 rpcz_store.cc:276] 0709 13:06:05.843518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.846560 (+  3042us) service_pool.cc:224] Handling call
0709 13:06:05.846930 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.993879 (+146949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.253592 (+1259713us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400211e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:07.253934 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238560256}
I20260709 13:06:07.257476 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.186105 19342 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.267483 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.267640 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.268647 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.274358 15435 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:07.274474 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.269134 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.205588 19365 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:07.276978 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.277778 15514 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:07.247779 19334 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:07.239984 19319 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:07.482048 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.249555 19209 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:07.360121 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.421064 15406 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:07.294762 15440 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:07.489071 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68113.7us
I20260709 13:06:07.318877 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.379019 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.310355 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.490065 15434 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:07.492965 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.428521 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:07.429842 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.387709 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.249810 19382 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:07.249946 19168 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:07.478483 19343 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.346s	user 0.010s	sys 0.003s
W20260709 13:06:07.406338 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.294260 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:07.300261 19354 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:06:07.410032 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2410) took 1778 ms. Trace:
I20260709 13:06:07.278561 19364 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:07.289702 19393 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:06:07.494300 15442 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:07.397594 19381 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.506888 15511 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
W20260709 13:06:07.499029 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.499725 15434 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:07.281180 19005 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:07.502367 15592 rpcz_store.cc:276] 0709 13:06:05.631235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.100556 (+469321us) service_pool.cc:224] Handling call
0709 13:06:06.159630 (+ 59074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.081540 (+921910us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b180040e3a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd4fbfb 00007fcf7bd5a64b
0709 13:06:07.081704 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.081732 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.122551 (+ 40819us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.242851 (+120300us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:07.242909 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.243024 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.399434 (+156410us) raft_consensus.cc:1685] finished
0709 13:06:07.399459 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.409912 (+ 10453us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43461,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":13141,"spinlock_wait_cycles":6409600,"thread_start_us":169328,"threads_started":2,"wal-append.queue_time_us":250567}
W20260709 13:06:07.427695 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 294605us
I20260709 13:06:07.512754 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:07.513094 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.484817 19334 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:07.295289 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.304383 19342 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:07.509281 15435 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:07.516275 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:07.281960 19360 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:07.298370 18762 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:07.519186 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:07.519265 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.288220 19346 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.221s
I20260709 13:06:07.499280 19382 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:07.284462 19095 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.502904 19378 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:07.514570 19364 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:07.505731 19365 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:07.528208 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.528456 19357 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:07.495340 19356 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.535560 15518 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:07.536340 15438 raft_consensus.cc:2376] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9. Re-sending same reply.
I20260709 13:06:07.449700 19348 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:06:07.539255 19382 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:07.544236 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:07.541002 19378 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.548949 15511 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:06:07.295058 19260 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.535053 18762 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.537762 19209 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.566036 19378 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:07.566866 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.577795 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2457) took 1695 ms. Trace:
I20260709 13:06:07.573632 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:07.579393 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.580982 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.576897 19356 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:07.581976 19103 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:07.583015 19319 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.560297 19361 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:07.584117 19361 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.585868 19026 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:07.535455 19305 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:07.575011 15436 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:07.518025 19381 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.560210 19357 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:07.638545 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 106126us
I20260709 13:06:07.574013 18762 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:07.552148 19360 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:07.639938 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66416.3us
I20260709 13:06:07.640271 15511 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:07.672668 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.673358 15511 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:06:07.674401 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.578437 15515 rpcz_store.cc:276] 0709 13:06:05.882839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.883052 (+   213us) service_pool.cc:224] Handling call
0709 13:06:05.886359 (+  3307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.886781 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.886816 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.904768 (+ 17952us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.023275 (+118507us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:06.023347 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.023427 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.450126 (+1426699us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:07.564121 (+113995us) raft_consensus.cc:1685] finished
0709 13:06:07.564146 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.577681 (+ 13535us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":558,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":13526,"spinlock_wait_cycles":23440128,"thread_start_us":50518,"threads_started":1,"wal-append.queue_time_us":195005}
I20260709 13:06:07.656260 15518 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:07.676352 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:07.586555 19361 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.559828 19365 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:07.681068 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.680547 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.657415 19103 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:07.667793 19357 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:07.683187 15511 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
W20260709 13:06:07.671221 19231 consensus_meta.cc:287] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.005s
I20260709 13:06:07.719846 19231 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.722293 19231 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:07.726003 19409 consensus_queue.cc:1059] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:07.727321 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 2033) took 1893 ms. Trace:
I20260709 13:06:07.727775 15439 rpcz_store.cc:276] 0709 13:06:05.833968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.837061 (+  3093us) service_pool.cc:224] Handling call
0709 13:06:07.727097 (+1890036us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b540028ffd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:07.727252 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935227136}
I20260709 13:06:07.728986 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:07.729260 16145 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:07.729803 16174 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:07.731469 16173 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:07.735998 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:07.679628 19360 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.731227 19379 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.740485 19379 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.740978 19360 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.697325 19335 raft_consensus.cc:3055] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.741532 19335 raft_consensus.cc:740] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:07.742103 16178 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:07.742709 19333 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:07.742506 19335 consensus_queue.cc:260] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.734839 19191 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:06:07.744021 19335 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.699193 19332 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:07.744688 19191 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:07.752748 19332 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:07.753129 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:07.754181 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:07.753909 19332 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.755084 19332 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:07.683714 19305 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:06:07.763370 19385 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.835s	user 0.003s	sys 0.000s
I20260709 13:06:07.763669 19305 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:07.764083 19379 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.704465 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2407) took 2111 ms. Trace:
I20260709 13:06:07.764693 19305 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.706594 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:07.709654 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.766588 15442 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:07.710067 19327 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:07.710230 19352 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:07.710695 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.678902 19356 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:07.711642 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2421) took 1185 ms. Trace:
I20260709 13:06:07.772529 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.712432 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.713127 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.774163 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.714490 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.772666 15587 rpcz_store.cc:276] 0709 13:06:06.526426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.526590 (+   164us) service_pool.cc:224] Handling call
0709 13:06:06.526974 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.800108 (+273134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.800141 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.800186 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:06.800228 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.711385 (+911157us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540015e5d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:07.711431 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.711586 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627570560}
I20260709 13:06:07.685469 19103 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:07.775971 19103 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:07.717231 19264 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:07.779827 19264 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:07.781139 19264 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.668474 19319 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:07.783602 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.783420 19319 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.786688 19319 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:07.788092 19168 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:07.788923 19168 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.589197 19209 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.793735 19209 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.736898 19262 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:07.795029 19262 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:07.795598 19262 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:07.703435 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.799973 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.800778 15556 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.697871 19365 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.803525 19159 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.804279 19159 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:07.807049 19231 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.807937 19231 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.810667 19346 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:07.690482 15511 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:07.814841 15511 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:07.698575 19364 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.758188 16178 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:07.764755 15584 rpcz_store.cc:276] 0709 13:06:05.592622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.993441 (+400819us) service_pool.cc:224] Handling call
0709 13:06:06.483117 (+489676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.483849 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.704203 (+1220354us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54001f3e50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:07.704391 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125328640}
I20260709 13:06:07.766060 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2041) took 1030 ms. Trace:
I20260709 13:06:07.705636 19381 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:07.766520 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:07.817771 15443 rpcz_store.cc:276] 0709 13:06:06.735739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.737748 (+  2009us) service_pool.cc:224] Handling call
0709 13:06:06.776125 (+ 38377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.798792 (+ 22667us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:06.798827 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.799390 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.874593 (+ 75203us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:06.874667 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.874743 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.720532 (+845789us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b2400139d78. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78af09c4 00007fcf78aeeacb 00007fcf78ca9dc9 00007fcf78ca9a55 00007fcf78ca909d 00007fcf7b8db10e 00007fcf7b8f288c 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221
0709 13:06:07.765694 (+ 45162us) raft_consensus.cc:1685] finished
0709 13:06:07.765719 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.765988 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22166,"raft.queue_time_us":23619,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":35018496,"thread_start_us":63211,"threads_started":1,"wal-append.queue_time_us":128130}
I20260709 13:06:07.768806 15434 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:07.710904 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2408) took 2104 ms. Trace:
I20260709 13:06:07.822221 15585 rpcz_store.cc:276] 0709 13:06:05.606217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.011318 (+405101us) service_pool.cc:224] Handling call
0709 13:06:06.098028 (+ 86710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.102669 (+  4641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.710663 (+1607994us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b54003db8d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:07.710818 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198424832}
I20260709 13:06:07.766506 15515 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:07.823663 19168 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:07.773109 19356 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:07.713815 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.828442 15441 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:07.820215 19264 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:07.840193 19159 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:07.845332 15556 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.851787 19231 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:07.856184 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 89745.2us
I20260709 13:06:07.859678 15511 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:07.766955 19340 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.635s	user 0.004s	sys 0.001s
I20260709 13:06:07.752820 19191 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:07.876513 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.768190 19305 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:07.882745 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:07.863456 19388 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.741s	user 0.003s	sys 0.000s
W20260709 13:06:07.891031 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.867348 19185 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:07.925295 15511 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:07.890017 19327 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:07.890499 19231 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:07.936780 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.880254 19119 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:06:07.873199 19380 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:06:07.931007 15442 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:07.906661 19185 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.922612 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:07.947710 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.950760 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:07.951697 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:07.955701 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 296958us
I20260709 13:06:07.957583 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:07.958922 15556 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.68:33529 timed out after 1.630s (SENT) [suppressed 35 similar messages]
I20260709 13:06:07.959022 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.964433 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.967034 16178 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:06:07.967285 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.969450 16146 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:07.970458 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:07.973726 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.975754 15434 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:07.946498 19185 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:07.967859 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 717) took 1101 ms. Trace:
I20260709 13:06:07.980479 15509 rpcz_store.cc:276] 0709 13:06:06.866550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.874633 (+  8083us) service_pool.cc:224] Handling call
0709 13:06:06.875090 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.876128 (+  1038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.876173 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.877856 (+  1683us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.963966 (+ 86110us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:06.964014 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.964092 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.719501 (+755409us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b2400291248. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78af09c4 00007fcf78aeeacb 00007fcf78ca9dc9 00007fcf78ca9a55 00007fcf78ca909d 00007fcf7b8db10e 00007fcf7b8f288c 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221
0709 13:06:07.961484 (+241983us) raft_consensus.cc:1685] finished
0709 13:06:07.961516 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.967782 (+  6266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":575,"raft.queue_time_us":1247,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":3691,"spinlock_wait_cycles":45984640,"thread_start_us":35901,"threads_started":1,"wal-append.queue_time_us":119899}
I20260709 13:06:07.985466 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.991915 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.002615 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.003242 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.964066 19231 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:08.009335 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:08.006470 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:08.012902 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.013979 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.018306 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:07.977913 19350 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.977797 19330 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:07.979804 19410 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:08.038561 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.017280 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:07.947683 19191 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.008919 19231 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:08.048825 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 89933.9us
I20260709 13:06:08.023867 19159 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:08.043865 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:08.017694 19005 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.041869 19138 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:06:08.093676 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.037868 19330 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.045401 19339 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:08.045724 19414 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.052605 19231 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.056649 19191 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.054116 19159 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:08.090557 19005 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.126240 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2465) took 1881 ms. Trace:
I20260709 13:06:08.131989 15510 rpcz_store.cc:276] 0709 13:06:06.244941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.245091 (+   150us) service_pool.cc:224] Handling call
0709 13:06:06.245456 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.504583 (+259127us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:06.504940 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:06:06.595691 (+ 90751us) log.cc:844] Serialized 14 byte log entry
0709 13:06:06.595942 (+   251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.595994 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:06.596055 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.164483 (+568428us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b480021e7d8. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf80c80aa1 00007fcf80c77b37 00007fcf80c779ca 00007fcf80d6f26f 00007fcf80d6ef37 00007fcf80d8355c 00007fcf80d83508 00007fcf80d83488 00007fcf80d83443 00007fcf80d826ec 00007fcf7fcaca96
0709 13:06:08.125859 (+961376us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400202bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:08.125944 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.126152 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10307,"prepare.queue_time_us":18890,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":79,"raft.run_cpu_time_us":2877,"raft.run_wall_time_us":552022,"spinlock_wait_cycles":635902720,"thread_start_us":90198,"threads_started":1,"wal-append.queue_time_us":174087,"wal-append.run_cpu_time_us":3055,"wal-append.run_wall_time_us":1222922}
I20260709 13:06:08.095239 19138 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:08.102353 19043 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:08.106974 19330 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:08.111402 19026 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.008s
W20260709 13:06:08.146999 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 103252us
I20260709 13:06:08.158453 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:08.130272 19159 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.140277 19005 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:08.169603 19334 consensus_meta.cc:287] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.001s
I20260709 13:06:08.114953 19414 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:08.194150 15483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.019s
W20260709 13:06:08.195719 15483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.020s
W20260709 13:06:08.188499 19418 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:06:08.188253 19334 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:08.201220 19423 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:06:08.202250 19424 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:08.202942 19334 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:08.172201 16174 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
W20260709 13:06:08.208839 19382 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.644s	user 0.018s	sys 0.004s
I20260709 13:06:08.215121 15517 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:06:08.218484 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.220889 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62552.6us
I20260709 13:06:08.166149 19357 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.227715 15509 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:08.230378 19414 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:08.209300 19382 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.239166 15510 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:08.223448 19172 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.245857 15584 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:08.242439 19378 consensus_meta.cc:287] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.004s
I20260709 13:06:08.231652 19339 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:08.257580 19378 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.258400 19339 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.244043 19432 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:08.271071 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2038) took 2272 ms. Trace:
W20260709 13:06:08.272119 15588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2417) took 1753 ms (client timeout 1758 ms). Trace:
W20260709 13:06:08.272922 15588 rpcz_store.cc:269] 0709 13:06:06.518814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.518970 (+   156us) service_pool.cc:224] Handling call
0709 13:06:08.271894 (+1752924us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540016cbd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:08.272050 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948108544}
I20260709 13:06:08.271639 15437 rpcz_store.cc:276] 0709 13:06:05.998347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.998511 (+   164us) service_pool.cc:224] Handling call
0709 13:06:06.014948 (+ 16437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.206420 (+191472us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:06.212888 (+  6468us) log.cc:844] Serialized 14 byte log entry
0709 13:06:06.213158 (+   270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.213213 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:06.213308 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.270734 (+2057426us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54003a7354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:08.270794 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.270973 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"prepare.queue_time_us":246,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":6419,"raft.queue_time_us":580,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":119,"spinlock_wait_cycles":439663360}
W20260709 13:06:08.281147 19420 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
I20260709 13:06:08.281311 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.282137 19436 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.282759 19436 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.266535 19168 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:08.221364 19138 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.290477 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.291280 15509 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:08.291976 16178 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:06:08.056002 19413 consensus_queue.cc:1175] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ff41728dec842afad5b53c20446a5a0" responder_term: 9 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: [8.9-8.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:08.298530 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.254786 19172 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.301837 16178 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:08.284739 19435 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.281227 19441 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.345472 19441 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.347734 19382 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.350281 19435 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.353258 19435 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:08.355203 19172 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:08.289729 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.327702 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.293459 19168 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.357642 19168 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:08.362674 19262 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.004s
I20260709 13:06:08.364485 19441 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:08.365936 19335 consensus_meta.cc:287] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.005s
W20260709 13:06:08.366007 19333 consensus_meta.cc:287] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.005s
I20260709 13:06:08.367564 16180 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:08.368436 18907 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.369079 18907 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:08.381697 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54218us
W20260709 13:06:08.400985 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.401350 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:08.402002 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:08.303390 19138 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.409451 15588 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:08.410256 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.411063 16178 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
W20260709 13:06:08.412428 16176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 546) took 2188 ms (client timeout 1758 ms). Trace:
W20260709 13:06:08.412958 16176 rpcz_store.cc:269] 0709 13:06:06.224426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.224609 (+   183us) service_pool.cc:224] Handling call
0709 13:06:08.412211 (+2187602us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400682254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:08.412334 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262914432}
I20260709 13:06:08.416149 16177 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:08.418664 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 416) took 1472 ms. Trace:
I20260709 13:06:08.423065 15511 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:08.427783 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.329444 19414 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:08.403913 18762 consensus_meta.cc:287] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.718s	user 0.015s	sys 0.000s
I20260709 13:06:08.433899 18762 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.419117 16177 rpcz_store.cc:276] 0709 13:06:06.945942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.946092 (+   150us) service_pool.cc:224] Handling call
0709 13:06:08.415905 (+1469813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.416727 (+   822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.418393 (+  1666us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400682250. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:08.418586 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3379463424}
I20260709 13:06:08.436534 18762 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:08.429193 19441 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.437602 19441 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.438055 19441 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.408046 19432 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.440124 19432 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:08.441776 19103 consensus_meta.cc:287] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.003s
I20260709 13:06:08.442207 19103 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.443156 19432 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.363258 19262 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.432008 19414 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.443642 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:08.423780 19365 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:08.445595 15589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2384) took 3902 ms (client timeout 1639 ms). Trace:
I20260709 13:06:08.408479 19142 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:08.449342 19395 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:08.449857 19378 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:08.453521 15589 rpcz_store.cc:269] 0709 13:06:04.522927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.542421 (+ 19494us) service_pool.cc:224] Handling call
0709 13:06:08.425576 (+3883155us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b540015f4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:08.425737 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5709698432}
I20260709 13:06:08.419286 19357 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:08.438763 19332 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.000s
I20260709 13:06:08.458830 19414 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:08.459937 19159 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.460520 19365 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.460959 16173 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:08.472261 19365 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:08.461951 19330 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.468307 15441 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:06:08.439420 19005 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.472342 19159 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:08.464556 19264 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.002s
I20260709 13:06:08.445045 19026 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:06:08.475595 19005 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.476888 19103 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.498086 19330 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:08.500716 19168 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.502385 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:08.477011 19436 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:08.508353 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:08.476333 19333 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:06:08.506388 19305 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.003s
I20260709 13:06:08.513833 19262 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:08.518705 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:08.520494 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:08.521225 15585 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:08.527354 19185 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.519s	user 0.014s	sys 0.001s
I20260709 13:06:08.538589 15585 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:08.545085 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.539626 19185 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.546020 16173 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:08.548688 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:08.550169 19103 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:08.550650 19103 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.551020 19103 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.529305 19007 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:08.563160 19422 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.387s	user 0.001s	sys 0.002s
I20260709 13:06:07.725128 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:08.579648 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.580325 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.581043 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.588497 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2501) took 1083 ms. Trace:
I20260709 13:06:08.589030 15514 rpcz_store.cc:276] 0709 13:06:07.507179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.859244 (+352065us) service_pool.cc:224] Handling call
0709 13:06:07.865592 (+  6348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.866302 (+   710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.866328 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.869250 (+  2922us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.944545 (+ 75295us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:07.944608 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.944696 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.562485 (+617789us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:08.588128 (+ 25643us) raft_consensus.cc:1685] finished
0709 13:06:08.588157 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.588419 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":10953,"spinlock_wait_cycles":109646976,"thread_start_us":70248,"threads_started":1,"wal-append.queue_time_us":273365}
I20260709 13:06:08.594764 15592 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:08.577625 19185 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:08.600679 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:08.600821 19441 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.602620 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:08.602439 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:08.603502 16182 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.604691 19231 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.618005 15588 raft_consensus.cc:2368] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10.
I20260709 13:06:08.620275 19231 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:08.621102 18994 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:08.634259 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:08.624112 15337 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 208) took 25470 ms (client timeout 15000 ms). Trace:
I20260709 13:06:08.625910 18978 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:08.632372 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.636086 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:08.625905 19441 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:08.634454 18994 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:08.636919 16174 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.637538 18994 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.638775 18994 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:08.621675 19268 consensus_queue.cc:1059] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:08.640476 19268 raft_consensus.cc:3055] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:08.640926 19268 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:08.641979 19268 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.650542 19005 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.651301 19005 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.653838 19005 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.656522 19442 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:08.657466 19425 log.cc:927] Time spent T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.465s	user 0.000s	sys 0.003s
I20260709 13:06:08.657311 19442 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.659893 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2480) took 1476 ms. Trace:
I20260709 13:06:08.660356 15513 rpcz_store.cc:276] 0709 13:06:07.183806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.708753 (+524947us) service_pool.cc:224] Handling call
0709 13:06:07.709087 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.746079 (+ 36992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.746135 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:07.746198 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:07.746243 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.659579 (+913336us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b5400212d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:08.659644 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.659797 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84456320}
I20260709 13:06:08.662038 19005 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.662799 19005 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.709904 19095 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.711338 19005 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:08.711949 19426 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.510s	user 0.000s	sys 0.004s
I20260709 13:06:08.663282 19204 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.714752 19204 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.717864 19168 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.718448 19204 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:08.635109 15337 rpcz_store.cc:269] 0709 13:05:43.153663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.153942 (+   279us) service_pool.cc:224] Handling call
0709 13:06:08.623816 (+25469874us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:01.093086 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:01.093796 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:01.093834 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:06:01.093847 (+    13us) tablet.cc:662] Decoding operations
0709 13:06:01.342231 (+248384us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:01.345122 (+  2891us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:01.346626 (+  1504us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:06:01.380161 (+ 33535us) tablet.cc:701] Row locks acquired
0709 13:06:01.380175 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:06:01.380357 (+   182us) write_op.cc:270] Start()
0709 13:06:01.380479 (+   122us) write_op.cc:276] Timestamp: P: 1783602361380301 usec, L: 0
0709 13:06:01.380492 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 13:06:01.381231 (+   739us) log.cc:844] Serialized 5964 byte log entry
0709 13:06:02.014815 (+633584us) op_driver.cc:464] REPLICATION: finished
0709 13:06:02.131303 (+116488us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf78c4d0ac 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7f78def0
0709 13:06:02.468538 (+337235us) write_op.cc:301] APPLY: starting
0709 13:06:02.495729 (+ 27191us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:02.608554 (+112825us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:02.608591 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:02.781046 (+172455us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:02.781562 (+   516us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=30
0709 13:06:02.781616 (+    54us) write_op.cc:312] APPLY: finished
0709 13:06:02.782177 (+   561us) log.cc:844] Serialized 107 byte log entry
0709 13:06:02.782407 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:02.782684 (+   277us) write_op.cc:454] Released schema lock
0709 13:06:02.782763 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:02.926313 (+143550us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:02.926349 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":192264,"reported_tablets":49,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":426741,"apply.run_cpu_time_us":9360,"apply.run_wall_time_us":456552,"num_ops":15,"prepare.queue_time_us":221647,"prepare.run_cpu_time_us":30320,"prepare.run_wall_time_us":786229,"raft.queue_time_us":138822,"raft.run_cpu_time_us":27433,"raft.run_wall_time_us":250065,"replication_time_us":633841,"spinlock_wait_cycles":45593856,"thread_start_us":648966,"threads_started":4,"wal-append.queue_time_us":314845,"wal-append.run_cpu_time_us":32161,"wal-append.run_wall_time_us":2105187}]]}
I20260709 13:06:08.666761 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.668380 15435 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:08.668610 19007 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.672050 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2497) took 1168 ms. Trace:
I20260709 13:06:08.674362 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.739388 15441 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:08.741154 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:08.675338 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:08.742239 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1943) took 1461 ms. Trace:
I20260709 13:06:08.742754 15443 raft_consensus.cc:2368] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:06:08.676964 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.738981 15515 rpcz_store.cc:276] 0709 13:06:07.503886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.827059 (+323173us) service_pool.cc:224] Handling call
0709 13:06:08.671099 (+844040us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:06:08.671396 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.671658 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.671690 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.671737 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:08.671767 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.671833 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.671950 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46948096}
I20260709 13:06:08.745610 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:08.745481 19007 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.746264 15515 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.747040 15592 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:08.677779 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:08.677350 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 1934) took 2090 ms. Trace:
I20260709 13:06:08.679265 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:08.748544 15517 rpcz_store.cc:276] 0709 13:06:06.586997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.638437 (+ 51440us) service_pool.cc:224] Handling call
0709 13:06:06.639324 (+   887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.215660 (+1576336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.677096 (+461436us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54001e55d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:08.677282 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3613559552}
I20260709 13:06:08.679670 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:08.680640 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.749590 15590 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:08.681141 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:08.750377 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.682489 19103 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.682895 19043 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.683892 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:08.684650 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:08.684845 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.685194 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:08.685598 15513 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:08.687995 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:08.689217 19429 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.486s	user 0.004s	sys 0.002s
I20260709 13:06:08.691000 15440 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:08.692871 19260 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.700465 16146 leader_election.cc:400] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10.
I20260709 13:06:08.760526 16146 leader_election.cc:403] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:08.701980 19305 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:08.708945 19268 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.730741 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:08.732281 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:08.745796 15589 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:08.743419 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:08.742798 15516 rpcz_store.cc:276] 0709 13:06:07.280413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.770112 (+489699us) service_pool.cc:224] Handling call
0709 13:06:07.874759 (+104647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.885240 (+ 10481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.885316 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.885983 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.041900 (+155917us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:08.175384 (+133484us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.180020 (+  4636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.180149 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.711058 (+530909us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:08.720044 (+  8986us) raft_consensus.cc:1685] finished
0709 13:06:08.742000 (+ 21956us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.742168 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16874,"prepare.queue_time_us":234960,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":10042,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":13090,"spinlock_wait_cycles":50522368,"thread_start_us":226242,"threads_started":2,"wal-append.queue_time_us":256728}
I20260709 13:06:08.677999 19306 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:08.756778 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:08.758770 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 70868.6us
I20260709 13:06:08.668442 18907 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.798242 15435 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:08.798485 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:08.700987 19330 consensus_queue.cc:1059] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:06:08.761703 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 61415.3us
I20260709 13:06:08.805910 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:08.792111 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.765813 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:08.811870 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46163.2us
I20260709 13:06:08.799000 15587 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:08.814442 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:08.799309 15583 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:08.799350 15591 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 10: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:08.748041 19007 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.761128 19043 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:08.815963 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:08.818091 15590 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:08.822477 15556 leader_election.cc:400] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:06:08.764683 19168 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:08.822937 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.822962 15556 leader_election.cc:403] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:08.796139 19442 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:08.832090 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1908) took 1439 ms. Trace:
I20260709 13:06:08.832888 15440 rpcz_store.cc:276] 0709 13:06:07.392985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.494922 (+101937us) service_pool.cc:224] Handling call
0709 13:06:07.495284 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.758419 (+1263135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.831707 (+ 73288us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003f8ed4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:08.831991 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748559232}
I20260709 13:06:08.827301 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:08.830564 15588 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:08.839346 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:08.845690 16182 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:08.819878 18879 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:08.849959 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:08.878504 18879 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.878868 15591 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:08.878535 15514 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:08.881541 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:08.851874 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.801452 19196 consensus_queue.cc:1059] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:06:08.820623 19005 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:08.857210 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.857404 19231 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.884068 19231 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:08.884842 19005 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:08.885448 19005 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:08.887760 19333 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10.
I20260709 13:06:08.825721 19007 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:08.889057 19007 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:08.889336 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.889623 19007 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.860668 19095 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:08.890182 15329 maintenance_manager.cc:643] P 7478e1667cd24e1eb33dcbc8ac104877: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.211s	user 0.232s	sys 0.040s Metrics: {"bytes_written":30232,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":173528,"dirs.run_cpu_time_us":718,"dirs.run_wall_time_us":1440,"drs_written":1,"lbm_read_time_us":50221,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":1,"lbm_write_time_us":405224,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":11,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":19,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":127768,"threads_started":2,"update_count":15,"wal-append.queue_time_us":16051}
I20260709 13:06:08.886937 19005 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.894915 19005 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.895628 15330 maintenance_manager.cc:419] P 7478e1667cd24e1eb33dcbc8ac104877: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8139 bytes on disk
I20260709 13:06:08.820969 19185 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:08.836076 15590 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:08.863902 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:08.830219 19159 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:08.810408 15515 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:08.861447 19441 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.869611 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2467) took 2623 ms. Trace:
I20260709 13:06:08.898943 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.868129 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:08.900472 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 80840.4us
I20260709 13:06:08.901470 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:08.902619 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:08.877836 15442 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:08.838339 19168 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.878954 18879 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.899528 15512 rpcz_store.cc:276] 0709 13:06:06.245739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.245889 (+   150us) service_pool.cc:224] Handling call
0709 13:06:06.246199 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.322719 (+ 76520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.322766 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.353229 (+ 30463us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.976138 (+1622909us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b180019f3c0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:08.095927 (+119789us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:08.095996 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.096904 (+   908us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.688314 (+591410us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:08.869207 (+180893us) raft_consensus.cc:1685] finished
0709 13:06:08.869234 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.869515 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76082,"raft.queue_time_us":172898,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":15270,"spinlock_wait_cycles":85889152,"thread_start_us":81310,"threads_started":1,"wal-append.queue_time_us":1738982}
I20260709 13:06:08.911751 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:08.915206 15435 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:08.904012 15590 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:08.906261 19306 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:08.921188 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.847218 19380 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:06:08.913942 19357 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.923499 15435 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:08.925941 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 343325us
I20260709 13:06:08.934548 15329 maintenance_manager.cc:643] P 7478e1667cd24e1eb33dcbc8ac104877: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.037s	user 0.002s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":1415,"lbm_reads_lt_1ms":4}
I20260709 13:06:08.863780 19363 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:06:08.907629 19336 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:08.908749 19168 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:08.945674 15437 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:08.946587 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.917291 19436 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.945779 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.948377 15440 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 10: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:08.924952 19379 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.917212 19339 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:08.959074 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:08.922938 19305 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:08.988559 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:08.964156 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:08.915179 19441 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.922166 19443 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:06:08.993818 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.000687 15592 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:08.947482 19336 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.004289 15406 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:09.012640 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:09.013414 15592 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.014133 19264 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:09.008126 19443 consensus_queue.cc:1243] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:08.988549 19432 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.016237 19443 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.016824 19443 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:09.024192 19103 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:08.990387 19379 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:09.011190 19442 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.025651 19379 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.025962 19442 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.028674 19442 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:09.029007 18907 raft_consensus.cc:3055] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:09.010874 19336 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.029544 18907 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:08.941222 19357 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:09.032078 19332 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:09.032594 19332 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:09.034022 19357 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:08.993595 19339 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:08.989319 19378 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.030692 18907 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.039870 19378 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:09.040839 18907 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.951948 19231 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:09.033560 19332 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:09.046502 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:09.053745 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.055641 15592 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:09.048931 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:09.076231 15518 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:06:09.015875 19432 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:09.081718 16145 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:09.050091 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:09.046816 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:09.060232 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.084419 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.083380 15443 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:09.059881 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:09.061970 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:09.065853 19357 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:09.068280 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:09.086776 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:09.088563 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:09.089999 15434 raft_consensus.cc:2368] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10.
I20260709 13:06:09.042404 19378 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:09.087528 15585 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 2.
I20260709 13:06:09.097368 15443 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:09.100819 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:09.101043 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:09.101527 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:09.101673 15439 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:09.066031 19151 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:09.112677 15440 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:09.134159 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.092120 19268 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.104305 19333 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.104429 19332 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:09.111734 16174 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
W20260709 13:06:09.208534 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.136986 19443 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:09.145089 19333 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:09.248524 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 315566us
I20260709 13:06:09.277532 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:09.283910 15585 raft_consensus.cc:2368] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10.
W20260709 13:06:09.297761 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 169396us
W20260709 13:06:09.144330 19327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.015s	sys 0.008s
I20260709 13:06:09.222255 19339 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:09.336656 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 250071us
I20260709 13:06:09.170835 19268 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:09.325742 19327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.016s	sys 0.009s
I20260709 13:06:09.302839 19333 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:09.355626 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 50583us
I20260709 13:06:09.340579 16173 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:06:09.302582 19151 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:09.327140 19196 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:09.403173 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:09.403443 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:09.431653 19441 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:09.437099 19260 consensus_meta.cc:287] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.009s
W20260709 13:06:09.440685 19043 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.609s	user 0.014s	sys 0.001s
I20260709 13:06:09.440160 19151 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.443652 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:09.471271 15441 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.047s
W20260709 13:06:09.472806 15441 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.003s	sys 0.048s
I20260709 13:06:09.449410 19306 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:09.453336 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 49984.4us
I20260709 13:06:09.476227 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:09.358285 19231 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:09.362572 19103 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:09.444133 15586 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:09.482702 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.506521 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.344838 18879 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.411585 19443 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:09.517625 16179 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:09.490387 19231 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.537846 19231 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:09.456256 19200 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:09.577841 19268 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:09.579628 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:09.584149 19457 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:06:09.584865 18762 raft_consensus.cc:3055] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:09.586570 19159 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.003s
W20260709 13:06:09.587095 19005 consensus_meta.cc:287] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.005s
I20260709 13:06:09.587787 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:09.589053 19305 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:09.589798 19379 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.563s	user 0.004s	sys 0.005s
I20260709 13:06:09.590655 19432 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:09.516426 19095 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.515785 19191 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:09.593986 19138 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:09.469645 19007 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.002s
W20260709 13:06:09.599524 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 81174.3us
I20260709 13:06:09.643869 15592 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:09.646965 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:09.516433 19306 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:09.667377 16179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 555) took 1923 ms (client timeout 2416 ms). Trace:
I20260709 13:06:09.551082 19372 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:09.674271 15442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.006s	sys 0.021s
W20260709 13:06:09.675694 15442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.007s	sys 0.021s
W20260709 13:06:09.672814 16179 rpcz_store.cc:269] 0709 13:06:07.732472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.735707 (+  3235us) service_pool.cc:224] Handling call
0709 13:06:09.656138 (+1920431us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54005dd9d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:09.656265 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4091355520}
W20260709 13:06:09.683785 15515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.039s	sys 0.033s
W20260709 13:06:09.684355 15515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.039s	sys 0.033s
W20260709 13:06:09.668817 15590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.021s	sys 0.044s
W20260709 13:06:09.691936 15590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.022s	sys 0.044s
I20260709 13:06:09.505184 19043 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.517867 19103 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:09.694377 15514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.025s	sys 0.030s
W20260709 13:06:09.706331 15514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.026s	sys 0.030s
W20260709 13:06:09.709954 15407 leader_election.cc:336] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.639s (SENT)
I20260709 13:06:09.703452 15585 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:09.654830 18762 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:09.656594 19443 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.666978 19159 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
W20260709 13:06:09.669466 19434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.013s	sys 0.013s
I20260709 13:06:09.717773 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:09.750860 15586 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:09.670622 19138 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:09.722405 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:09.722473 15587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.023s	sys 0.050s
W20260709 13:06:09.752902 15587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.023s	sys 0.050s
W20260709 13:06:09.717684 15512 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.025s	sys 0.045s
W20260709 13:06:09.755798 15512 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.025s	sys 0.045s
I20260709 13:06:09.671912 16174 raft_consensus.cc:2376] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8. Re-sending same reply.
I20260709 13:06:09.715425 18966 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:09.706611 19119 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.706923 19334 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.715674 19363 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:09.672178 19379 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.717103 19191 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:09.681535 19095 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:09.757516 19434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.013s	sys 0.014s
I20260709 13:06:09.808054 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:09.766171 19436 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.002s
I20260709 13:06:09.809439 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:09.760231 18966 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:09.681859 19007 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:09.798044 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.017s	sys 0.027s
W20260709 13:06:09.833145 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.017s	sys 0.027s
W20260709 13:06:09.833585 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 547156us
W20260709 13:06:09.775733 19395 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.046s
I20260709 13:06:09.840859 15589 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:09.695479 19372 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.758653 19362 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:06:09.810207 19436 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:09.836364 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:09.803887 19380 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:09.840426 19395 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.008s	sys 0.047s
I20260709 13:06:09.777627 19119 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.779577 19334 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:09.830520 19259 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:09.777678 19363 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:09.833312 19467 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:09.856892 19336 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.827s	user 0.015s	sys 0.000s
I20260709 13:06:09.866523 15586 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:09.761381 19443 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:09.874349 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.776672 15592 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:09.886982 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:09.888271 15586 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:09.866359 19380 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.801721 18762 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:09.896252 15583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.008s
W20260709 13:06:09.908674 15583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.006s	sys 0.008s
I20260709 13:06:09.910163 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:09.887944 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:09.913763 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:09.889639 18879 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:09.889515 19467 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:09.889147 19259 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:09.924991 15592 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:09.901472 19380 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:09.898576 19468 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:09.922979 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:09.942914 15483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.013s	sys 0.021s
W20260709 13:06:09.946739 15483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.013s	sys 0.021s
I20260709 13:06:09.891425 19336 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.879474 19191 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:09.932101 18762 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.931200 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:09.942785 19381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.015s	sys 0.022s
I20260709 13:06:09.917719 19436 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:09.934700 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1922) took 1058 ms. Trace:
I20260709 13:06:09.950564 15586 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:09.961942 15584 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.013s	sys 0.011s
I20260709 13:06:09.964924 15509 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:09.966181 15518 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:09.974656 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:09.883095 18966 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:09.977027 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.011173 15443 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
W20260709 13:06:09.977959 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.974857 15584 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.013s	sys 0.011s
W20260709 13:06:09.951076 19442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.019s	sys 0.020s
W20260709 13:06:10.034090 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.035100 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:09.971580 15441 rpcz_store.cc:276] 0709 13:06:08.876521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.877013 (+   492us) service_pool.cc:224] Handling call
0709 13:06:08.877456 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.877693 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:09.497070 (+619377us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.932845 (+435775us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.932910 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:09.932979 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.933090 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.933233 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37637,"prepare.queue_time_us":111549,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":16308,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7076,"spinlock_wait_cycles":50688,"thread_start_us":986625,"threads_started":2}
I20260709 13:06:09.996901 15518 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:10.007350 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44592us
I20260709 13:06:09.941901 19306 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:09.945762 19043 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:09.994771 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.021605 15556 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:10.021469 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2426) took 1295 ms. Trace:
I20260709 13:06:10.027030 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.028398 15516 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:10.020443 15438 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:10.062703 15517 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:09.961081 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:10.057055 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.069104 15586 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:06:10.073648 15592 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 10: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:10.084195 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.064478 15584 rpcz_store.cc:276] 0709 13:06:08.726280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.726429 (+   149us) service_pool.cc:224] Handling call
0709 13:06:08.726882 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.727395 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.727433 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.742184 (+ 14751us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.993186 (+251002us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:10.020795 (+1027609us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.021118 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.021200 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.021241 (+    41us) raft_consensus.cc:1685] finished
0709 13:06:10.021256 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.021397 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":435033,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":9804,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":17438,"thread_start_us":1209078,"threads_started":2,"wal-append.queue_time_us":418023}
I20260709 13:06:10.130568 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:10.128909 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 61432.2us
W20260709 13:06:10.033389 19442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.020s	sys 0.020s
I20260709 13:06:10.136360 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:10.157709 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 312415us
W20260709 13:06:10.064862 19464 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:06:09.957419 19231 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.058563 19379 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:10.059289 18966 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:10.205945 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:09.961758 19477 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 13:06:10.197350 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:10.192785 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:10.132014 19159 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:10.149688 19332 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.978s	user 0.015s	sys 0.000s
I20260709 13:06:10.129180 19434 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:10.157232 19450 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:06:10.128558 19306 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.948001 19468 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.172629 19043 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.240551 15586 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:10.208765 19457 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:06:10.150382 19103 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.244619 15584 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
W20260709 13:06:10.246758 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 180390us
I20260709 13:06:10.207109 19185 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.249811 19436 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:10.256048 19336 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.160976 19005 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:06:10.251430 19363 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.256647 19231 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.257355 19379 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:10.257182 19478 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:10.257596 19468 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.286511 19334 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.259745 19443 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.162245 19467 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.261059 15517 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:10.261413 19495 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:10.262542 19466 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.292s	user 0.000s	sys 0.000s
W20260709 13:06:10.264631 19470 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
W20260709 13:06:10.264775 19486 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:06:10.265965 19473 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:06:10.269716 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2442) took 1275 ms. Trace:
I20260709 13:06:10.234441 19476 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.268855 19472 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.317s	user 0.000s	sys 0.000s
I20260709 13:06:10.319670 15587 rpcz_store.cc:276] 0709 13:06:08.994819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.994991 (+   172us) service_pool.cc:224] Handling call
0709 13:06:08.995529 (+   538us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:09.753348 (+757819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.753384 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:09.754108 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:06:10.143482 (+389374us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:10.143562 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.143673 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.269352 (+125679us) raft_consensus.cc:1685] finished
0709 13:06:10.269373 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.269634 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28960,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":1095623,"threads_started":2,"wal-append.queue_time_us":500308}
I20260709 13:06:10.321290 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1932) took 1365 ms. Trace:
I20260709 13:06:10.322280 19476 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.321758 15442 rpcz_store.cc:276] 0709 13:06:08.956763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.961119 (+  4356us) service_pool.cc:224] Handling call
0709 13:06:08.991931 (+ 30812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.992462 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.992497 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.006374 (+ 13877us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.683979 (+677605us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:09.684028 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.684103 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.321028 (+636925us) raft_consensus.cc:1685] finished
0709 13:06:10.321057 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.321216 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1070,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":11018,"thread_start_us":593097,"threads_started":1,"wal-append.queue_time_us":849858}
W20260709 13:06:10.323953 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.321976 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:10.246809 19469 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
I20260709 13:06:10.325544 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.326354 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2433) took 1505 ms. Trace:
I20260709 13:06:10.326511 15587 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:10.327112 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2439) took 1398 ms. Trace:
I20260709 13:06:10.327714 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.242264 19159 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.327616 15590 rpcz_store.cc:276] 0709 13:06:08.928904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.929217 (+   313us) service_pool.cc:224] Handling call
0709 13:06:08.930063 (+   846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.930707 (+   644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.930760 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.943494 (+ 12734us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.692664 (+749170us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:09.692709 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.692785 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.326860 (+634075us) raft_consensus.cc:1685] finished
0709 13:06:10.326884 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.327043 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3718,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5418,"thread_start_us":679388,"threads_started":1,"wal-append.queue_time_us":885425}
I20260709 13:06:10.329196 19159 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:10.329871 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.251525 19475 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:10.326845 15583 rpcz_store.cc:276] 0709 13:06:08.821191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.823384 (+  2193us) service_pool.cc:224] Handling call
0709 13:06:08.823804 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.824218 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:08.876623 (+ 52405us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800291280. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7f74f3c7 00007fcf7bd619a7 00007fcf7bd710bf 00007fcf7bd71038
0709 13:06:09.123577 (+246954us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.911654 (+788077us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.923976 (+ 12322us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.924192 (+   216us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:09.950564 (+ 26372us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.950847 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.950952 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.326110 (+375158us) raft_consensus.cc:1685] finished
0709 13:06:10.326134 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.326289 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17056,"prepare.queue_time_us":624789,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":2006,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":13995,"spinlock_wait_cycles":23815040,"thread_start_us":838460,"threads_started":2,"wal-append.queue_time_us":983090}
I20260709 13:06:10.128837 19259 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.287715 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:10.258381 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 97999.1us
I20260709 13:06:10.254061 19434 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.275099 19306 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.279105 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.279016 19043 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.317361 19499 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:10.300676 19379 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.356086 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.357733 19379 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.287186 19185 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.333858 19119 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:10.336468 19487 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:06:10.328562 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2521) took 1273 ms. Trace:
I20260709 13:06:10.359905 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.331295 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.360147 15514 rpcz_store.cc:276] 0709 13:06:09.055293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.055734 (+   441us) service_pool.cc:224] Handling call
0709 13:06:09.056055 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.056480 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.056525 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.067599 (+ 11074us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.707037 (+639438us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:09.707102 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.707211 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.328297 (+621086us) raft_consensus.cc:1685] finished
0709 13:06:10.328321 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.328473 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":392752,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":564693,"threads_started":1,"wal-append.queue_time_us":757561}
I20260709 13:06:10.352209 15586 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:10.361202 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.362258 15515 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.290640 19436 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:10.298583 19168 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.306s	user 0.014s	sys 0.003s
I20260709 13:06:10.336814 19005 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.335455 19007 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:10.325544 19476 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.355333 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.358415 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.358560 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.362195 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:10.313220 19333 consensus_meta.cc:287] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.906s	user 0.014s	sys 0.000s
I20260709 13:06:10.333797 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.377182 15510 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:10.377595 15583 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:10.377663 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.378065 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.362968 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.347038 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2517) took 1388 ms. Trace:
W20260709 13:06:10.364951 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50739.5us
I20260709 13:06:10.379714 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.365968 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.371737 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.379189 15512 rpcz_store.cc:276] 0709 13:06:08.958316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.958629 (+   313us) service_pool.cc:224] Handling call
0709 13:06:08.959038 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.959495 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:08.992675 (+ 33180us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.723738 (+731063us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b180038a7c0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a522 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:09.756315 (+ 32577us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.756806 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.756965 (+   159us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:09.757003 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.757083 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.346638 (+589555us) raft_consensus.cc:1685] finished
0709 13:06:10.346782 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.346960 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39088,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":164497,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":14976,"spinlock_wait_cycles":6016896,"thread_start_us":713219,"threads_started":1,"wal-append.queue_time_us":903935}
I20260709 13:06:10.382871 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.383240 15517 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:10.382422 15511 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:10.389747 15590 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:10.359975 19185 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.382752 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.391219 15590 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:10.393894 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:10.394325 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.395056 15587 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:10.396533 19007 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.397392 19007 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:10.399947 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.400879 15516 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:10.413214 15515 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:06:10.415719 19443 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.416457 19334 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:10.416968 19434 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.417387 19231 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.418653 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.418916 19007 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.419507 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:10.420018 19043 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:10.381867 19378 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.421743 19436 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:10.374994 19005 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.429777 15590 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:10.415012 15587 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:10.445780 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.446911 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:10.426517 19465 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.594s	user 0.007s	sys 0.017s
I20260709 13:06:10.426359 19475 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.434496 15516 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:10.436335 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49062.2us
I20260709 13:06:10.372881 19168 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.447414 15517 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:10.451278 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.452009 15518 pending_rounds.cc:85] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 4
I20260709 13:06:10.452389 15518 pending_rounds.cc:107] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:10.452723 15518 raft_consensus.cc:2889] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:10.445504 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.447768 15587 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:10.455652 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.442627 19119 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:10.458274 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.459000 15510 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:10.458930 19488 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:10.450532 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.460790 15591 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:10.461689 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.423028 19443 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.463920 19332 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:10.464885 19119 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:10.469305 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.465464 19159 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.385236 19333 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:10.473107 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.471024 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:10.501226 15592 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:10.468240 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.495174 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.490463 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.504577 15512 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:06:10.501992 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.507200 15583 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:10.508610 19159 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.512216 19434 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.512837 19434 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.514110 19095 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:10.515100 19434 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.515796 18966 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.516393 18966 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.518843 18966 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.503945 15587 raft_consensus.cc:2376] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8. Re-sending same reply.
I20260709 13:06:10.465827 19489 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:06:10.502918 15590 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:10.522621 15517 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:10.524287 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:10.524982 15440 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:10.524869 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:10.525731 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.525842 15434 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:10.527012 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:10.526950 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.527958 15587 raft_consensus.cc:2376] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10. Re-sending same reply.
I20260709 13:06:10.529410 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.530087 15511 raft_consensus.cc:2410] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:06:10.530110 15590 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:10.538009 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.540690 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1931) took 1594 ms. Trace:
I20260709 13:06:10.441416 19231 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.541214 15437 rpcz_store.cc:276] 0709 13:06:08.946633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.946988 (+   355us) service_pool.cc:224] Handling call
0709 13:06:08.947322 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.947750 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.947778 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.948287 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.322441 (+374154us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:09.322516 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.322626 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.425881 (+1103255us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:10.521820 (+ 95939us) raft_consensus.cc:1685] finished
0709 13:06:10.521844 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.540606 (+ 18762us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11987,"raft.queue_time_us":201,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":39115,"spinlock_wait_cycles":19605376,"thread_start_us":373711,"threads_started":1,"wal-append.queue_time_us":824322}
I20260709 13:06:10.545677 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.545493 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.555384 15592 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:10.555384 15587 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:10.556767 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.557309 15587 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:10.558156 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.546958 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:10.550740 15482 connection.cc:256] RPC call timeout handler was delayed by -1.5035216919999357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 13:06:10.559052 15590 raft_consensus.cc:2376] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13. Re-sending same reply.
I20260709 13:06:10.560098 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:10.560931 15590 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:10.562958 19306 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.540740 19348 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:06:10.563925 19191 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:10.565088 19443 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.567459 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.570909 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2454) took 1127 ms. Trace:
I20260709 13:06:10.572463 19372 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.571412 15584 rpcz_store.cc:276] 0709 13:06:09.442990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.283658 (+840668us) service_pool.cc:224] Handling call
0709 13:06:10.283926 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.284431 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:10.296033 (+ 11602us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.429479 (+133446us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.434464 (+  4985us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.434693 (+   229us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:10.470365 (+ 35672us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.470861 (+   496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.470963 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.570658 (+ 99695us) raft_consensus.cc:1685] finished
0709 13:06:10.570683 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.570837 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35336,"prepare.queue_time_us":65113,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":2460,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":26825,"spinlock_wait_cycles":29399936,"thread_start_us":113095,"threads_started":1,"wal-append.queue_time_us":217357}
I20260709 13:06:10.435576 19380 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.576618 15434 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:10.584669 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.588259 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:10.589696 15434 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:10.593215 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:10.586452 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 65231.8us
I20260709 13:06:10.590996 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.596227 15440 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:10.450847 19378 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.603103 19489 raft_consensus.cc:3055] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:10.603838 19489 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:10.604832 19489 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.606003 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 536) took 1799 ms. Trace:
I20260709 13:06:10.606562 19489 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:10.608426 19348 consensus_queue.cc:1243] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:10.599822 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:10.488976 19498 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:06:10.606624 15589 rpcz_store.cc:276] 0709 13:06:08.806147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.814612 (+  8465us) service_pool.cc:224] Handling call
0709 13:06:08.826103 (+ 11491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.844732 (+1018629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.605578 (+760846us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540016d0d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:10.605907 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2332790016}
I20260709 13:06:10.609133 19348 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:10.585103 19436 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.601346 19443 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:10.616151 19467 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:10.618498 19348 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:10.661486 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.662263 15510 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.663465 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.655695 19095 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.648155 19443 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:10.668545 19005 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.656062 19467 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:10.641055 19119 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.642030 19436 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.688128 15510 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:06:10.693150 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.671708 19095 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.698405 19095 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.698545 19151 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:10.699101 19151 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:10.700289 19151 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.700945 19333 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.701933 19151 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:10.702832 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.703869 15440 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:10.705680 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:10.706741 19005 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:10.707314 19005 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.708235 19005 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:10.709232 19467 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.711790 19348 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.713519 19348 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:10.719882 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 159702us
I20260709 13:06:10.748992 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:10.749873 15517 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
W20260709 13:06:10.752403 15482 connection.cc:256] RPC call timeout handler was delayed by -1.4157849059998853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:06:10.752826 15482 connection.cc:256] RPC call timeout handler was delayed by -1.409528956000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:06:10.753548 15482 connection.cc:256] RPC call timeout handler was delayed by -1.2861849059999031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:06:10.754431 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1867216919999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:06:10.754860 15482 connection.cc:256] RPC call timeout handler was delayed by -1.149263818999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 13:06:10.755119 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1402638189999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:06:10.755352 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1063054090000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27080000000000004s for a response
I20260709 13:06:10.756762 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:10.708302 19231 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:10.763247 15512 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:10.766618 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:10.768189 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:10.768888 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.769085 15441 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:06:10.756798 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:10.690481 19490 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:06:10.774026 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.774406 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:10.777354 15434 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:10.778743 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.779054 15516 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:10.780818 15436 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 10: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:10.779619 15556 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:10.781730 15440 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:10.782013 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:10.784169 19379 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.783981 19231 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:10.757648 19043 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.757242 19306 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.787971 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.788699 15436 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:10.757218 19305 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.784869 19231 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:10.789739 19379 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:10.790079 19500 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:06:10.763695 19380 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:10.801447 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2437) took 1894 ms. Trace:
I20260709 13:06:10.802124 15591 rpcz_store.cc:276] 0709 13:06:08.907587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.907782 (+   195us) service_pool.cc:224] Handling call
0709 13:06:08.908248 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.461194 (+1552946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.800902 (+339708us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54001dd8d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:10.801343 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569991552}
I20260709 13:06:10.808979 19378 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:10.811029 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.786389 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:10.788787 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:10.846141 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 63413.6us
I20260709 13:06:10.778234 19468 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:10.851194 15585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2455) took 1407 ms (client timeout 1792 ms). Trace:
I20260709 13:06:10.844112 15440 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:10.854707 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2449) took 1456 ms. Trace:
W20260709 13:06:10.856164 15585 rpcz_store.cc:269] 0709 13:06:09.443241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.443344 (+   103us) service_pool.cc:224] Handling call
0709 13:06:10.850711 (+1407367us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000c1a54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:10.850860 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447324032}
I20260709 13:06:10.857628 15588 rpcz_store.cc:276] 0709 13:06:09.398334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.398533 (+   199us) service_pool.cc:224] Handling call
0709 13:06:09.398989 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.752055 (+353066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.752106 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.752171 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:09.752220 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.854452 (+1102232us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400114c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:10.854501 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.854644 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811216256}
I20260709 13:06:10.783246 19436 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:10.861460 19379 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:10.811118 19043 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:10.855532 19495 consensus_meta.cc:287] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.000s
I20260709 13:06:10.852221 18994 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:10.853708 19306 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.875161 19043 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:10.852804 19305 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.892685 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:10.894286 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:10.895107 19378 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:10.758476 19443 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.870873 18994 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:10.855803 19468 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.897648 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:10.900712 15407 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:10.896534 18978 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:10.897780 19362 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:06:10.927940 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:10.873014 19495 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:10.932619 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:10.903812 19095 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.895776 19498 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:10.895524 19378 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:10.927690 19259 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:10.943286 15518 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:10.925216 19468 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.926641 18978 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:10.947171 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 158468us
I20260709 13:06:10.902878 19005 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:10.945803 19513 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
I20260709 13:06:10.945304 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:10.959381 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:10.963800 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:10.965094 15440 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:06:10.965728 15440 pending_rounds.cc:85] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 10
I20260709 13:06:10.966037 15440 pending_rounds.cc:107] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:06:10.966293 15440 raft_consensus.cc:2889] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:10.946827 19378 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:10.895841 19231 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:10.944010 19007 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:10.951421 19264 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:10.946201 19259 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.897563 18994 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.950050 19363 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:10.959450 19491 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:10.990621 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45370.5us
I20260709 13:06:10.993788 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:10.966420 19495 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.001675 19491 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.946343 19095 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:10.984623 19264 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.008082 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:10.997507 19259 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:11.004215 19191 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:11.029134 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57269.7us
I20260709 13:06:11.030465 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:10.983042 19357 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:06:11.023353 18994 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.012951 19043 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:10.992158 19007 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.000502 19518 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:11.042968 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:11.025658 19491 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.050575 19095 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:11.054327 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:11.030704 19264 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:11.071326 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:11.072430 15589 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:11.072795 19005 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:11.055822 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:11.073416 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:11.074143 15588 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:11.074745 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:11.057158 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:11.057936 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:11.076608 15591 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 10: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:11.031754 19495 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.059309 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:11.085656 15587 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:11.060772 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:11.085922 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:11.059196 19512 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.196s	user 0.001s	sys 0.001s
I20260709 13:06:11.064196 15590 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:11.067068 16182 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:11.074100 15589 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:11.077682 15591 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:11.056033 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:11.098208 15585 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:11.058528 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:11.099402 15583 raft_consensus.cc:2376] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9. Re-sending same reply.
I20260709 13:06:11.088649 15587 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:11.075460 16174 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:11.079094 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:11.061388 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:11.101436 16177 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:11.388037 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 326689us
I20260709 13:06:11.388669 19475 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:11.389117 19475 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:11.389057 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:11.389744 19475 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.390246 19495 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.064527 19436 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:11.052053 19379 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.064910 19518 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:11.391777 19043 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:11.045545 19191 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:11.393507 19379 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:11.394043 19379 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:11.394356 19191 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.394970 19379 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.005066 18978 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.396592 18978 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:11.112779 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:11.119509 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:11.400336 16174 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:11.391031 19495 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:11.126286 19264 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.132326 19491 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.134420 19138 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.166893 16182 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:11.139387 19007 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:11.185356 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69561us
I20260709 13:06:11.404174 19264 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:11.194631 19168 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:11.204807 19259 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.209409 19305 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.216171 19468 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:11.405072 18879 consensus_queue.cc:1175] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:11.216420 19378 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.407047 19259 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.247359 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 426) took 1361 ms. Trace:
I20260709 13:06:11.295305 19333 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.404196 19491 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.408339 19333 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.409936 16179 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:11.304591 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:11.411779 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 107349us
I20260709 13:06:11.414276 19372 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:11.414783 19372 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.415175 19372 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.416486 19530 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:11.407768 15435 rpcz_store.cc:276] 0709 13:06:09.886113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.886332 (+   219us) service_pool.cc:224] Handling call
0709 13:06:11.246955 (+1360623us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54000a5354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:11.247234 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523406720}
I20260709 13:06:11.407209 19468 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.422936 19138 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:11.426600 19378 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.428905 19495 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:11.354044 15436 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:11.357317 19498 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:11.357527 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 271741us
I20260709 13:06:11.433313 18966 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:11.433689 15407 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:11.433904 18966 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:11.362263 19334 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.435958 19436 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:11.392467 19518 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:11.437027 19333 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:11.106537 19519 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:11.438437 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:11.435349 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:11.435772 19334 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.445585 19334 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:11.435313 18966 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.447340 18966 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.443684 19498 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.452653 19534 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:11.453244 19534 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:11.458197 16179 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:11.461345 19436 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:11.465855 19436 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:11.461135 19468 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:11.468124 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:11.469159 19378 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:11.466951 19436 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.470626 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:11.476346 19334 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:11.476861 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:11.477903 19334 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:11.478338 19334 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:11.478696 19334 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:11.478899 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:11.461134 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:11.435431 18978 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:11.449005 19518 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.480671 15438 raft_consensus.cc:606] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:11.481058 15438 raft_consensus.cc:614] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:11.481436 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:11.482046 19518 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.482375 19468 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:11.482441 19495 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:11.483304 19468 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:11.484010 19468 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.464557 16174 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:11.469599 19378 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.488216 19378 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.488600 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:11.494743 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 1952) took 1136 ms. Trace:
I20260709 13:06:11.517580 15511 rpcz_store.cc:276] 0709 13:06:10.358205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.358344 (+   139us) service_pool.cc:224] Handling call
0709 13:06:11.494453 (+1136109us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b54003f66d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:11.494653 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14328576}
I20260709 13:06:11.498445 19372 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.499873 18978 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:11.462729 19534 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.507747 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
W20260709 13:06:11.509845 19520 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.476s	user 0.000s	sys 0.004s
W20260709 13:06:11.511409 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.742311 18808 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:11.500885 18879 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:11.505980 19535 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:11.491127 19334 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:12.034590 19138 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.611s	user 0.015s	sys 0.002s
W20260709 13:06:11.670742 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.700289 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.600421 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:11.803566 15510 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:11.815114 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:12.045127 19537 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.664376 15516 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:11.816789 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.056249 15442 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:12.056557 15583 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.595745 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.061028 15511 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:11.757064 15588 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:11.733029 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.072224 15509 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 10: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:11.825259 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:11.815312 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:12.087041 15517 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:12.087743 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:11.811923 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.607623 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.092514 15591 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.666494 16145 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:11.721309 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 308020us
W20260709 13:06:11.694645 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.573953 18966 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:12.102725 18966 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.766096 18978 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.107432 19550 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:12.108615 19550 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.108780 18978 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.772081 19007 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.775522 19168 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.111857 19334 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.111451 19007 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.111609 19168 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.114773 19168 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:11.802830 19264 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.116330 19264 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.117929 19007 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:11.527055 19468 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.121857 19468 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.514657 19475 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.808725 19306 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.507716 19498 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.253882 19498 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.254554 16173 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:11.800139 19372 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:11.507149 19257 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:11.527715 19495 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:12.258281 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:11.503285 19518 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:11.749591 19535 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:11.608798 19539 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:12.275390 19535 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:12.275754 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 536510us
I20260709 13:06:12.277191 19535 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:11.661907 19540 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:11.920867 15584 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:11.911398 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:11.947144 19436 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:11.950614 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:11.954638 15518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34302 (request call id 750) took 1379 ms (client timeout 1822 ms). Trace:
I20260709 13:06:11.970615 19443 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:12.281564 19443 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:11.980643 19005 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:11.981896 19095 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.984323 19467 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.985014 19159 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:12.281139 15518 rpcz_store.cc:269] 0709 13:06:10.574802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.575130 (+   328us) service_pool.cc:224] Handling call
0709 13:06:11.953914 (+1378784us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400212354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:11.954286 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822263552}
I20260709 13:06:12.285480 19095 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.283069 15515 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:12.003273 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.287595 19535 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:12.287961 15589 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:06:12.288213 19467 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.016592 19534 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:12.268776 19518 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:12.289974 19518 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:12.043053 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 442509us
I20260709 13:06:12.291579 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:12.020819 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45904.7us
I20260709 13:06:12.293596 19443 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.122953 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:12.051280 15440 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:12.126678 19264 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.130299 19550 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.295619 15438 raft_consensus.cc:606] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.295799 19467 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.296057 15438 raft_consensus.cc:614] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:12.133512 15338 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 109) took 14567 ms (client timeout 15000 ms). Trace:
I20260709 13:06:12.128063 19362 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:12.138511 18966 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:12.177837 19378 consensus_meta.cc:287] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.689s	user 0.020s	sys 0.009s
I20260709 13:06:12.300009 19362 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.300570 19378 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.178051 15513 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:12.191218 15583 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:12.282877 15585 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.198096 15517 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:12.294737 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.192057 19334 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.307672 19334 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.206286 19489 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.215349 16179 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:12.217293 16174 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:12.221088 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:12.225742 18808 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:12.313599 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.313905 19334 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.227959 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.314822 19550 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:12.283308 19436 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.315836 19264 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:12.316478 19264 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.317443 19436 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.228659 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:12.232401 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:12.317790 19264 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.234488 15441 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:12.243713 19553 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.244313 19475 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.303290 19362 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.319890 19553 raft_consensus.cc:697] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:06:12.249621 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 79330.2us
I20260709 13:06:12.256316 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.322983 19489 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.257963 19498 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.259599 19551 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:12.325925 19489 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.325387 19551 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.260248 16182 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 7: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:12.269038 15591 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:12.235374 19537 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:12.258303 19257 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.279784 19540 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.330394 15442 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:06:12.285596 19159 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.284164 19005 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.321493 19553 consensus_queue.cc:237] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.333041 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.344389 19005 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.344502 19540 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.124074 15510 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:12.294687 19379 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:12.346895 16146 leader_election.cc:400] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10.
I20260709 13:06:12.299950 19539 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:12.296800 15338 rpcz_store.cc:269] 0709 13:05:57.598953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.611745 (+ 12792us) service_pool.cc:224] Handling call
0709 13:06:12.133158 (+14521413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:09.019739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:09.020486 (+   747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:09.020556 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:06:09.020579 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:09.021420 (+   841us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:09.021550 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:09.021581 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:09.022125 (+   544us) tablet.cc:701] Row locks acquired
0709 13:06:09.022191 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:06:09.022403 (+   212us) write_op.cc:270] Start()
0709 13:06:09.022580 (+   177us) write_op.cc:276] Timestamp: P: 1783602369022321 usec, L: 0
0709 13:06:09.022607 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:06:09.538836 (+516229us) log.cc:844] Serialized 1686 byte log entry
0709 13:06:10.460080 (+921244us) op_driver.cc:464] REPLICATION: finished
0709 13:06:10.511985 (+ 51905us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd52e28 00007fcf7f78d581 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d 000000000038f354 000000000038f199
0709 13:06:10.652203 (+140218us) write_op.cc:301] APPLY: starting
0709 13:06:10.657380 (+  5177us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:10.905038 (+247658us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:10.905073 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:11.116191 (+211118us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:11.119477 (+  3286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:06:11.119530 (+    53us) write_op.cc:312] APPLY: finished
0709 13:06:11.119898 (+   368us) log.cc:844] Serialized 49 byte log entry
0709 13:06:11.120114 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:11.120239 (+   125us) write_op.cc:454] Released schema lock
0709 13:06:11.120302 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:11.120806 (+   504us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:11.120846 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3861482,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":165743,"apply.run_cpu_time_us":18112,"apply.run_wall_time_us":473443,"cfile_cache_hit":14,"cfile_cache_hit_bytes":14630,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":61661,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":4,"lbm_reads_lt_1ms":7,"mutex_wait_us":104707,"num_ops":4,"prepare.queue_time_us":328304,"prepare.run_cpu_time_us":53777,"prepare.run_wall_time_us":1518796,"raft.queue_time_us":48571,"raft.run_cpu_time_us":32029,"raft.run_wall_time_us":135093,"replication_time_us":1437260,"spinlock_wait_cycles":341511552,"thread_start_us":671771,"threads_started":4,"wal-append.queue_time_us":674449,"wal-append.run_cpu_time_us":14755,"wal-append.run_wall_time_us":1888166}]]}
I20260709 13:06:12.308656 19467 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.342342 19551 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.342327 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.347980 19530 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:12.369155 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:12.370016 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54478.5us
I20260709 13:06:12.349189 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.371307 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.362051 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.375941 15584 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.376322 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.377189 15589 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.294562 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:12.380272 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 85895.4us
I20260709 13:06:12.380348 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.381661 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.313396 16177 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:12.321465 19095 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:12.324651 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 2095) took 1271 ms. Trace:
I20260709 13:06:11.985359 19231 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.387455 19095 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.387946 19231 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.388768 19475 raft_consensus.cc:2764] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:06:12.340381 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 112904us
I20260709 13:06:12.314755 18808 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:12.340960 19257 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.342012 19159 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.381723 19467 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:12.303248 19378 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.382683 19540 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:12.383433 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.384169 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:12.417303 15438 raft_consensus.cc:606] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.348318 19372 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:06:12.387262 15440 rpcz_store.cc:276] 0709 13:06:11.053487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.053657 (+   170us) service_pool.cc:224] Handling call
0709 13:06:12.324394 (+1270737us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54003a7854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:12.324570 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231371648}
I20260709 13:06:12.419427 19372 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:12.401247 15515 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
W20260709 13:06:12.355741 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 88314.1us
I20260709 13:06:12.419950 19372 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:12.421072 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.421191 19372 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.423862 19362 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:12.424141 18966 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:12.424907 18978 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:12.425395 19362 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:12.405047 16177 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:12.426030 19362 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.411154 15584 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:12.411598 15589 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:06:12.427318 15513 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:12.425355 18978 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.427223 19362 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.431095 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:12.432156 15442 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.403710 15585 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:12.402290 18808 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.411266 19530 raft_consensus.cc:2764] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:12.409559 19534 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.440845 19372 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:12.429230 19231 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:12.423851 19498 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:12.416975 19540 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.443310 18978 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.464250 15442 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
W20260709 13:06:12.469496 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86312.1us
W20260709 13:06:12.471868 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 150669us
I20260709 13:06:12.472169 18966 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.473074 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:12.472851 18966 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.475749 15516 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:12.475023 19555 consensus_queue.cc:1175] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" responder_term: 9 status { last_received { term: 7 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:12.428810 19138 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:06:12.478912 19159 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:12.479740 19159 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:12.471947 19378 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.480650 19378 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.481038 19159 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.483142 19378 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.484304 19005 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:12.486141 19257 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.479741 19498 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.555588 19539 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.555934 19498 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.556823 15510 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:12.500509 15340 catalog_manager.cc:5697] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:12.464191 19540 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:12.559244 15340 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 7, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:12.561482 15340 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 7, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 7 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:12.504077 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.565166 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.505686 18978 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.507836 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:12.512661 19362 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:12.572659 15442 raft_consensus.cc:606] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.573225 15442 raft_consensus.cc:614] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:12.515123 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.575559 19191 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:12.576113 15518 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:12.576212 19191 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.516443 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.577870 15514 raft_consensus.cc:2410] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:06:12.517578 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.520798 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.578657 19191 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.578963 15509 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:12.579054 15512 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
W20260709 13:06:12.521214 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 64514.4us
I20260709 13:06:12.522786 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:12.581712 19534 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:12.582228 15513 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:12.582530 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:12.582424 19534 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.583266 15442 raft_consensus.cc:606] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.583209 19196 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:12.584618 19185 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:12.585644 19185 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:12.586015 19185 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.586624 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.587725 15512 raft_consensus.cc:2393] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:12.523651 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.530707 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.588377 15517 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:12.588472 15589 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:06:12.525142 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.534114 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.589498 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.589933 15591 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:12.590313 16177 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:12.533766 18966 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:12.534351 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69418.3us
W20260709 13:06:12.535197 15539 debug-util.cc:398] Leaking SignalData structure 0x7b08001b30a0 after lost signal to thread 14296
I20260709 13:06:12.591009 19550 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:12.591071 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:12.590328 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65337.9us
I20260709 13:06:12.592041 19534 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:12.589542 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:12.592710 15539 debug-util.cc:398] Leaking SignalData structure 0x7b08000c93a0 after lost signal to thread 15375
I20260709 13:06:12.593858 15589 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:12.535981 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:12.595498 15539 debug-util.cc:398] Leaking SignalData structure 0x7b080005a4c0 after lost signal to thread 15467
I20260709 13:06:12.595834 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:12.597267 15539 debug-util.cc:398] Leaking SignalData structure 0x7b080014c1c0 after lost signal to thread 15542
I20260709 13:06:12.541988 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:12.597621 15539 debug-util.cc:398] Leaking SignalData structure 0x7b0800325260 after lost signal to thread 15543
I20260709 13:06:12.597927 15587 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:12.542855 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.598871 15583 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:06:12.599337 15539 debug-util.cc:398] Leaking SignalData structure 0x7b08002190a0 after lost signal to thread 15616
W20260709 13:06:12.568920 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 80546.7us
W20260709 13:06:12.601090 15539 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0960 after lost signal to thread 16206
I20260709 13:06:12.535099 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.603902 15590 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 6.
I20260709 13:06:12.605255 19378 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.605876 19378 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.606184 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.544770 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.535125 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.608371 15516 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:12.608799 19378 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.551770 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.609635 15588 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:12.550338 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.611357 15585 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:12.536907 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.535341 19138 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:12.593289 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.443442 18808 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.602397 19550 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:12.465060 19551 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:12.587077 19185 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.623783 15583 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:06:12.601435 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:12.615132 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.631141 15587 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:12.628341 15586 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:12.634438 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.635389 15584 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:06:12.563973 15340 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:12.592741 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.620432 15513 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:12.641157 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.620769 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:12.620826 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.583945 15442 raft_consensus.cc:614] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:12.592765 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.646471 15591 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:12.649153 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.650641 19095 raft_consensus.cc:2764] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:06:12.650439 16180 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:12.651458 19095 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:12.650465 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57831.1us
I20260709 13:06:12.652791 15592 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:06:12.652849 19185 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:12.653353 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:12.653954 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.655015 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.655893 19095 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:12.657236 16177 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:12.639314 19489 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:06:12.647827 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 46513.9us
I20260709 13:06:12.675134 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.675913 15584 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:12.679175 15406 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.685075 19264 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:06:12.642827 19518 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.677816 19534 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.693511 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.684687 15340 catalog_manager.cc:5697] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:12.701783 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:12.702512 16180 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.701944 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.710247 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:12.714682 15442 raft_consensus.cc:2410] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:12.717273 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:12.720125 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:12.720852 16177 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:12.723660 19259 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:12.733242 15406 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.733861 19259 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.734347 15406 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.735062 19259 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.735744 19334 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:12.736219 19334 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.736570 19334 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.703876 19191 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:12.727849 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:12.737424 19191 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:12.737963 19191 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:12.738318 18808 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.739164 19511 raft_consensus.cc:2764] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:12.730124 16180 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:12.694168 19378 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.731844 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:12.732648 18978 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.734488 19196 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:12.727276 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.740619 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 85738.7us
I20260709 13:06:12.735430 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.744177 15511 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:12.741750 19555 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.725286 15340 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:12.747154 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.753355 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.753768 16180 raft_consensus.cc:2368] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10.
I20260709 13:06:12.748659 19196 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.745144 19534 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.756351 19196 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:12.758325 19534 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.759680 18978 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:12.760304 18978 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:12.760730 18978 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:12.762880 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.762900 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.763973 15511 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:12.775719 15585 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:12.702666 19095 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:12.751413 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:12.741830 19378 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.780795 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.749560 16177 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:12.740330 19539 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.802350 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:12.801539 16180 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:12.808444 19306 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.809727 19378 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:12.773481 19498 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:12.810524 19498 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.809216 19539 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.810994 19498 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.810340 19306 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:12.814991 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52194.5us
I20260709 13:06:12.763674 19555 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.825241 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.825676 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.826633 16180 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:12.827070 19555 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.827754 19539 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.830168 15586 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:12.821844 18966 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:12.832500 18966 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:12.834144 18966 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:12.837075 19568 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:06:12.837666 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.838938 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.840090 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.841660 15592 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:12.843186 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:12.844271 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.845639 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:12.846472 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:12.887020 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 66982.1us
I20260709 13:06:12.891721 16177 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:12.846638 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.847239 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.893210 16179 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:12.848089 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:12.849411 16173 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:12.848097 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.861129 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.861742 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.862025 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:12.862916 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.864487 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:12.903584 15517 raft_consensus.cc:2410] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:06:12.839669 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76414.2us
I20260709 13:06:12.875440 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.904420 15583 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.877169 19518 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:12.877614 19539 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.878623 19379 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.879521 19566 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:12.822597 19553 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:12.819361 15340 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 10 to 11, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 11 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.917320 15588 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:12.917106 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.923236 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.924260 15512 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:12.925338 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.926169 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.926610 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.923846 19362 consensus_queue.cc:1059] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:12.927846 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:12.933012 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 115316us
I20260709 13:06:12.927408 15512 raft_consensus.cc:2368] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12.
I20260709 13:06:12.934783 15584 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:12.927512 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:12.929059 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.929174 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.928681 15340 catalog_manager.cc:5697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:12.953437 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:12.953450 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.955587 16179 raft_consensus.cc:2410] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:12.819572 19540 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.927918 19553 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.957271 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:12.928611 19362 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:12.959517 15583 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:12.962141 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:12.962714 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.960630 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.970650 15513 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:12.970292 15510 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:12.966792 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:12.977727 15592 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:12.956278 16174 raft_consensus.cc:2368] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7.
I20260709 13:06:12.973229 15340 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 7 to 10, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 10 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.014156 15514 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:06:12.930006 19539 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:12.929876 19379 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:12.948153 19306 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:13.022516 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:12.974263 19553 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.974022 19362 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:13.014672 19489 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:13.033429 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 120978us
I20260709 13:06:13.024649 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.031822 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:13.032038 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:13.047748 15438 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:13.040350 15340 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:06:13.052407 15515 raft_consensus.cc:2410] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:13.031112 19498 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.056313 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:13.057265 16179 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:13.050302 15340 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 5 to 6, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 6 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.065086 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:13.065855 15585 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:13.070065 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.070585 19540 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.060509 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.072423 15517 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:13.046249 19095 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.081686 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:13.082931 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.025600 19334 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.090842 15584 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:13.094660 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 139655us
I20260709 13:06:13.066800 19489 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:13.104130 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.105134 19264 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:13.105755 16173 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:13.106889 19191 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.076638 19159 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:13.137228 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54455.3us
I20260709 13:06:13.138458 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.126317 18978 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.130872 19539 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.131569 19264 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:13.142375 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:13.140369 19379 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:13.149190 15340 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 7 to 9, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 9 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.159752 19264 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.160274 15340 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 10 to 12, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 12 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.161186 18978 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.162493 15340 catalog_manager.cc:5697] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.164088 15340 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.165738 15340 catalog_manager.cc:5697] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 3 to 5, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.167227 15340 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 7 to 8, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.169508 15340 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 9, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.172508 15340 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 8, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 8 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.176431 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:13.176149 19489 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.178642 19185 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:13.135299 19159 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.179411 19159 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:13.183475 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 231359us
I20260709 13:06:13.175297 15340 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.190769 19185 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:13.196391 19185 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.197041 19362 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.197598 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:13.190745 15482 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.68:33529 timed out after 1.894s (SENT) [suppressed 21 similar messages]
I20260709 13:06:13.200707 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.201165 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:13.201704 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.202404 19379 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.202633 15443 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:13.203600 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:13.203732 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:13.204947 15435 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:13.206110 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.203791 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.180285 19378 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.180457 19498 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.185051 15340 catalog_manager.cc:5697] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 1 to 6, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.212329 15443 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:13.224568 15340 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:13.228736 15435 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:13.231971 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:13.226279 19551 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:13.247802 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:13.248147 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:13.249225 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:13.250661 19379 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:13.251080 19306 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:13.251260 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:13.207347 19576 consensus_queue.cc:1175] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d225833a2cbf4a5995fdbbb1292d1918" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 6 } }
I20260709 13:06:13.231734 19467 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:13.260946 15340 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 5 to 6, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 6 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:13.255733 18808 consensus_meta.cc:287] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.006s
I20260709 13:06:13.229756 19378 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.251108 19379 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.267978 18966 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:13.277889 15340 catalog_manager.cc:5697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } }
W20260709 13:06:13.297538 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57876.3us
I20260709 13:06:13.299346 15436 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:13.302863 19379 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:13.305882 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.310032 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:13.284093 19095 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:13.301095 19196 consensus_meta.cc:287] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.003s
I20260709 13:06:13.324399 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:13.308991 19575 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:06:13.328150 15515 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:13.339668 15434 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:06:13.304028 18966 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.337253 19185 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:13.362931 15439 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:13.286161 19540 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:13.359814 15437 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:13.366920 19592 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:13.271509 19539 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:06:13.321790 19334 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.361227 15517 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:13.329298 19372 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:13.373123 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 121955us
W20260709 13:06:13.373212 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45592.4us
W20260709 13:06:13.340830 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 108890us
I20260709 13:06:13.376567 19534 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:13.372684 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:13.387414 15510 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:13.381065 15512 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:13.382871 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:13.379067 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 178513us
I20260709 13:06:13.323272 18978 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:06:13.364174 18966 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.391811 16146 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.399046 15440 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:13.396667 19372 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:13.378404 19191 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:13.404521 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79696.5us
I20260709 13:06:13.360926 19553 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:13.359617 19196 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.413414 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:13.411347 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:13.390098 19185 consensus_queue.cc:1243] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:13.403690 19467 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:13.406257 19555 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:13.437448 19555 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.437894 19555 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.440442 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:13.441121 15438 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:13.425479 19372 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:13.427977 19196 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.429015 19589 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:13.433375 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:13.424204 19539 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 13:06:13.436277 19581 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:13.452574 15510 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:13.424495 19095 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:13.456784 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51514.6us
W20260709 13:06:13.465938 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54650.7us
I20260709 13:06:13.471920 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.473423 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:13.484268 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66905.6us
I20260709 13:06:13.484637 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.449558 19518 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:13.441975 19592 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:06:13.493377 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.492673 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:13.495467 19585 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:06:13.496681 19467 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:13.498780 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:13.499882 19257 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:06:13.500284 19582 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.240s	user 0.004s	sys 0.000s
I20260709 13:06:13.501518 19257 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:13.502028 19257 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:13.486629 19334 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:13.511585 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:13.512071 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:13.513329 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:13.513547 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:13.493808 19586 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:06:13.522555 15509 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:13.514616 15511 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:13.517875 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 136404us
I20260709 13:06:13.515364 15437 raft_consensus.cc:2410] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:13.520507 15515 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:13.520349 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:13.524937 15517 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.530377 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.533273 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.491063 19598 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:13.511652 19540 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:13.511891 19378 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.503054 19257 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.514250 19334 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:13.542274 19590 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:06:13.553895 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:13.554787 15513 raft_consensus.cc:2410] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:13.546087 19539 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:13.556686 15439 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
W20260709 13:06:13.557744 19596 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:13.557559 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.563864 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:13.544324 19540 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.564589 15513 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.549772 19095 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.573300 19600 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:13.555903 19334 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:13.559731 19539 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:13.583010 19540 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:13.585130 19598 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:13.652529 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 212153us
I20260709 13:06:13.654033 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:13.665697 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.667286 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 109873us
I20260709 13:06:13.668895 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.676792 15517 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:13.638484 19553 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.679509 19601 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:13.680037 19601 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:13.681082 19601 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.681979 15436 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:13.682631 19601 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:13.678157 19095 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.650079 19600 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.709666 19600 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:13.724838 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.727154 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 73236us
I20260709 13:06:13.687119 19159 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:13.737318 15512 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:13.739626 15513 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
W20260709 13:06:13.730108 15555 connection.cc:256] RPC call timeout handler was delayed by -1.0462062479999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:06:13.750967 19555 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:13.754195 19191 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:13.754751 19191 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:13.758311 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.766268 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:13.764936 15406 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:13.769894 15515 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:13.775708 19191 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.777225 19191 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.778855 19580 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:13.772318 19259 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:06:13.779815 19580 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:13.781284 19580 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.783862 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:13.754752 19555 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.789022 15511 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:13.807976 19489 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:13.739727 19539 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.808305 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:13.809430 19539 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:13.808614 19489 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:13.812208 19489 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.744679 19600 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.814052 19600 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.815824 19372 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:13.820206 15515 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:13.820551 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:13.820778 15515 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:13.821857 15515 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.822384 15588 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:13.823227 15515 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:13.745707 19518 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:13.846861 15513 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.856315 15406 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:13.879174 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 94042.2us
I20260709 13:06:13.888286 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:13.890316 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.765231 19540 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.843804 19362 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.891834 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:13.773159 19379 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.894786 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:13.890774 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.897781 15436 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:13.898190 16177 raft_consensus.cc:2410] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:13.845211 19600 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.868854 19372 raft_consensus.cc:697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:13.880939 19518 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:13.888010 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 339407us
I20260709 13:06:13.904414 15515 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:13.907961 15439 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:13.905936 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:13.914005 19095 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:13.881790 19378 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:13.915505 19372 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:13.921255 19540 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.921952 19379 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:13.909577 19598 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.935745 15516 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:13.906075 18966 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:13.895925 19138 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:13.937016 19306 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:06:13.938067 18966 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:13.943517 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:13.954419 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 48594.3us
I20260709 13:06:13.955155 15592 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:13.957269 15513 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:13.959777 15442 raft_consensus.cc:2368] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10.
I20260709 13:06:13.896237 19592 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:06:13.967312 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:13.973402 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 67263.8us
I20260709 13:06:13.973402 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:13.974817 15584 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.982833 16145 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:13.964545 19138 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:13.990917 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:13.991639 16177 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:13.985810 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 78253us
I20260709 13:06:13.992741 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:13.995837 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:13.999001 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:13.999040 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:14.000221 15518 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13.
I20260709 13:06:14.002125 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.002125 15518 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:06:14.004091 15518 pending_rounds.cc:85] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 4
I20260709 13:06:13.983465 19489 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.995260 16173 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:14.007827 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:14.008394 19138 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.985924 19606 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.009411 15517 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:14.009711 19606 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:13.987154 19592 consensus_queue.cc:1243] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:14.003309 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:13.989663 19379 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.006628 19540 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.011432 19379 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.011670 19540 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.014029 19379 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:14.014272 19577 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:06:14.017068 19306 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.017951 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:14.017849 19306 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.018754 15515 raft_consensus.cc:2368] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 5. Current term is 6.
I20260709 13:06:14.017163 19593 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:14.019773 19593 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:14.020238 19593 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:14.009022 19603 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.265s	user 0.000s	sys 0.002s
I20260709 13:06:14.030733 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.004415 15518 pending_rounds.cc:107] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:14.033838 15518 raft_consensus.cc:2889] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.039387 15588 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:14.040642 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.046823 15584 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:14.013950 19540 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:14.002707 19159 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:14.006393 19553 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:14.058260 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.065505 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:14.065831 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:14.056686 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.067066 19617 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.073484 19617 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.075999 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:14.025812 19518 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.080072 19498 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:14.080912 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:14.068544 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65330.4us
W20260709 13:06:14.084450 19609 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:06:14.069468 16179 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:14.086625 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:14.079922 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:14.087661 16180 raft_consensus.cc:2376] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11. Re-sending same reply.
I20260709 13:06:14.089864 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:14.090574 15515 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.069033 15588 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:14.100442 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 292381us
I20260709 13:06:14.101641 15592 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:14.105858 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.106609 15587 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:14.108285 15587 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:14.110384 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:14.111371 15586 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.102746 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:14.115590 16177 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:14.121892 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:14.072522 19607 log.cc:927] Time spent T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:06:14.133240 15585 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:14.133984 15585 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:14.143831 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:14.144622 15583 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.145323 15512 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:14.147807 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:14.149120 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.153005 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.156837 15589 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:14.082492 19553 raft_consensus.cc:697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 10 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:14.199250 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:14.211897 16179 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.200168 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:14.214052 15441 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:14.123145 19498 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:14.083248 19334 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.200994 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:14.203680 19615 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:14.204242 19595 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:06:14.205704 19592 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.206010 15585 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:14.229799 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.155503 19550 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.203680 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:14.209378 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 116190us
I20260709 13:06:14.135305 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:14.231017 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:14.152115 19372 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.230198 15585 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:14.122602 19259 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:06:14.161204 19159 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.193475 15515 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:14.242869 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.161903 19606 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:14.246181 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.253116 15513 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:14.254406 15583 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
W20260709 13:06:14.258667 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 113684us
I20260709 13:06:14.260301 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:14.261018 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:14.224051 19555 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:14.292414 15512 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:06:14.292920 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 61904us
W20260709 13:06:14.293612 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.244692 19621 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:14.309214 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 49023.1us
I20260709 13:06:14.264204 19306 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:14.321364 15513 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:14.267655 19615 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:14.340196 19498 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.251441 19372 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.344633 19334 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:14.297211 19617 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:14.345924 19617 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:14.258605 19159 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:14.348956 19618 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
W20260709 13:06:14.365221 19624 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:14.322815 19580 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:14.324432 19550 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:06:14.241894 19592 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.317945 19576 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:14.387442 19615 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.399993 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:14.399994 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:14.402143 15592 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.399832 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:14.404495 19550 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.408406 19598 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:14.405689 19550 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.409188 19598 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.418227 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1961) took 1215 ms. Trace:
I20260709 13:06:14.421655 15441 rpcz_store.cc:276] 0709 13:06:13.202794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.203168 (+   374us) service_pool.cc:224] Handling call
0709 13:06:14.417878 (+1214710us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b5400225bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:14.418108 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984394624}
I20260709 13:06:14.423674 19553 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:14.436677 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 75447.6us
I20260709 13:06:14.442575 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:14.454434 15585 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
W20260709 13:06:14.454361 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 306641us
I20260709 13:06:14.455730 15585 pending_rounds.cc:85] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 6
I20260709 13:06:14.456230 15585 pending_rounds.cc:107] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:06:14.456590 15585 raft_consensus.cc:2889] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.462255 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:14.462352 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:14.464846 15441 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.477587 19191 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.478338 19191 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.480883 19191 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:14.482271 19614 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:06:14.451687 19306 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:14.449587 19580 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:14.486989 19580 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.488411 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:14.490005 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:14.492568 15588 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:14.473780 15509 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:06:14.496274 15592 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:14.496531 15509 pending_rounds.cc:85] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:06:14.505534 16179 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:14.445259 19259 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:06:14.541829 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50569.1us
I20260709 13:06:14.545780 16146 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:14.546969 15441 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:14.478253 19159 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:14.566148 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:14.542790 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 417907us
I20260709 13:06:14.544080 15509 pending_rounds.cc:107] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:06:14.568143 15509 raft_consensus.cc:2889] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.493634 19593 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.572578 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.573740 15511 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:14.535138 19606 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.535614 19540 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:14.580024 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 117897us
I20260709 13:06:14.588181 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:14.597499 15442 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:14.601790 19372 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:14.602569 19372 raft_consensus.cc:2764] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:14.603312 19372 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.603874 19372 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.570466 19379 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.606716 19372 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:14.612155 19379 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.643052 15592 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:14.596815 19540 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.616864 15586 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
W20260709 13:06:14.643841 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 349448us
W20260709 13:06:14.646111 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 58052.8us
I20260709 13:06:14.712468 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:14.618541 16174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.009s	sys 0.024s
W20260709 13:06:14.615063 19601 consensus_meta.cc:287] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.915s	user 0.005s	sys 0.012s
I20260709 13:06:14.643882 19185 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:06:14.617722 19592 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:14.617413 19306 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:14.687650 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.647138 19598 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:14.709194 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.731925 15513 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:14.732496 15515 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:06:14.732877 15515 pending_rounds.cc:85] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 6
I20260709 13:06:14.733109 15515 pending_rounds.cc:107] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:06:14.733371 15515 raft_consensus.cc:2889] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.715833 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:14.714403 16174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.009s	sys 0.025s
I20260709 13:06:14.737174 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:14.726610 19539 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:14.758603 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:14.757576 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 496594us
I20260709 13:06:14.759862 19601 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:14.801750 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 239707us
I20260709 13:06:14.759696 19615 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.759286 19539 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.826884 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:14.764117 19306 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:14.824214 19467 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.834113 19615 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:14.835037 19467 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:14.836855 19615 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:14.841310 19639 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:14.822468 19601 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.842526 19601 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.843142 19550 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:14.868261 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:14.869025 15438 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:14.831156 19593 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:14.829162 19539 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.848001 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:14.849917 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.872586 15440 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:14.801452 19630 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:14.873301 15510 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:14.873672 15509 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:14.851879 19595 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:14.853545 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:14.853821 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.856099 19379 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:14.857599 19540 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:14.858057 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:14.858320 19306 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:14.824851 19191 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:06:14.859033 15512 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:14.860687 19467 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:14.866134 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:14.906939 15586 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:14.911063 15584 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:14.906507 19632 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:14.913612 19598 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:14.936933 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 113237us
W20260709 13:06:14.954325 15590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.006s	sys 0.013s
W20260709 13:06:14.954723 15590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.006s	sys 0.013s
W20260709 13:06:14.958869 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 119683us
W20260709 13:06:14.962170 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 160790us
I20260709 13:06:14.962540 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:14.969570 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:14.927120 16174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 591) took 1082 ms. Trace:
W20260709 13:06:14.978643 15591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.018s	sys 0.015s
W20260709 13:06:14.984259 15591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.018s	sys 0.015s
I20260709 13:06:14.932928 19553 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:06:14.987509 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65618.6us
I20260709 13:06:15.002291 15555 leader_election.cc:400] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12.
W20260709 13:06:14.999809 19489 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.972s	user 0.017s	sys 0.005s
I20260709 13:06:14.979830 19638 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:15.012900 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 64108.5us
I20260709 13:06:14.953514 19632 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:15.006167 19589 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:15.015064 15434 raft_consensus.cc:2410] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:14.976867 19467 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:14.979750 19550 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:06:15.006384 19257 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.983916 19648 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:14.990345 19637 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:06:15.012281 19191 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:15.053056 15407 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:15.000797 19306 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:15.074374 19655 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:06:15.080453 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:15.062465 15515 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:15.037544 19257 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.031533 19589 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.044606 19489 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:06:15.029156 19642 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:06:15.056066 19511 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:15.074690 19539 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.156876 19257 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:15.159720 19641 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
W20260709 13:06:15.161743 19661 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:06:15.163689 19662 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:06:15.164186 19632 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:15.165107 19589 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:15.165268 19656 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:06:15.182132 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 356726us
W20260709 13:06:15.190847 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 266937us
I20260709 13:06:14.985179 16174 rpcz_store.cc:276] 0709 13:06:13.827280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.868957 (+ 41677us) service_pool.cc:224] Handling call
0709 13:06:13.924441 (+ 55484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.986486 (+ 62045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.988340 (+  1854us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.023864 (+ 35524us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.764320 (+740456us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:14.766097 (+  1777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.783035 (+ 16938us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:14.876348 (+ 93313us) raft_consensus.cc:1685] finished
0709 13:06:14.896189 (+ 19841us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.909118 (+ 12929us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9679,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":1856,"thread_start_us":711279,"threads_started":1,"wal-append.queue_time_us":705876}
W20260709 13:06:15.194324 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 103807us
I20260709 13:06:15.196545 15590 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:15.201308 15518 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:15.202525 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:15.204950 15590 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 10: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:15.206512 19657 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:06:15.194151 19555 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:15.213984 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:15.216282 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:15.218334 19518 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:15.218950 19518 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:15.219050 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:15.219980 19518 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.220631 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:15.221339 19658 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:15.223762 19379 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.226969 19539 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:15.229615 19668 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:15.223791 19540 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:15.245759 19601 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:15.251829 19632 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:15.253962 16180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 450) took 1106 ms. Trace:
I20260709 13:06:15.254575 16180 rpcz_store.cc:276] 0709 13:06:14.147088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.147212 (+   124us) service_pool.cc:224] Handling call
0709 13:06:14.199322 (+ 52110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.544821 (+345499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.544872 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.862354 (+317482us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b2c0001d2f8. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:06:14.862798 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.193469 (+330671us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:15.193522 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.193656 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.253460 (+ 59804us) raft_consensus.cc:1685] finished
0709 13:06:15.253500 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.253856 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":166106,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":9101184,"thread_start_us":674265,"threads_started":2,"wal-append.queue_time_us":388717}
I20260709 13:06:15.265718 19576 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:15.285604 19185 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:15.286489 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 182871us
I20260709 13:06:15.293205 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:15.294039 15517 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:15.295286 15513 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:15.291056 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:15.303314 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:15.304087 15587 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:15.300807 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:15.328850 16180 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:15.325775 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:15.336387 15583 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:15.330456 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:15.337142 15585 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:15.337303 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:15.334182 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:15.343928 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52991us
I20260709 13:06:15.353010 15583 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:06:15.325241 19663 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.254s	user 0.000s	sys 0.003s
I20260709 13:06:15.357344 15583 raft_consensus.cc:3055] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:15.360723 15583 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:15.360972 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:15.355616 19518 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.366191 15583 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.366549 19518 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.367264 19601 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:15.332509 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:15.367795 15583 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.368377 16173 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:15.278193 19597 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:15.376085 19257 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:15.377077 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:15.377264 19489 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.378262 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:15.355517 19641 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:15.378974 19638 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:15.393870 19638 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:15.395948 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.396323 19518 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:15.379737 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.343966 19671 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.379822 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:15.381767 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:15.386530 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:15.398811 15438 raft_consensus.cc:2368] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 10. Current term is 11.
I20260709 13:06:15.386361 19257 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.387399 15437 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:06:15.386569 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:15.392577 19641 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:15.380841 19677 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:06:15.369597 19498 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.387887 19659 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:15.409410 15437 pending_rounds.cc:85] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 8
I20260709 13:06:15.322189 19658 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:15.379002 19259 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:15.419896 15437 pending_rounds.cc:107] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:06:15.420280 15437 raft_consensus.cc:2889] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:15.417954 15583 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:15.381513 15587 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:15.399897 19379 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:15.464835 15434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 1962) took 1587 ms (client timeout 2005 ms). Trace:
I20260709 13:06:15.390040 19550 consensus_queue.cc:1243] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:06:15.465801 15434 rpcz_store.cc:269] 0709 13:06:13.877271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.877446 (+   175us) service_pool.cc:224] Handling call
0709 13:06:15.464612 (+1587166us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002b2354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:15.464772 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2573344000}
I20260709 13:06:15.414790 19641 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.412628 19597 raft_consensus.cc:697] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:15.415194 19592 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.529706 15587 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:06:15.512189 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 542671us
I20260709 13:06:15.422240 19467 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:15.422312 19659 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:15.399039 19489 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:15.421940 19138 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:15.488883 19598 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.423137 19580 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 13:06:15.397719 19671 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:15.548327 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 84949.3us
W20260709 13:06:15.552242 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 331674us
I20260709 13:06:15.531354 19550 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.559108 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:15.556456 19467 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.461808 19498 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:15.570909 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:15.461280 19264 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:06:15.464654 19259 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.577776 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:15.587369 15555 leader_election.cc:336] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.515s (SENT)
I20260709 13:06:15.588142 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:15.590659 16146 leader_election.cc:400] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 10. Current term is 11.
I20260709 13:06:15.591353 16146 leader_election.cc:403] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:15.598470 16146 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:15.538928 19592 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:15.614414 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 75976.8us
I20260709 13:06:15.627312 15442 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:15.555095 19672 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:15.583241 19667 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:15.584715 19550 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.586476 19379 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:15.602926 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:15.560032 19598 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:15.651860 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 75353.3us
I20260709 13:06:15.651914 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:15.656736 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 60881.5us
I20260709 13:06:15.658443 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:15.651185 19688 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:15.656230 15437 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:15.670440 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:15.575331 19334 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:06:15.679526 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 76718.8us
W20260709 13:06:15.685645 15555 leader_election.cc:336] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.528s (SENT)
I20260709 13:06:15.686213 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:15.683419 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:15.640100 19606 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:15.634416 19638 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:06:15.691495 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 93122.5us
I20260709 13:06:15.696381 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:15.643998 19632 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:15.661119 19191 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.660188 19688 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:15.653867 19589 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.689072 19676 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:15.697592 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:15.700065 19138 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:15.722949 16173 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:15.739409 19259 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:15.741814 19690 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:15.743356 19592 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:15.705941 19606 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.747078 19606 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:15.748459 19498 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:15.749606 19489 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:15.644225 19659 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:15.751188 19659 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:15.640828 19597 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.676651 19379 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:15.687184 19306 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:15.733572 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46754.6us
I20260709 13:06:15.640506 19658 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.723731 19695 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:15.731630 19138 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.778784 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:15.814733 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 351526us
I20260709 13:06:15.727006 19688 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:15.747257 19642 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:06:15.758340 19467 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:15.710649 19638 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:15.804355 19539 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:15.818655 19138 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:15.897046 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 200816us
I20260709 13:06:15.816752 19592 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.828418 19511 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:15.724026 19191 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:15.906668 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 70163.9us
I20260709 13:06:15.810006 19671 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:15.919756 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:15.924474 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 226943us
I20260709 13:06:15.768126 19589 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:15.927875 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 50542.1us
I20260709 13:06:15.839464 18966 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:06:15.900334 19668 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:15.956640 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.986868 15589 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:15.987473 15589 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:15.987726 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68208.5us
I20260709 13:06:15.943770 19670 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 10. Current term is 11.
I20260709 13:06:15.933378 19553 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:16.000133 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:16.009822 16179 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
W20260709 13:06:16.013113 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 356887us
I20260709 13:06:15.989953 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:16.003736 15556 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:15.941383 19467 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:15.918368 19593 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:06:15.820842 19695 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.024875 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:15.941695 19372 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:06:15.926482 19592 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.001621 19539 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:15.980922 19511 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:16.032035 19689 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:16.032524 19687 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.032985 19686 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.033273 19259 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:16.023748 19490 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:16.069916 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.042455 19257 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.030871 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:16.050750 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62097us
I20260709 13:06:16.023747 19685 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:16.066591 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51561.2us
I20260709 13:06:15.952702 19379 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.106760 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.068545 19550 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.129410 15437 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:16.066018 19259 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:16.143718 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:16.148303 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54521.4us
I20260709 13:06:16.070492 19306 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.060122 19334 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:06:16.157060 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.061534 19539 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.171413 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.153065 19259 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.151880 19550 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.069972 19687 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:16.199177 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.200302 15509 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:16.201648 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:16.202550 15583 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:16.202826 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:16.205667 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 307515us
I20260709 13:06:16.206017 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:16.076678 19686 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.223922 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:16.232419 19698 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:06:16.232565 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.233487 15583 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:16.234750 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.235363 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.218448 19588 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.236845 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.237169 19588 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.239955 19588 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:16.240263 19684 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:16.240871 19684 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.241285 19684 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.246701 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.247520 15584 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:16.247685 19592 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.247923 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:16.248558 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:16.249272 19699 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.250142 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:16.249295 15584 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:16.251507 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.252122 15584 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:06:16.252961 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:16.249883 19699 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.253427 15510 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:16.249317 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:16.255293 15516 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:16.253480 15584 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:16.256137 19659 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.004s
I20260709 13:06:16.185245 19671 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:16.256933 19671 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.255328 19699 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.259116 19671 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.259929 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:16.260681 15513 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
W20260709 13:06:16.232573 19705 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:16.264571 19191 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.266570 19539 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:16.269518 19641 consensus_meta.cc:287] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.002s
I20260709 13:06:16.236495 19695 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:16.272164 19467 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:16.277402 19641 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.237599 15587 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:16.274223 19589 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.281971 19641 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.285951 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 575) took 1014 ms. Trace:
I20260709 13:06:16.286514 15586 rpcz_store.cc:276] 0709 13:06:15.271750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.271914 (+   164us) service_pool.cc:224] Handling call
0709 13:06:15.272388 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.762104 (+489716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.762141 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.816567 (+ 54426us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.985686 (+169119us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:15.985824 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.986037 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.285634 (+299597us) raft_consensus.cc:1685] finished
0709 13:06:16.285660 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.285859 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125496,"raft.queue_time_us":302673,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":35562,"thread_start_us":432218,"threads_started":2,"wal-append.queue_time_us":406194}
I20260709 13:06:16.223258 19638 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.278849 15584 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:16.282006 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.294893 15587 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:16.297287 15586 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:06:16.273186 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 67271.3us
I20260709 13:06:16.110152 19685 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.300112 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:16.307454 15586 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:16.324584 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 98371us
I20260709 13:06:16.160392 19306 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.255085 15589 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.332796 15583 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:16.183723 19511 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.327517 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:16.341513 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 567) took 1141 ms. Trace:
I20260709 13:06:16.342053 15588 rpcz_store.cc:276] 0709 13:06:15.188999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.189187 (+   188us) service_pool.cc:224] Handling call
0709 13:06:15.189598 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.390179 (+200581us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:15.390224 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.390873 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.800794 (+409921us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:15.800917 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.801143 (+   226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.329973 (+528830us) raft_consensus.cc:1685] finished
0709 13:06:16.329994 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.330144 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200043,"raft.queue_time_us":223648,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6880,"thread_start_us":272922,"threads_started":1,"wal-append.queue_time_us":902797}
I20260709 13:06:16.345644 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.346372 15588 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:16.348918 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.350591 19728 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:16.351063 19634 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.351649 19634 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.354575 19634 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:16.356309 19718 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:16.357004 15586 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:16.359754 19696 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:16.362530 15589 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:16.346959 19467 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:16.369907 16182 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:16.208638 19550 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.379515 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:16.380820 15592 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.400247 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:16.402927 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:16.403832 15513 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:16.402927 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:16.328455 19638 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:06:16.419678 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:16.423928 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.424381 19692 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.424002 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:16.425107 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:16.433080 15437 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:16.433390 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.435518 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.439095 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:16.439677 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:16.388077 19695 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.442267 15435 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:16.446370 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.446460 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.458323 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.404543 19631 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.461053 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:16.461396 15592 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:16.405313 19676 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.465642 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:16.469385 15435 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.476418 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.478297 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:16.480713 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:16.431371 19518 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.482451 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.487474 15438 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:16.485675 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:16.489295 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:16.490516 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:16.454231 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:16.457973 19489 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:16.453860 19593 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:16.494604 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.459277 19695 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.448968 19692 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.494695 15437 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:16.505820 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.568120 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.577917 19685 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.540374 19648 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:16.476423 19631 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.637434 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.574551 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 437) took 1197 ms. Trace:
I20260709 13:06:16.638165 16177 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.638069 15442 rpcz_store.cc:276] 0709 13:06:15.377219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.380473 (+  3254us) service_pool.cc:224] Handling call
0709 13:06:15.380796 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.627852 (+247056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.574189 (+946337us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54001793d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:16.574443 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566004992}
W20260709 13:06:16.541682 19138 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.007s
I20260709 13:06:16.467941 19717 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:16.597908 15439 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:16.658200 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:16.533635 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:16.509935 15589 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:16.528586 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:16.498595 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:16.524058 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.492059 19257 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:16.572845 19672 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:16.523499 19718 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:06:16.669727 15512 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:16.668480 15510 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.637297 19648 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.642069 19306 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.671191 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2551) took 1376 ms. Trace:
I20260709 13:06:16.493901 19589 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:16.688357 16177 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:16.494632 19498 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:16.483489 19676 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.643636 19593 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:16.688825 15556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.016s	sys 0.006s
I20260709 13:06:16.659802 19717 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:16.476727 19684 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.696064 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:16.701304 15589 rpcz_store.cc:276] 0709 13:06:15.294401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.296765 (+  2364us) service_pool.cc:224] Handling call
0709 13:06:15.297129 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.986712 (+689583us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54001a52a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd591c0 00007fcf7bd5a231 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c
0709 13:06:16.254671 (+267959us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b4c0024c000. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a023a20 00007fcf7a034a29 00007fcf79ffa644 00007fcf7a021f2d 00007fcf7a021b93 00007fcf7bd5218b 00007fcf7bd52cb5 00007fcf7bd4df30 00007fcf7bd4f7de 00007fcf7bd59b49 00007fcf7bd5a416
0709 13:06:16.670915 (+416244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.671131 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540989056}
I20260709 13:06:16.628924 19259 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.667920 19539 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:16.694134 19637 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:06:16.701447 19550 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.672076 19257 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:06:16.707654 15556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.016s	sys 0.007s
W20260709 13:06:16.758551 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 759045us
I20260709 13:06:16.708901 19593 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:16.694023 19490 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:16.713047 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.703212 19735 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:06:16.780823 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.668304 19264 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:06:16.662388 19138 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.700265 19648 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.589495 19185 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:06:16.739341 15510 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:16.703269 19498 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.494230 19518 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.761318 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.761588 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.710168 19598 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.711200 19717 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:16.709656 19589 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:16.767019 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:16.746835 19362 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:16.794526 15436 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:16.791874 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:16.699294 19672 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.762727 19257 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:16.779556 19490 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.751981 19539 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.825098 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.801580 19731 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.810778 19498 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:16.844830 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.847528 19731 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.823945 19658 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.827455 19362 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.856943 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.867419 15437 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:16.832509 19467 raft_consensus.cc:2764] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:16.853123 15435 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:16.844065 19490 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:16.827061 19588 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:06:16.891024 19589 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:16.883200 19738 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:06:16.884797 19676 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.889169 19672 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.890352 19138 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.895699 19746 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.896452 19746 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.899112 19746 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.899356 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.901322 19684 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.926703 15586 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:16.927402 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.927874 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.858505 19692 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.856012 19731 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.872618 19362 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:16.864620 19379 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.959904 19379 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.960490 19518 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.871712 19658 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:16.962865 19379 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.965312 19259 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.963330 19658 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:16.971798 19740 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.156s	user 0.002s	sys 0.006s
I20260709 13:06:16.974188 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:16.975040 15586 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:16.977159 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.978426 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:16.978925 19688 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.073s	user 0.016s	sys 0.000s
I20260709 13:06:16.979390 19688 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.981890 19688 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.982191 19467 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:16.982571 19688 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:06:16.931879 19734 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:06:16.948788 19684 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:16.958338 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2565) took 1630 ms. Trace:
I20260709 13:06:16.977360 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:16.989073 15438 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.928263 15442 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:16.985297 15587 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:16.990435 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:16.988727 15591 rpcz_store.cc:276] 0709 13:06:15.327720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.480826 (+153106us) service_pool.cc:224] Handling call
0709 13:06:15.481511 (+   685us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:15.877237 (+395726us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:15.985921 (+108684us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.407365 (+421444us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:16.440507 (+ 33142us) log.cc:844] Serialized 52 byte log entry
0709 13:06:16.441472 (+   965us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:16.441533 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.957840 (+516307us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54001f5c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:16.957910 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.957969 (+    59us) raft_consensus.cc:1685] finished
0709 13:06:16.958088 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.958263 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129195,"prepare.queue_time_us":67808,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":7672,"raft.queue_time_us":406982,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":16830,"spinlock_wait_cycles":496077056,"thread_start_us":566841,"threads_started":4,"wal-append.queue_time_us":296603}
I20260709 13:06:16.903339 19498 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.991773 19684 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:16.993496 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:16.993867 19498 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:16.994207 19684 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:16.994571 19467 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:16.949972 19736 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.250s	user 0.004s	sys 0.004s
I20260709 13:06:16.936712 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:16.933310 19741 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.123s	user 0.007s	sys 0.001s
W20260709 13:06:16.934511 19733 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.240s	user 0.001s	sys 0.003s
I20260709 13:06:17.007504 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:17.010216 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:17.012398 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 75828.1us
I20260709 13:06:16.988389 19731 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:17.023578 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:16.988631 19550 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:17.028119 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 268242us
I20260709 13:06:17.031874 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:16.995079 19467 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.023065 19747 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:17.025489 19684 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:17.054126 19498 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:17.051271 19668 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:17.178421 19668 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:17.179044 19668 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:17.179451 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2559) took 1870 ms. Trace:
I20260709 13:06:17.179919 15585 rpcz_store.cc:276] 0709 13:06:15.308547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.389752 (+ 81205us) service_pool.cc:224] Handling call
0709 13:06:15.415326 (+ 25574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.787214 (+371888us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:15.884184 (+ 96970us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.072343 (+188159us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.122715 (+ 50372us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.127491 (+  4776us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:16.127825 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.439872 (+312047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.179009 (+739137us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54001dced4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:17.179065 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.179203 (+   138us) raft_consensus.cc:1685] finished
0709 13:06:17.179221 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.179383 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163564,"prepare.queue_time_us":100309,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":5866,"raft.queue_time_us":424445,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":48581,"spinlock_wait_cycles":539320576,"thread_start_us":405597,"threads_started":2,"wal-append.queue_time_us":436728}
I20260709 13:06:17.183583 15588 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
W20260709 13:06:17.185490 19744 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:06:17.051666 19467 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:17.060796 19747 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:17.192996 19747 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:17.202903 19704 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.025s	user 0.000s	sys 0.003s
I20260709 13:06:17.059943 19686 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:17.130955 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.169138 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:17.054436 19550 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:17.214707 19498 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:17.214879 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.215415 19498 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:17.216403 19550 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:17.217819 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.219142 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:17.220589 15589 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 7.
I20260709 13:06:17.175406 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:17.176524 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:17.222694 15510 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:17.221062 15592 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:17.224756 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.225535 15589 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:17.225380 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:17.055409 19731 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:17.235968 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2684) took 1016 ms. Trace:
W20260709 13:06:17.127038 19741 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:17.238597 15592 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:17.126602 19688 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:17.274151 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:17.172031 16173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 601) took 1280 ms. Trace:
I20260709 13:06:17.298118 15510 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:17.312552 15589 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:17.245798 15514 rpcz_store.cc:276] 0709 13:06:16.219609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.220157 (+   548us) service_pool.cc:224] Handling call
0709 13:06:16.244104 (+ 23947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.244636 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:16.459878 (+215242us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.761784 (+301906us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.797893 (+ 36109us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.798121 (+   228us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:16.798170 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.798271 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.180962 (+382691us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180034e760. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:17.184830 (+  3868us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:17.235690 (+ 50860us) raft_consensus.cc:1685] finished
0709 13:06:17.235716 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.235886 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":460350,"prepare.run_wall_time_us":13100,"raft.queue_time_us":15672,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":201,"spinlock_wait_cycles":97192448,"thread_start_us":394968,"threads_started":2,"wal-append.queue_time_us":322490}
I20260709 13:06:17.314318 15438 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:17.129522 19684 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.291347 19306 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.321426 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2571) took 1746 ms. Trace:
I20260709 13:06:17.334988 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2127) took 1704 ms. Trace:
W20260709 13:06:17.334863 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 61022us
I20260709 13:06:17.340757 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:17.331787 19648 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.001s
I20260709 13:06:17.315201 19658 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:17.348809 19676 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:17.350703 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:17.330799 15590 rpcz_store.cc:276] 0709 13:06:15.574913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.844716 (+269803us) service_pool.cc:224] Handling call
0709 13:06:15.845197 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.448457 (+603260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.448494 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.449033 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.658729 (+209696us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:16.670711 (+ 11982us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.670958 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.193637 (+522679us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54000c1054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:17.193689 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.303639 (+109950us) raft_consensus.cc:1685] finished
0709 13:06:17.321175 (+ 17536us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.321349 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13654,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":160880,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":605224960,"thread_start_us":564669,"threads_started":2,"wal-append.queue_time_us":307250}
I20260709 13:06:17.327912 19539 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:17.297948 19688 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.335932 15440 rpcz_store.cc:276] 0709 13:06:15.630964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.631088 (+   124us) service_pool.cc:224] Handling call
0709 13:06:15.652368 (+ 21280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.654214 (+  1846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.654260 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.689758 (+ 35498us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.800615 (+110857us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:15.800739 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.800944 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.202159 (+1401215us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:17.334593 (+132434us) raft_consensus.cc:1685] finished
0709 13:06:17.334623 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.334916 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5111,"raft.queue_time_us":32331,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6240,"spinlock_wait_cycles":66056448,"thread_start_us":76834,"threads_started":1,"wal-append.queue_time_us":468118}
I20260709 13:06:17.362200 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:17.314647 19668 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:17.346318 19686 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:17.375932 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.377305 15440 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:17.366299 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.379351 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.380599 15438 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:17.385594 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:17.363447 19379 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:17.339004 19306 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:17.367314 19257 consensus_meta.cc:287] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.514s	user 0.013s	sys 0.000s
I20260709 13:06:17.403327 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.384086 19539 raft_consensus.cc:2764] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:06:17.414747 19767 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:06:17.415321 19731 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:17.415825 19763 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:06:17.357343 19648 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:17.416491 19743 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.550s	user 0.003s	sys 0.000s
I20260709 13:06:17.418309 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 792) took 1016 ms. Trace:
I20260709 13:06:17.418862 19648 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:17.410468 19676 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:17.420715 19676 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:17.421129 19676 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.423877 16180 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:17.301378 16173 rpcz_store.cc:276] 0709 13:06:15.887852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.891337 (+  3485us) service_pool.cc:224] Handling call
0709 13:06:15.974932 (+ 83595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.030722 (+ 55790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.043822 (+ 13100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.163090 (+119268us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.676048 (+512958us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:16.694161 (+ 18113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.699778 (+  5617us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.125361 (+425583us) raft_consensus.cc:1685] finished
0709 13:06:17.125421 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.167966 (+ 42545us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1996,"raft.queue_time_us":11958,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":21136,"thread_start_us":411396,"threads_started":1,"wal-append.queue_time_us":408298}
I20260709 13:06:17.425556 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2581) took 1101 ms. Trace:
I20260709 13:06:17.425868 19306 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:17.384972 19686 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:17.414791 19766 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:06:17.429081 19688 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:17.426105 15586 rpcz_store.cc:276] 0709 13:06:16.324638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.975842 (+651204us) service_pool.cc:224] Handling call
0709 13:06:16.976220 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.977127 (+   907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.977158 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.977684 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.169669 (+191985us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:17.169722 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.169801 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.425177 (+255376us) raft_consensus.cc:1685] finished
0709 13:06:17.425201 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.425485 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":241,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":113,"thread_start_us":191503,"threads_started":1,"wal-append.queue_time_us":389243}
I20260709 13:06:17.433185 19467 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.428691 19686 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:17.406658 19257 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.436797 15441 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:17.412946 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:17.420107 19764 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:06:17.418756 15511 rpcz_store.cc:276] 0709 13:06:16.402079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.406160 (+  4081us) service_pool.cc:224] Handling call
0709 13:06:16.406539 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.428996 (+ 22457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.429034 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.452391 (+ 23357us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.700309 (+247918us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:16.700375 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.700481 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.374230 (+673749us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:17.417924 (+ 43694us) raft_consensus.cc:1685] finished
0709 13:06:17.417951 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.418232 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22213,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":14327,"spinlock_wait_cycles":55910144,"thread_start_us":194230,"threads_started":1,"wal-append.queue_time_us":341175}
W20260709 13:06:17.466888 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 121937us
I20260709 13:06:17.442874 19642 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:17.471035 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:17.492868 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 107381us
I20260709 13:06:17.466729 19467 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:17.494067 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:17.462906 19747 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:17.523053 19777 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:17.524145 19777 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:17.525581 19777 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.528281 19668 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:17.529037 19257 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:17.506048 19518 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:17.530022 19518 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:17.531068 19518 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.534150 19684 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:17.524159 19747 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:17.538600 19490 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
I20260709 13:06:17.539091 19490 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.540252 15439 raft_consensus.cc:2368] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:06:17.542829 19490 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:17.543713 19362 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.000s
I20260709 13:06:17.544644 19362 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.547053 19362 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:17.510186 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:17.552917 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:17.553589 15516 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:17.559517 19306 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:17.561652 19758 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:17.562062 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2706) took 1016 ms. Trace:
I20260709 13:06:17.562163 19758 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:17.562613 19758 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:17.564532 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:17.569347 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:17.570459 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52910 (request call id 453) took 1167 ms. Trace:
I20260709 13:06:17.575768 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.578401 15510 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:17.580082 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:17.581043 15518 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:17.582038 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.585824 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.589500 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.592722 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.593103 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.593489 15511 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:17.600242 15518 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:17.600471 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.602524 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.571095 16177 rpcz_store.cc:276] 0709 13:06:16.400411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.402639 (+  2228us) service_pool.cc:224] Handling call
0709 13:06:17.567799 (+1165160us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54007201d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:17.567932 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533949824}
I20260709 13:06:17.603984 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.562487 15513 rpcz_store.cc:276] 0709 13:06:16.546091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.672403 (+126312us) service_pool.cc:224] Handling call
0709 13:06:16.687394 (+ 14991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.831079 (+143685us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:16.866479 (+ 35400us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.023893 (+157414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.023960 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:17.024023 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.561803 (+537780us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400213c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:17.561860 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.561999 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17012,"prepare.queue_time_us":45045,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":14588,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":9610,"spinlock_wait_cycles":329858816,"thread_start_us":143091,"threads_started":1,"wal-append.queue_time_us":378175}
I20260709 13:06:17.638202 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.638125 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.639967 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.619843 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.623186 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.565181 19379 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:17.643803 15512 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:17.649135 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.649901 15511 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:06:17.656680 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.658536 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.663964 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.665411 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.650538 15513 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:17.666704 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.671314 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.676805 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.679369 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.680761 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2590) took 1340 ms. Trace:
I20260709 13:06:17.681211 15591 rpcz_store.cc:276] 0709 13:06:16.340580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.281733 (+941153us) service_pool.cc:224] Handling call
0709 13:06:17.314551 (+ 32818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.342297 (+ 27746us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:17.466338 (+124041us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.635292 (+168954us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.656097 (+ 20805us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.656316 (+   219us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:17.656376 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.656495 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.680525 (+ 24030us) raft_consensus.cc:1685] finished
0709 13:06:17.680553 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.680693 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20682,"prepare.queue_time_us":165222,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":41095,"raft.queue_time_us":20256,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":11356,"thread_start_us":240377,"threads_started":2,"wal-append.queue_time_us":185829}
I20260709 13:06:17.633527 19676 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.698139 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.698843 15592 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:17.698735 15590 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:17.700654 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.712034 15590 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:17.718542 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.721046 15590 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:06:17.702729 19306 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:17.732962 19717 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.902s	user 0.006s	sys 0.009s
I20260709 13:06:17.730032 19306 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:17.736406 19306 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:17.737193 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.744683 19717 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.744328 15592 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:17.750303 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.752600 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.753012 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.758461 15516 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:16.601033 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:17.759888 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:17.760555 15437 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:17.763909 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.764556 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2594) took 1304 ms. Trace:
W20260709 13:06:17.765606 19498 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.000s
I20260709 13:06:17.766076 19498 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.768411 19498 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:17.774856 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:17.775437 19676 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:17.776377 19684 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.776703 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:17.776939 19684 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.778070 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:17.732401 19379 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.764940 15585 rpcz_store.cc:276] 0709 13:06:16.460246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.239875 (+779629us) service_pool.cc:224] Handling call
0709 13:06:17.297776 (+ 57901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.342381 (+ 44605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.342412 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.342461 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:17.342503 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.764278 (+421775us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b5400114754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:17.764331 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.764492 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102001408}
W20260709 13:06:17.781209 15583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2576) took 1885 ms (client timeout 2119 ms). Trace:
I20260709 13:06:17.783520 15437 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:17.777419 15590 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:17.784693 15443 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:17.797768 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:17.798604 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.789216 15592 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:17.786607 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 578687us
W20260709 13:06:17.796656 15583 rpcz_store.cc:269] 0709 13:06:15.895466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.234382 (+338916us) service_pool.cc:224] Handling call
0709 13:06:17.780944 (+1546562us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b54001dd3d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:17.781096 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223849728}
I20260709 13:06:17.802223 15513 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:17.807667 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.807966 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.809355 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.809988 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.811479 15556 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:17.812597 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:17.814467 15583 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:17.816675 19773 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.817642 19717 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:17.786051 19762 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.641s	user 0.000s	sys 0.002s
I20260709 13:06:17.819506 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:17.780143 19593 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.992s	user 0.014s	sys 0.000s
I20260709 13:06:17.825709 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.839826 19731 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.840991 15556 leader_election.cc:400] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:06:17.841420 15556 leader_election.cc:403] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:17.842056 19731 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:17.843151 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:17.844208 19550 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:17.841023 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:17.854416 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.859078 19306 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:17.852772 15592 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:17.859911 19306 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:17.862990 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:17.872851 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.779472 19684 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:17.874343 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:17.875917 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 430206us
I20260709 13:06:17.875981 15438 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:17.879189 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.882236 19798 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:17.885376 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.783740 19687 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:17.820137 19686 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.902850 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.904212 15440 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:17.890955 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.819885 19685 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:17.889088 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.837512 19688 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:17.904361 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.887043 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.813282 19667 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:06:17.908473 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.877135 19550 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:17.910300 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:17.820408 19467 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:06:17.884441 19731 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:06:17.927560 19685 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:17.927712 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.928033 19686 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:17.928472 19686 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:17.929128 19685 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:17.910247 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:17.918633 16175 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:17.929448 19686 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:17.922619 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:17.930657 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.931643 19684 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:17.932140 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.933022 19684 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.933499 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.936123 19684 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.937291 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.938170 19684 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.938629 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.939407 19684 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:17.939904 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.940747 19684 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.941190 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.942261 19684 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:17.943251 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:17.945607 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:17.862725 19593 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:17.959534 15590 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
W20260709 13:06:18.043308 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 95241.2us
I20260709 13:06:17.909225 19306 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:18.042973 19684 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:17.913622 19615 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.076280 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 1980) took 1589 ms. Trace:
I20260709 13:06:18.076828 15441 rpcz_store.cc:276] 0709 13:06:16.486575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.486698 (+   123us) service_pool.cc:224] Handling call
0709 13:06:16.487051 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.437239 (+950188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.075955 (+638716us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54002247d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:18.076186 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183734656}
I20260709 13:06:18.078783 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 1961) took 2135 ms. Trace:
I20260709 13:06:18.087918 15442 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:18.088153 19670 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.089184 19593 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:18.089949 19615 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:18.090750 19793 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:06:18.092646 19615 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:18.053942 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 105627us
I20260709 13:06:18.079427 15587 rpcz_store.cc:276] 0709 13:06:15.943134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.295575 (+352441us) service_pool.cc:224] Handling call
0709 13:06:16.295907 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.990603 (+694696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.078402 (+1087799us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540028b4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:18.078687 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584942464}
I20260709 13:06:17.916738 19688 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:17.916335 19630 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:18.109480 15588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 2588) took 1767 ms (client timeout 1636 ms). Trace:
I20260709 13:06:18.116513 19550 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.045765 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:18.088675 19670 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.103636 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:18.100481 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:18.151616 19758 consensus_meta.cc:287] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.005s
I20260709 13:06:18.211836 19758 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.213402 15515 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
W20260709 13:06:18.149950 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 315832us
I20260709 13:06:18.212440 19669 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:18.218600 15588 rpcz_store.cc:269] 0709 13:06:16.339954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.347295 (+  7341us) service_pool.cc:224] Handling call
0709 13:06:18.106974 (+1759679us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54001f5254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:18.107130 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908322688}
I20260709 13:06:18.221711 19669 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:18.230026 19630 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.230729 19676 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:18.230634 19669 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.231657 19676 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.232803 19630 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:18.234459 19676 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:18.209973 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 106431us
W20260709 13:06:18.226202 19760 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.053s	user 0.005s	sys 0.000s
I20260709 13:06:18.228297 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:18.238482 19676 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:18.239506 19658 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:18.239919 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.240463 19658 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.227727 19306 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:18.244114 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:18.244326 19306 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.245656 19798 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:18.257756 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.262789 19757 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.381s	user 0.000s	sys 0.013s
I20260709 13:06:18.258960 19658 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:18.328536 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.370882 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 98206.9us
I20260709 13:06:18.389904 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:18.273344 19695 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:18.388878 19676 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:18.386674 19658 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:18.418395 15441 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:18.406915 19490 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:06:18.406379 19334 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:18.406726 19777 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.400650 19372 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:18.391172 19306 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:18.408957 19757 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:06:18.476636 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 236865us
I20260709 13:06:18.477663 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.479358 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.470045 19334 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:18.484019 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:18.406550 19671 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:06:18.501924 19806 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.486271 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2597) took 1277 ms. Trace:
W20260709 13:06:18.503645 15555 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.606s (SENT)
I20260709 13:06:18.504664 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:18.485498 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.488314 19379 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.445022 19670 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:18.506574 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.504223 15591 rpcz_store.cc:276] 0709 13:06:17.208696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.682932 (+474236us) service_pool.cc:224] Handling call
0709 13:06:17.703464 (+ 20532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.703731 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:17.722603 (+ 18872us) log.cc:844] Serialized 14 byte log entry
0709 13:06:18.266551 (+543948us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b18001dfc20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a 00007fcf7bd61a2a
0709 13:06:18.480354 (+213803us) log.cc:844] Serialized 14 byte log entry
0709 13:06:18.485669 (+  5315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:18.485761 (+    92us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:18.485865 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.485981 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.486189 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4751,"prepare.queue_time_us":23843,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2278,"raft.queue_time_us":5090,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":13624,"spinlock_wait_cycles":5677952,"thread_start_us":213174,"threads_started":1,"wal-append.queue_time_us":743286}
I20260709 13:06:18.402272 19688 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.484244 19334 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.485368 19306 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.513985 15434 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:18.510852 19598 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:18.514499 19379 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.474653 19372 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.516546 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2136) took 1751 ms. Trace:
I20260709 13:06:18.521845 15434 rpcz_store.cc:276] 0709 13:06:16.765299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.765451 (+   152us) service_pool.cc:224] Handling call
0709 13:06:16.797130 (+ 31679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.513856 (+1716726us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b54001d7a20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd591c0 00007fcf7bd5a231 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c
0709 13:06:18.516157 (+  2301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.516462 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21142400}
I20260709 13:06:18.469689 19777 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.510675 19758 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:18.520326 19467 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.520517 19806 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.540812 19670 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.546599 19670 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.551111 19777 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:18.539975 19467 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:18.562601 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 56110.9us
I20260709 13:06:18.563737 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:18.567303 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.566299 19806 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.581008 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.569914 19758 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:18.524312 19676 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.595431 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:18.597496 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:18.597894 15441 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:18.598065 15588 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:18.600111 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 2733) took 1048 ms. Trace:
I20260709 13:06:18.600023 16180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 454) took 1833 ms. Trace:
I20260709 13:06:18.600188 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:18.600878 16180 rpcz_store.cc:276] 0709 13:06:16.766922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.767233 (+   311us) service_pool.cc:224] Handling call
0709 13:06:16.767749 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.424404 (+656655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.599771 (+1175367us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b5400a30f54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:18.599959 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508347136}
I20260709 13:06:18.601765 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:18.602967 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:18.600726 15517 rpcz_store.cc:276] 0709 13:06:17.552058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.555028 (+  2970us) service_pool.cc:224] Handling call
0709 13:06:18.599919 (+1044891us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400203ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:18.600042 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605730176}
I20260709 13:06:18.603646 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:18.603681 15436 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:18.605988 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:18.606295 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:18.605669 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:18.613219 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:18.614625 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:18.615767 15434 raft_consensus.cc:2368] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11.
I20260709 13:06:18.617048 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:18.619418 15439 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:18.574774 19658 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:18.587622 19631 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:18.623090 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:18.623886 15511 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:18.593078 19807 consensus_queue.cc:1059] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:06:18.625419 19807 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:06:18.644311 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.604182 19758 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:18.663138 15511 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:18.641741 19807 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:18.665225 19807 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.642202 19798 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.668921 19798 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.674474 19810 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.675278 19810 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.677721 19810 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:18.644083 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:18.695951 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.696790 15517 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:18.625656 19703 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:06:18.610100 19379 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:06:18.698237 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:18.700223 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.700762 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.702162 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.704051 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.705103 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:18.705449 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.705569 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:18.707206 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:18.708637 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.709905 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.710260 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.715368 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.716293 15517 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:18.720052 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.723330 19798 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:18.725803 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:18.728967 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.736371 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.737323 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:18.737639 15510 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:06:18.740154 15509 raft_consensus.cc:2368] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:06:18.714497 19746 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:18.755600 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.757905 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.759066 15517 raft_consensus.cc:2410] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:06:18.766044 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.773739 15509 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:06:18.780092 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:18.782297 19518 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:18.767344 19810 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:18.799975 19703 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.800921 19703 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.805222 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:18.806245 15590 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
W20260709 13:06:18.810092 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.755924 19758 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.813094 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:18.814553 19667 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:18.815012 19667 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.815374 19667 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:18.817749 19703 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:18.789582 19815 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:18.820067 19815 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.820528 19815 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.820605 19306 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:18.821324 19306 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:18.822644 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.829281 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:18.830998 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 51032.5us
I20260709 13:06:18.833845 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:18.832294 15407 connection.cc:256] RPC call timeout handler was delayed by -1.0362614189999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:06:18.836408 15407 connection.cc:256] RPC call timeout handler was delayed by -1.0279604739999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260709 13:06:18.836544 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.834808 15588 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:18.840497 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:18.841298 16179 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:18.842741 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:18.849025 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:18.853291 15512 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:06:18.841706 19686 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:18.843747 19810 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:18.850560 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 137455us
I20260709 13:06:18.859197 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:18.822640 19306 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.840619 19518 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:06:18.868371 16179 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:18.867882 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.877781 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:18.863135 19687 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:18.884331 19518 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:18.884155 19687 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.884792 19518 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:18.885507 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:18.885687 19518 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.886796 19687 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:18.888227 19306 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.889510 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:18.895887 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:18.887300 19518 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.864234 16173 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:18.904121 19818 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:18.898072 19676 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.906456 19676 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:18.906987 19676 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:18.899792 19758 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.908051 19676 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.898542 19702 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:06:18.901208 19379 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:18.862879 19362 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:18.878057 19688 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.893958 19810 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:18.929979 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:18.916234 19379 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:18.936996 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:18.945077 19379 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:18.928479 19688 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.944972 19334 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:18.947515 19490 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:18.952164 19490 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:18.952903 19667 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.948858 19264 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.954149 19815 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.927290 19810 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:18.949425 19334 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.955785 19810 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:18.956240 19334 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:18.956913 19810 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.957533 19379 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.958117 19810 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.949740 19688 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:18.959992 19379 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:18.954957 19264 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:18.953205 19490 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.965312 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:18.956074 19670 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:18.918555 19362 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.974562 19264 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:18.946063 19372 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:18.975765 19362 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:18.976437 15511 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:18.977732 19815 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:18.955376 19667 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:18.999107 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59921.4us
W20260709 13:06:19.004762 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 107317us
I20260709 13:06:18.996855 19688 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:06:19.006521 19688 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:19.007196 19688 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:19.008565 19688 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:19.010277 19688 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:19.014582 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:19.015025 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.030354 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:19.018402 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:19.020012 15587 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:06:19.024744 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:19.027257 19467 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:19.017968 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:19.073398 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 58462.5us
I20260709 13:06:19.038802 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 613) took 1120 ms. Trace:
I20260709 13:06:19.075081 16177 rpcz_store.cc:276] 0709 13:06:17.918359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.921038 (+  2679us) service_pool.cc:224] Handling call
0709 13:06:17.921396 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.233652 (+312256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.233684 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:18.233730 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:18.233771 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.038448 (+804677us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400540bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:19.038511 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.038711 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717602176}
I20260709 13:06:19.077234 15588 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:19.073742 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:19.085237 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.086056 19806 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.086767 19806 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:18.972594 19550 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
W20260709 13:06:19.089092 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 51403.7us
I20260709 13:06:19.095909 15516 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:19.098340 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.103721 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.110895 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.111662 15516 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:19.088745 19810 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.097043 19191 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:19.130759 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:19.097839 19306 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.109776 19818 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:19.137253 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.112308 19827 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.117412 19379 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:19.147971 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:19.166435 15437 raft_consensus.cc:606] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.167012 15437 raft_consensus.cc:614] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:19.168393 15517 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:19.028216 19334 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.142879 19576 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:19.122799 19777 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:06:19.148331 19518 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.151064 19810 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.194845 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.136176 19717 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:06:19.197521 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:19.197932 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 87163.8us
I20260709 13:06:19.200366 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.203855 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.147874 19692 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:06:19.187515 19576 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.193255 19671 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:19.209213 15437 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:06:19.209941 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66135.4us
I20260709 13:06:19.193256 19777 consensus_queue.cc:1243] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:19.212392 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.213392 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:19.188380 19828 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:06:19.220033 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:19.214159 15590 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:19.196684 19822 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.204986 15588 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:19.216605 16175 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:19.217327 18966 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.217218 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:19.225376 15589 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:19.218362 19576 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:19.210461 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 73387.8us
I20260709 13:06:19.223694 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.228713 19798 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:19.229363 19798 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.229748 19798 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.235984 19467 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.208591 19687 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.219267 19671 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.246217 19823 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.246567 19671 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.247372 19823 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:19.267825 19576 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:19.236096 19822 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:19.273049 19822 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:19.273989 19334 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:19.276769 19703 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:19.237414 19191 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.277348 19703 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:19.278183 19191 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.246233 19828 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:19.284458 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:19.285180 15588 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:19.286252 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.278267 19703 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:19.287918 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50910.3us
I20260709 13:06:19.289143 15590 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:06:19.295957 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 72395.5us
I20260709 13:06:19.296967 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.294963 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:19.302042 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:19.303181 15584 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:19.283453 19828 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.256287 19687 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:19.303265 15588 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:19.246663 19829 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:06:19.292177 18966 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:06:19.302387 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:19.311208 15590 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:19.320896 15591 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:19.304769 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.289968 19701 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:06:19.301489 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.305835 19658 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:19.342204 15591 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:19.342358 19658 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.344655 19658 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:19.314321 19687 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:19.346037 15439 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:06:19.310395 19830 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:19.324174 18966 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:19.312099 19828 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.304971 19686 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.347282 18966 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.348517 19823 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.348414 18966 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.349092 19823 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.350695 18966 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.323563 19372 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.354017 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.354787 19372 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:19.354278 15439 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:19.326836 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:19.358327 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.359166 19829 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:19.359632 19829 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.359967 19829 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:19.360108 19264 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:19.360548 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.361048 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.327466 19835 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:19.328055 19676 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.328749 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.333002 19692 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:19.333995 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:19.336192 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.369910 19806 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:19.371048 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:19.338533 15512 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:06:19.340243 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.351390 19823 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:19.371352 19807 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.371959 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:19.373854 16146 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.571s (SENT) [suppressed 17 similar messages]
I20260709 13:06:19.337110 19798 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.376864 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.377287 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:19.381263 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79879.5us
W20260709 13:06:19.388648 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.420221 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:19.423799 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 45656.1us
I20260709 13:06:19.398000 19834 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:06:19.396924 19185 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:19.385892 19467 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:06:19.439986 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 66166.4us
W20260709 13:06:19.446651 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 68231.6us
I20260709 13:06:19.448097 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:19.448830 15442 raft_consensus.cc:606] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.449296 15442 raft_consensus.cc:614] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:19.457724 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:19.458168 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:19.460038 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.418092 19334 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:06:19.443502 19836 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:19.473483 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:19.450747 19806 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:19.474992 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.455067 15337 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 5 to 6, term changed from 5 to 8, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to <none>, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:19.469260 19631 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:19.480618 19185 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.480894 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:19.465653 19824 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.481778 19185 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:19.482508 19824 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:19.485765 19334 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:19.486315 19334 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.455477 19686 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:19.486649 15337 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:19.492636 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.505136 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:19.506629 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 57658.9us
I20260709 13:06:19.452857 19658 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:19.517697 15482 leader_election.cc:400] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11.
I20260709 13:06:19.471024 19836 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.519748 15337 catalog_manager.cc:5697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:19.516597 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.529996 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:19.468998 19630 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:06:19.535310 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.539809 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:19.541044 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:19.541216 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.510757 19518 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:19.546536 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:19.537261 15434 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:19.538815 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:19.538792 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.536607 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.542824 15441 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:19.552290 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:19.543725 15438 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:19.544672 15589 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:19.557026 15515 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:19.557678 15515 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:19.558755 15515 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.522727 19467 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.561936 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:19.487255 19334 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:19.564859 15515 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:19.567793 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.570184 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.571382 15440 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:19.573909 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:19.576658 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:19.536902 19686 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:19.518105 19191 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:06:19.537739 19823 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.607710 15439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:19.608753 15439 raft_consensus.cc:606] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.539129 19631 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:19.586489 15590 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:19.579064 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:19.589331 15437 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:19.609272 15439 raft_consensus.cc:614] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:19.573642 19688 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.551s	user 0.018s	sys 0.000s
W20260709 13:06:19.617565 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76435.6us
I20260709 13:06:19.548048 19837 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:19.613101 15337 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 4 to 6, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:19.553779 19838 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:19.539603 19810 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:06:19.574673 19832 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:19.600978 19518 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:19.629722 15337 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 10, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:19.611027 19758 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:19.539940 19815 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:06:19.666553 15337 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 3 to 9, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:19.547688 19306 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:06:19.683594 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.628074 19818 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:19.682013 15337 catalog_manager.cc:5697] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:19.694777 15337 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 8 to 10, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:19.696578 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:19.699534 15516 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:06:19.701673 15516 pending_rounds.cc:85] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 7
I20260709 13:06:19.701947 15516 pending_rounds.cc:107] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:06:19.702251 15516 raft_consensus.cc:2889] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:19.628482 19837 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.683910 15515 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:06:19.606590 19823 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.698812 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:19.712904 15515 pending_rounds.cc:85] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:06:19.664621 19688 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.708140 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:19.681941 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 72603.1us
W20260709 13:06:19.706067 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 82408.9us
I20260709 13:06:19.665895 19518 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.723340 15510 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:19.731861 15555 leader_election.cc:400] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:06:19.734128 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:19.713284 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 178159us
I20260709 13:06:19.737250 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:19.650207 19832 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.713333 15515 pending_rounds.cc:107] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:06:19.738637 19832 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.738700 15515 raft_consensus.cc:2889] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:19.725917 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 105330us
W20260709 13:06:19.738075 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 173526us
I20260709 13:06:19.741142 15588 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:19.741732 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:19.743217 15583 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:19.741187 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:19.744756 15585 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:19.747226 15583 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: [7.8-11.10]
I20260709 13:06:19.749336 15583 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:06:19.753732 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:19.757810 15340 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 212) took 19208 ms (client timeout 15000 ms). Trace:
I20260709 13:06:19.757789 19834 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:06:19.762905 19758 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:19.766116 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.711436 19798 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:19.679261 19467 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:06:19.727905 19372 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:19.777582 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.720820 19837 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.725216 19824 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:19.733044 19518 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.776841 15436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:19.808280 16146 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.719029 19658 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:06:19.835282 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.836848 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:19.758342 15340 rpcz_store.cc:269] 0709 13:06:00.515688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.519705 (+  4017us) service_pool.cc:224] Handling call
0709 13:06:19.723274 (+19203569us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:13.552173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:13.557064 (+  4891us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:13.557128 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:06:13.557160 (+    32us) tablet.cc:662] Decoding operations
0709 13:06:13.668702 (+111542us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:13.668808 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:13.668837 (+    29us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:06:13.721013 (+ 52176us) tablet.cc:701] Row locks acquired
0709 13:06:13.721079 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:06:13.721293 (+   214us) write_op.cc:270] Start()
0709 13:06:13.721480 (+   187us) write_op.cc:276] Timestamp: P: 1783602373721211 usec, L: 0
0709 13:06:13.721523 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:06:13.757726 (+ 36203us) log.cc:844] Serialized 9510 byte log entry
0709 13:06:14.303894 (+546168us) op_driver.cc:464] REPLICATION: finished
0709 13:06:14.834346 (+530452us) write_op.cc:301] APPLY: starting
0709 13:06:14.834476 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:15.241622 (+407146us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5432a 00007fcf7bcd9f14 00007fcf7bcd9ec3 00007fcf7bcd9e38 00007fcf7bcd9df3 00007fcf7bcd90dc 00007fcf7bd02e16 00007fcf7bceacbb 00007fcf7bcd539d 00007fcf7bcd8d75
0709 13:06:15.323445 (+ 81823us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:15.323493 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:16.263201 (+939708us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:16.279776 (+ 16575us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:06:16.279868 (+    92us) write_op.cc:312] APPLY: finished
0709 13:06:16.280593 (+   725us) log.cc:844] Serialized 212 byte log entry
0709 13:06:16.497160 (+216567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:16.547637 (+ 50477us) write_op.cc:454] Released schema lock
0709 13:06:16.547790 (+   153us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:16.564519 (+ 16729us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:16.564570 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4012,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":519938,"apply.run_cpu_time_us":57373,"apply.run_wall_time_us":1724988,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104447,"num_ops":24,"prepare.queue_time_us":87714,"prepare.run_cpu_time_us":46111,"prepare.run_wall_time_us":355537,"raft.queue_time_us":213597,"raft.run_cpu_time_us":70110,"raft.run_wall_time_us":1018809,"replication_time_us":537365,"spinlock_wait_cycles":34172160,"thread_start_us":853870,"threads_started":5,"wal-append.queue_time_us":547907,"wal-append.run_cpu_time_us":29693,"wal-append.run_wall_time_us":2634049}]]}
W20260709 13:06:19.803637 19849 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:06:19.617676 19836 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.842399 19836 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:19.842909 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:19.843642 19362 consensus_queue.cc:1175] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d225833a2cbf4a5995fdbbb1292d1918" responder_term: 12 status { last_received { term: 11 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:19.785482 19853 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.845366 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.845220 19853 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.736033 19676 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:06:19.829975 15436 raft_consensus.cc:606] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.855032 15436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:19.859302 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:19.861092 15436 raft_consensus.cc:606] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:19.864784 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:19.865633 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:19.869136 19853 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:19.877305 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 101497us
I20260709 13:06:19.882714 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.883783 19191 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:19.884881 19191 consensus_queue.cc:1243] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:06:19.886862 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 52094.3us
I20260709 13:06:19.889144 19700 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:19.889621 19700 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:19.870337 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:19.777612 19379 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:06:19.826964 19855 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:19.929395 19306 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.876212 19615 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.892463 19687 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.882426 19838 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:19.874720 19818 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:19.904841 19817 log.cc:927] Time spent T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:06:19.834731 19834 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
W20260709 13:06:19.972293 19841 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.441s	user 0.000s	sys 0.002s
I20260709 13:06:19.890666 19700 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:19.979952 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 134652us
I20260709 13:06:19.926944 19595 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:19.810427 19631 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:20.019995 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 139504us
I20260709 13:06:20.022140 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:20.023514 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 135703us
W20260709 13:06:19.991523 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.016566 19842 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.428s	user 0.002s	sys 0.000s
I20260709 13:06:19.937268 19692 consensus_queue.cc:1059] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:06:19.975870 19860 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:19.982164 19630 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.831526 19758 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:19.986783 19667 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:20.054198 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:19.984378 19306 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:20.041787 19467 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.983250 19861 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:06:20.057718 16175 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:20.040496 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:20.054231 19847 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 13:06:19.986425 19853 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:06:20.071702 19807 consensus_meta.cc:287] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.005s
W20260709 13:06:20.104282 19843 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 13:06:20.017956 19838 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.064818 19595 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:20.055595 19700 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:20.127202 15518 raft_consensus.cc:2410] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:06:20.028987 19867 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:06:20.103237 19798 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.106124 19667 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:20.143890 19855 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.117842 19467 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.048233 19832 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.147857 19882 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:06:20.151046 15435 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.026s	sys 0.045s
I20260709 13:06:20.135753 15587 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:06:20.157188 15435 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.027s	sys 0.045s
I20260709 13:06:20.136766 19818 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.175333 19832 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.128852 19823 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.133567 19861 consensus_queue.cc:1243] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:20.177886 19838 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.138015 19807 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.188583 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 65495.7us
I20260709 13:06:20.199702 19806 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:20.200350 19806 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:20.201445 19806 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:20.182179 19829 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.819s	user 0.013s	sys 0.002s
I20260709 13:06:20.181046 19467 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.183955 19858 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:20.161950 19798 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.162063 19855 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:20.272753 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 365695us
I20260709 13:06:20.275624 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:20.276638 15406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.008s
I20260709 13:06:20.276536 15517 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
W20260709 13:06:20.277032 15406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.006s	sys 0.008s
I20260709 13:06:20.206930 19867 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.281924 19824 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:20.248371 19861 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:20.295212 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:20.296865 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:20.204457 19807 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.265128 19858 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:20.307663 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:20.280859 19185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.030s
I20260709 13:06:20.309729 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:20.318470 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 260143us
I20260709 13:06:20.172659 19882 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:20.326224 15513 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.003s	sys 0.017s
W20260709 13:06:20.326692 15513 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.003s	sys 0.017s
I20260709 13:06:20.329770 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:20.314949 19185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.012s	sys 0.032s
I20260709 13:06:20.338722 19864 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:20.342267 19855 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.348135 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:20.251569 19829 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.371824 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:20.319473 19688 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:20.408839 19818 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.409647 19703 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:20.410228 19758 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.309306 19861 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.444353 15443 raft_consensus.cc:2368] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 13. Current term is 14.
I20260709 13:06:20.419436 19798 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.421340 19882 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.422112 16173 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:06:20.429805 19518 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.003s
I20260709 13:06:20.452214 19518 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.425558 19467 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.457980 19467 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.460110 19306 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:06:20.462610 19829 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:20.445145 19818 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.466830 19818 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.424199 19858 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.339448 19864 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:20.468816 19864 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.470594 19864 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:20.470643 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 2769) took 1340 ms. Trace:
I20260709 13:06:20.300989 19867 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.474009 19867 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.423620 19807 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:20.429111 19837 consensus_meta.cc:287] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
W20260709 13:06:20.466909 19874 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.355s	user 0.003s	sys 0.000s
W20260709 13:06:20.427425 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.478509 15585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.022s	sys 0.055s
W20260709 13:06:20.490530 15585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.022s	sys 0.055s
I20260709 13:06:20.471323 15510 rpcz_store.cc:276] 0709 13:06:19.130240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.130418 (+   178us) service_pool.cc:224] Handling call
0709 13:06:20.470359 (+1339941us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b540036b0d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:20.470549 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348877696}
I20260709 13:06:20.455128 19518 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:20.486974 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.433447 19379 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.497849 19379 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:20.499733 19888 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:20.500859 19379 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.504041 19861 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.504624 19837 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.506345 15583 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:20.488940 19807 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.511018 19807 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.514496 19807 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.477067 19758 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.523059 19758 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.524207 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:20.528190 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:20.534916 15516 raft_consensus.cc:2410] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:06:20.530606 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:20.401115 19886 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.542362 15510 raft_consensus.cc:2393] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:20.566162 19806 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:20.561389 19853 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.568240 19853 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.570600 19853 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:20.546972 19886 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.577375 15511 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
W20260709 13:06:20.581386 15518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2034) took 1879 ms (client timeout 2059 ms). Trace:
W20260709 13:06:20.582126 15518 rpcz_store.cc:269] 0709 13:06:18.702172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.705267 (+  3095us) service_pool.cc:224] Handling call
0709 13:06:20.580986 (+1875719us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400295754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:20.581273 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3267035904}
I20260709 13:06:20.584569 15509 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:06:20.585247 15509 pending_rounds.cc:85] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 6
I20260709 13:06:20.585501 15509 pending_rounds.cc:107] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:06:20.585813 15509 raft_consensus.cc:2889] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:20.594815 19334 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:20.612569 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 104080us
I20260709 13:06:20.562280 19837 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.620301 19858 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:20.620924 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.621634 15586 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:20.626183 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.627141 15592 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:20.628163 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.629413 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.629859 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:20.631170 19467 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.630287 15592 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:20.631347 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.648108 15585 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:20.656075 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.656594 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.657269 15585 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
W20260709 13:06:20.657786 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.658213 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.658794 15585 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:20.652258 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.660302 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:20.665722 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:20.676277 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:20.653911 19828 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.678635 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:20.656396 19806 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.680163 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:20.684453 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:20.664844 19832 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.686257 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:20.682675 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:20.687283 15591 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:20.668272 19467 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:20.679683 19815 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.697160 19306 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:20.697667 19306 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.698218 19306 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:20.697734 19815 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.673049 19758 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.685814 19379 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:20.699994 19886 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.700574 19379 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.701050 19379 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:20.701355 19703 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:20.699988 19758 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.683871 19861 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.706283 19758 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.706763 19861 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.710763 19861 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.710702 19815 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.688319 19870 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.685766 19518 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:20.719794 19467 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.678293 19873 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.691825 19837 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.692459 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:20.678577 19687 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:20.673797 19807 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:06:20.726656 19837 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:20.733453 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 693042us
I20260709 13:06:20.734553 19576 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:20.735060 19489 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.736402 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:20.738286 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45955.4us
I20260709 13:06:20.720346 19867 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:20.723205 19518 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:20.756623 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.751338 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.725888 19467 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:20.764957 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.766588 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.768271 15585 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:20.770581 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.737188 19642 raft_consensus.cc:3055] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:20.690413 19806 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.777326 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.778743 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:20.779175 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:20.779663 15518 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:20.720412 19832 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.748884 19861 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:20.748641 19867 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.786744 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:20.787484 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 453) took 1287 ms. Trace:
W20260709 13:06:20.788231 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.726142 19379 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:06:20.788595 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48753.1us
I20260709 13:06:20.793020 15435 rpcz_store.cc:276] 0709 13:06:19.500115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.500853 (+   738us) service_pool.cc:224] Handling call
0709 13:06:19.501212 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.501429 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:20.157678 (+656249us) log.cc:844] Serialized 14 byte log entry
0709 13:06:20.787113 (+629435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.787174 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:20.787225 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.787292 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.787425 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":532369,"prepare.queue_time_us":140171,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":533982,"thread_start_us":729895,"threads_started":2,"wal-append.queue_time_us":291934}
I20260709 13:06:20.772130 19822 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.792552 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.801751 15437 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:20.764726 19518 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.775327 19642 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:20.806989 19822 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.784922 19864 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:20.763317 19489 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.785351 19687 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.787001 19815 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:20.792481 19861 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.820072 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.822661 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.823802 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:20.819250 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.799326 19867 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:20.728924 19873 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.849186 15438 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:20.849982 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:20.719995 19870 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.865424 19870 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:20.865552 19191 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.866593 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:20.868057 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.855911 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:20.868643 19822 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.870520 19576 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:20.872226 19896 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.370s	user 0.003s	sys 0.003s
I20260709 13:06:20.858019 19362 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:06:20.869278 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.874562 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:20.875684 19902 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:06:20.875888 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.865640 15440 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:06:20.878974 19832 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:20.879052 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.879614 19379 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:06:20.832434 19864 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.881424 19873 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.881974 15434 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:20.882004 19864 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:20.853065 15518 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:20.876428 15586 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:20.884759 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:20.885826 15591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 1999) took 1340 ms (client timeout 1732 ms). Trace:
I20260709 13:06:20.886312 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:20.886245 15591 rpcz_store.cc:269] 0709 13:06:19.545265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.546200 (+   935us) service_pool.cc:224] Handling call
0709 13:06:20.885659 (+1339459us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001f3e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:20.885765 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2621292928}
I20260709 13:06:20.857111 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.877595 19806 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:20.790908 19676 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:20.887876 15585 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:06:20.888304 15435 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:20.866392 19191 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.890035 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.877041 15438 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:20.888950 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:20.848057 19861 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:20.894886 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.900717 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.901391 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:20.905395 15510 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:20.905884 15434 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
W20260709 13:06:20.922572 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.923576 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.926786 15556 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:20.875437 19837 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:20.929888 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.929042 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:20.932217 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.959160 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:20.961880 15556 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:20.852032 19815 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.964821 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.972220 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:20.905453 19703 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:20.977769 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.978156 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 621) took 1276 ms. Trace:
I20260709 13:06:20.978891 16177 rpcz_store.cc:276] 0709 13:06:19.701963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.703643 (+  1680us) service_pool.cc:224] Handling call
0709 13:06:20.735153 (+1031510us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5800004598. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:06:20.735414 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.735721 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:20.921799 (+186078us) log.cc:844] Serialized 14 byte log entry
0709 13:06:20.976528 (+ 54729us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.976616 (+    88us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:20.976702 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.977892 (+  1190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.978076 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":3513600,"thread_start_us":221774,"threads_started":2}
I20260709 13:06:20.849836 19687 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:20.964620 19893 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:20.984952 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:20.957361 19853 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:20.897400 19306 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:20.990764 15434 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:20.967506 19860 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:20.973613 19837 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:21.017287 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:21.022576 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 233194us
W20260709 13:06:20.984772 19904 log.cc:927] Time spent T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 13:06:21.006889 19810 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:21.007339 19490 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.008143 19905 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:06:21.012058 15513 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:20.986276 19798 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:20.988956 19686 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.033704 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.043038 15439 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:21.017907 19860 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:21.041766 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:21.055604 15513 raft_consensus.cc:2410] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:06:20.966594 19642 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.064396 15584 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:21.058883 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.059708 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:21.028537 19676 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:21.027577 19810 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:21.081910 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:21.082719 15513 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:21.043381 19798 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.052809 19334 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:21.058336 19860 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:21.069216 19829 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:21.040813 19490 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.115495 15591 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:21.056680 19686 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.098399 19798 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:21.090440 19701 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:06:21.122679 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:21.123310 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:21.125120 15517 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:21.098912 19334 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:21.073695 19467 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:21.102617 19837 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:21.089969 19834 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:06:21.084056 19676 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.135375 15517 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:06:21.145985 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2625) took 1395 ms. Trace:
I20260709 13:06:21.151859 15517 pending_rounds.cc:85] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 9
I20260709 13:06:21.151582 15583 rpcz_store.cc:276] 0709 13:06:19.750737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.751087 (+   350us) service_pool.cc:224] Handling call
0709 13:06:19.751396 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.506810 (+755414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.145577 (+638767us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54002486d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:21.145885 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735708416}
I20260709 13:06:21.152570 15517 pending_rounds.cc:107] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:06:21.154752 15592 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:21.137821 19489 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.155049 15517 raft_consensus.cc:2889] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:21.153539 19899 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.652s	user 0.006s	sys 0.000s
I20260709 13:06:21.153970 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.154982 19676 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.159173 15511 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:21.159433 15591 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
W20260709 13:06:21.160306 19889 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.672s	user 0.000s	sys 0.007s
I20260709 13:06:21.161666 19490 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.164565 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.165576 15588 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:21.168479 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.169284 15438 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:21.169843 18966 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:21.170630 18966 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:21.173439 18966 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:21.175091 15556 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:21.176159 19688 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:21.135023 19810 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.176690 19688 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.137532 19880 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:21.118072 19829 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:21.139247 19334 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:21.182981 19688 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:21.183946 19686 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.184800 19576 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:21.186548 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:21.186710 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2615) took 1447 ms. Trace:
I20260709 13:06:21.188206 19490 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:21.190084 19834 raft_consensus.cc:993] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:06:21.158020 19191 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:21.209488 15589 rpcz_store.cc:276] 0709 13:06:19.739022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.739174 (+   152us) service_pool.cc:224] Handling call
0709 13:06:19.739585 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:19.775256 (+ 35671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.775289 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:19.817799 (+ 42510us) log.cc:844] Serialized 26 byte log entry
0709 13:06:20.277733 (+459934us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:20.303862 (+ 26129us) log.cc:844] Serialized 14 byte log entry
0709 13:06:20.318225 (+ 14363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.318355 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.155008 (+836653us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:21.186366 (+ 31358us) raft_consensus.cc:1685] finished
0709 13:06:21.186480 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.186638 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146571,"prepare.queue_time_us":25856,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":7220,"raft.queue_time_us":97683,"raft.run_cpu_time_us":523,"raft.run_wall_time_us":56622,"spinlock_wait_cycles":6776704,"thread_start_us":403300,"threads_started":1,"wal-append.queue_time_us":659728}
W20260709 13:06:21.238590 15443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 449) took 1781 ms (client timeout 2146 ms). Trace:
I20260709 13:06:21.157480 19837 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:21.208448 19815 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:21.260447 19913 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:06:21.293922 19837 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:21.263311 19372 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.268698 19834 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:21.294976 19834 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.267719 19490 raft_consensus.cc:1081] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:06:21.295786 19834 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:21.241075 19702 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:06:21.260455 19686 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:21.260761 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 74279.8us
I20260709 13:06:21.298287 19686 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:21.269699 19912 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:21.205572 19810 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:21.269194 19828 consensus_meta.cc:287] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.001s
I20260709 13:06:21.300696 19828 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:21.300915 19686 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.301106 19828 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:21.301739 19859 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.302186 19828 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.302376 19859 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.303277 19828 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:21.273705 19306 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.277844 19688 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.307510 19688 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.182225 19880 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.308379 19880 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.282047 19518 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.311364 15590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:06:21.312379 15514 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:21.312675 15590 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:21.313190 15590 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.241531 15441 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:21.315884 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.247460 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:21.317785 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 70506.7us
I20260709 13:06:21.317987 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.294874 19372 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:21.318874 15584 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:21.320581 19915 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:21.321194 19372 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.262496 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:21.188239 19890 consensus_queue.cc:1059] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:06:21.329557 19850 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:21.330462 19880 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:21.331328 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 68940.5us
I20260709 13:06:21.207790 19687 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:21.315325 19518 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.333384 19798 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.339491 19860 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.354631 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.339804 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:21.342114 15518 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:21.358327 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.345551 19798 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.297655 19829 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:21.352708 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2048) took 1811 ms. Trace:
W20260709 13:06:21.352259 15439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 460) took 1675 ms (client timeout 1571 ms). Trace:
W20260709 13:06:21.360620 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.365813 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 60191.8us
W20260709 13:06:21.347642 15443 rpcz_store.cc:269] 0709 13:06:19.457129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.457304 (+   175us) service_pool.cc:224] Handling call
0709 13:06:21.238188 (+1780884us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54002b1954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:21.238490 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242992896}
I20260709 13:06:21.368790 15509 rpcz_store.cc:276] 0709 13:06:19.541106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.551967 (+ 10861us) service_pool.cc:224] Handling call
0709 13:06:20.583768 (+1031801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.586524 (+  2756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.352447 (+765923us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b5400295750. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:21.352607 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255914752}
I20260709 13:06:21.346906 19880 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.374832 19191 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.375396 19334 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.377038 19890 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:21.378377 19687 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:21.381130 19892 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.877s	user 0.001s	sys 0.009s
I20260709 13:06:21.382676 15584 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:21.206208 19836 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.190s
W20260709 13:06:21.396764 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 204290us
W20260709 13:06:21.421828 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47536.5us
I20260709 13:06:21.350250 19642 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.401575 15590 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.430497 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:21.433302 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:21.404861 16146 leader_election.cc:336] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.571s (SENT)
W20260709 13:06:21.370177 15439 rpcz_store.cc:269] 0709 13:06:19.676906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.678042 (+  1136us) service_pool.cc:224] Handling call
0709 13:06:21.351986 (+1673944us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540026b954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:21.352167 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2983181184}
I20260709 13:06:21.434659 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:21.439531 15517 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 10: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:21.403481 19890 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:21.449234 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.431417 15516 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.449287 15590 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.395864 19191 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.453753 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:21.390223 19834 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:21.458051 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.403226 19861 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.479475 19810 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:21.480607 19810 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.482124 19861 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.461356 19860 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:21.483399 19910 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 13:06:21.484222 15515 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:21.463344 19909 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.341s	user 0.002s	sys 0.001s
I20260709 13:06:21.470338 19890 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.442581 19881 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:21.473248 19334 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.474907 19362 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:06:21.476311 19914 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.352s	user 0.005s	sys 0.000s
I20260709 13:06:21.478235 19834 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.479423 16146 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:21.420122 19687 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.503118 19687 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.504763 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:21.505775 15589 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:21.507375 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:21.508852 15516 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:21.509116 16180 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:21.484725 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:21.511904 15590 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.512449 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:21.513914 16179 raft_consensus.cc:2410] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:06:21.520406 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:21.521293 15592 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:21.499899 19362 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:21.513365 19854 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.526365 15556 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:21.535621 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:21.525557 19867 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.630s	user 0.015s	sys 0.003s
I20260709 13:06:21.541950 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:21.543143 16179 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 10: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:21.546118 15590 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:21.572418 19810 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.556288 19860 raft_consensus.cc:2764] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:21.581084 19191 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.586086 15436 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:06:21.586863 15436 pending_rounds.cc:85] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 9
I20260709 13:06:21.587198 15436 pending_rounds.cc:107] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:06:21.587575 15436 raft_consensus.cc:2889] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:21.557073 19867 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.581774 19362 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.594573 19362 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:21.595913 15512 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:21.600692 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.594724 19867 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.605636 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.611670 15585 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:21.609730 15592 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:21.611593 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:21.591943 19688 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:21.604099 19915 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:21.593591 19859 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.632797 19717 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:21.659713 19931 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:21.662468 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:21.634783 19686 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:21.664404 19859 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:21.664112 19686 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.668807 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:21.672066 19777 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.673282 19931 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.673995 19631 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:21.674871 19631 consensus_queue.cc:1243] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:21.673939 19931 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.675527 19686 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.684031 19798 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:21.686837 19798 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.658806 19915 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.670293 19837 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:21.689261 19798 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.689714 19915 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.689486 19837 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.684119 19490 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:21.637526 19688 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:21.708829 19467 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:21.714237 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:21.746474 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.721750 15407 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:21.720304 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:21.748637 15437 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:21.749135 15437 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:21.717276 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.721817 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:21.750908 16175 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:21.752840 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:21.753289 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:21.753584 15442 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:21.754664 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:21.719209 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.751875 15436 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:21.741276 15590 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:06:21.715065 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:21.704938 19828 consensus_queue.cc:1059] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:21.705660 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.714210 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.758621 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.758955 15585 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:21.736542 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.728287 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:21.745399 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:21.761842 15583 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 10: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:21.746726 15438 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:21.714676 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:21.721047 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:21.730381 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.750265 15437 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.764755 15437 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.765970 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:21.770030 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.773033 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:21.767792 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:21.785159 15591 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:06:21.787938 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 66297.5us
I20260709 13:06:21.791976 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:21.792500 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.794863 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:21.795990 19777 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:21.796761 15587 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:21.803745 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:21.748020 19915 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.805332 19931 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:21.802749 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:21.809783 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:21.813898 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:21.787770 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 83252.5us
I20260709 13:06:21.780597 19798 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:21.818956 15435 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:21.823405 16146 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:21.802579 19837 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:21.825469 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.829138 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.828074 15438 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:21.825996 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.829833 15434 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:21.796841 19777 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:21.817051 15406 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:21.832397 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 458) took 2207 ms. Trace:
I20260709 13:06:21.831470 19865 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:21.832836 15441 rpcz_store.cc:276] 0709 13:06:19.620081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.620327 (+   246us) service_pool.cc:224] Handling call
0709 13:06:21.238451 (+1618124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.315699 (+ 77248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.827035 (+511336us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54002b1950. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:21.827185 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3720397696}
I20260709 13:06:21.833535 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.834357 15584 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:21.818579 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:21.835354 19924 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:21.838610 19688 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:21.817198 19467 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:21.832139 15442 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:21.843295 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:21.844753 19467 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:21.845284 19467 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:21.843773 19865 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:21.848130 19865 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:21.843326 15437 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:21.817485 19810 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:21.864818 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:21.866206 15437 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:21.859949 19867 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:21.873663 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:21.874433 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57510.6us
I20260709 13:06:21.857964 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:21.876448 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:21.872530 19865 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:21.824148 19931 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:21.878739 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:21.889990 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80584.1us
I20260709 13:06:21.813346 19915 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.833602 19837 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:06:21.883129 19833 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:21.873616 19810 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:21.950450 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.882349 19865 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:21.894363 19490 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:21.995880 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 65122.3us
W20260709 13:06:21.996490 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80051.8us
I20260709 13:06:21.887811 19867 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:22.003260 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 179947us
W20260709 13:06:22.028692 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.901032 19688 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:21.833119 19777 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:21.977005 19810 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.975243 19931 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:22.090688 19490 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.094383 19798 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:22.088933 19867 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:22.123001 19688 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.166479 19490 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:22.177188 19867 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.175510 19837 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:22.231357 19362 raft_consensus.cc:3055] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:22.232092 19837 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:22.233629 19837 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.236222 19671 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:22.236866 19671 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:22.238096 19671 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:22.175211 19865 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.212087 19798 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.188254 19688 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:22.171319 19861 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:06:22.166148 19828 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:06:22.216409 19933 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:22.218333 19931 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.221640 19833 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:22.245211 19822 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:22.232115 19362 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:22.248519 19865 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:22.249771 19671 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.304021 19947 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.305370 19947 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.301265 19915 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:22.321930 19947 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:22.356870 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:22.388504 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.389859 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2012) took 1524 ms. Trace:
I20260709 13:06:22.390502 15440 rpcz_store.cc:276] 0709 13:06:20.865514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.880203 (+ 14689us) service_pool.cc:224] Handling call
0709 13:06:20.880700 (+   497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:20.999836 (+119136us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:21.005085 (+  5249us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.330697 (+325612us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b180029aa60. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a 00007fcf7bd61a2a
0709 13:06:21.446263 (+115566us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180029aa60. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a522 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:21.520399 (+ 74136us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:21.531106 (+ 10707us) log.cc:844] Serialized 52 byte log entry
0709 13:06:21.532786 (+  1680us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:21.533099 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.537052 (+  3953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.206521 (+669469us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b180029aa60. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:22.388726 (+182205us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b54003edd54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:22.388846 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.388995 (+   149us) raft_consensus.cc:1685] finished
0709 13:06:22.389032 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.389508 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105772,"prepare.queue_time_us":679160,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":111830,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":25292,"spinlock_wait_cycles":277130496,"thread_start_us":127828,"threads_started":1,"wal-append.queue_time_us":516795}
I20260709 13:06:22.399191 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2064) took 1620 ms. Trace:
I20260709 13:06:22.401922 15515 rpcz_store.cc:276] 0709 13:06:20.778765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.778940 (+   175us) service_pool.cc:224] Handling call
0709 13:06:22.398526 (+1619586us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54002e2f54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:22.398835 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619428224}
W20260709 13:06:22.401099 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.400375 15510 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:22.425621 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:22.427356 16173 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:22.438253 19362 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.457545 15592 pending_rounds.cc:85] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 7
I20260709 13:06:22.458063 15592 pending_rounds.cc:107] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:06:22.458436 15592 raft_consensus.cc:2889] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:22.462793 19550 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:22.466073 19372 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:22.471045 19550 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.488849 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2788) took 1671 ms. Trace:
I20260709 13:06:22.489892 15510 rpcz_store.cc:276] 0709 13:06:20.817453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.909432 (+ 91979us) service_pool.cc:224] Handling call
0709 13:06:22.399088 (+1489656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.404240 (+  5152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.488405 (+ 84165us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54002e2f50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:22.488689 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3424228224}
I20260709 13:06:22.259132 19670 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:22.505064 19670 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:22.509413 19670 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:22.262336 19822 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:22.594494 19362 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.595896 19550 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:22.601778 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.604305 19854 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:22.604857 19956 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.605132 19854 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:22.606102 19956 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.608340 19835 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.609504 19835 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.616215 19692 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.617516 19692 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.620918 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:22.622231 19860 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:22.663120 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.663264 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 586540us
I20260709 13:06:22.664134 19692 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:22.664978 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.000s	sys 0.011s
W20260709 13:06:22.665422 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.000s	sys 0.011s
I20260709 13:06:22.607520 19854 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:22.665782 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 786165us
I20260709 13:06:22.666649 19854 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:22.671772 19861 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:22.672221 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.672793 19861 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.674957 19947 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:22.675513 19947 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:22.678891 19834 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:22.679577 19834 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:22.681102 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 110) took 9245 ms. Trace:
I20260709 13:06:22.681528 19834 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.684083 19822 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:22.676306 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:22.676273 19962 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:22.685891 15514 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:22.686570 19962 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:22.690109 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:22.677254 19890 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.693501 19956 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:22.694375 19490 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.697440 19490 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:22.677495 19467 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.832s	user 0.011s	sys 0.014s
I20260709 13:06:22.708938 19861 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:22.709796 19861 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:22.708583 19467 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.690398 19962 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:22.711514 19861 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.718763 19861 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:22.713735 19467 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:22.681671 15337 rpcz_store.cc:276] 0709 13:06:13.435480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.435776 (+   296us) service_pool.cc:224] Handling call
0709 13:06:22.680615 (+9244839us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:20.420211 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:20.420839 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:20.420883 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:06:20.420895 (+    12us) tablet.cc:662] Decoding operations
0709 13:06:20.421916 (+  1021us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:20.421989 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:20.422017 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:20.422693 (+   676us) tablet.cc:701] Row locks acquired
0709 13:06:20.422712 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:20.422879 (+   167us) write_op.cc:270] Start()
0709 13:06:20.423632 (+   753us) write_op.cc:276] Timestamp: P: 1783602380422820 usec, L: 0
0709 13:06:20.423658 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:06:20.424510 (+   852us) log.cc:844] Serialized 3310 byte log entry
0709 13:06:21.166138 (+741628us) op_driver.cc:464] REPLICATION: finished
0709 13:06:21.458053 (+291915us) write_op.cc:301] APPLY: starting
0709 13:06:21.458158 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:21.563332 (+105174us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:21.563483 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:21.691786 (+128303us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:21.692163 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:06:21.692234 (+    71us) write_op.cc:312] APPLY: finished
0709 13:06:21.692664 (+   430us) log.cc:844] Serialized 81 byte log entry
0709 13:06:21.696425 (+  3761us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:21.696563 (+   138us) write_op.cc:454] Released schema lock
0709 13:06:21.696616 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:21.698693 (+  2077us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:21.698733 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":478595,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":259042,"apply.run_cpu_time_us":16956,"apply.run_wall_time_us":240619,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37567,"num_ops":8,"prepare.queue_time_us":634568,"prepare.run_cpu_time_us":51581,"prepare.run_wall_time_us":261236,"raft.queue_time_us":244245,"raft.run_cpu_time_us":15006,"raft.run_wall_time_us":274952,"replication_time_us":710755,"thread_start_us":1064134,"threads_started":4,"wal-append.queue_time_us":300540,"wal-append.run_cpu_time_us":18468,"wal-append.run_wall_time_us":1966445}]]}
I20260709 13:06:22.719826 19834 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:22.720957 19835 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:22.623167 19860 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:22.723344 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.591754 15556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.011s
W20260709 13:06:22.728763 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 64191.2us
I20260709 13:06:22.744701 19861 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:22.746356 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 78959.7us
W20260709 13:06:22.752082 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.752928 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.679389 19947 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.755764 19947 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:22.755963 15407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.009s	sys 0.049s
W20260709 13:06:22.756522 15407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.009s	sys 0.049s
W20260709 13:06:22.756897 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 755531us
W20260709 13:06:22.757426 19810 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.011s
I20260709 13:06:22.761509 19861 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:22.763710 19692 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:22.749588 15556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.008s	sys 0.012s
I20260709 13:06:22.791720 19824 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:22.758203 19810 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:22.789141 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 912653us
I20260709 13:06:22.787351 19692 consensus_queue.cc:1243] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:06:22.837965 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.851316 19777 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:06:22.840725 19867 consensus_meta.cc:287] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.008s
I20260709 13:06:22.845182 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:22.841233 19861 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:22.873178 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.864017 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:22.891228 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.901571 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.937024 15510 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
W20260709 13:06:22.946637 19671 consensus_meta.cc:287] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.593s	user 0.016s	sys 0.000s
I20260709 13:06:22.876374 19867 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:22.964011 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 193449us
I20260709 13:06:22.965615 19798 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:22.979212 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 146026us
I20260709 13:06:22.978386 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:22.948812 19861 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:22.971748 19810 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:22.954902 15341 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 6 to 5, term changed from 8 to 5, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from VOTER to NON_VOTER. New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:06:22.994481 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:22.993894 19949 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.002597 15510 raft_consensus.cc:2410] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:06:23.002910 15512 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:23.003294 19949 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.004467 19867 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.006376 19949 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:23.007346 19950 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.008240 19950 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.010869 19950 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:23.011356 19958 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.261s	user 0.005s	sys 0.000s
I20260709 13:06:22.994033 19550 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:22.993201 19861 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.020959 19835 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:23.024878 19550 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.027308 19860 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.043720 19669 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.069674 15511 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:23.070206 19669 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.072873 15513 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:23.044639 19467 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.075981 19467 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.077600 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.078495 15514 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:23.040864 19835 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:23.081173 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.080978 19835 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.082326 15517 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
W20260709 13:06:23.048615 19957 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:06:23.085879 16179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52910 (request call id 463) took 1370 ms. Trace:
I20260709 13:06:23.049016 19876 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.088075 19876 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:23.089859 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.057644 19550 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:23.096724 19810 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.097498 19810 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.067379 15589 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:23.050806 19865 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.782s	user 0.014s	sys 0.003s
I20260709 13:06:23.023296 19671 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:23.054566 19489 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.059172 19688 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.012s
I20260709 13:06:23.061188 19836 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.016450 19798 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.064185 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.066052 19861 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:23.067960 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.102226 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:23.101887 15556 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:23.121869 15515 raft_consensus.cc:2410] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:06:23.120728 15583 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:23.121093 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2657) took 1735 ms. Trace:
I20260709 13:06:23.119030 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:23.123950 15518 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:23.079267 19467 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.123431 15516 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:23.083413 19835 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:23.118436 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:23.086421 16179 rpcz_store.cc:276] 0709 13:06:21.715038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.715308 (+   270us) service_pool.cc:224] Handling call
0709 13:06:21.715826 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:21.716406 (+   580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.716455 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.717142 (+   687us) log.cc:844] Serialized 26 byte log entry
0709 13:06:22.426226 (+709084us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18000d6300. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:22.779013 (+352787us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:22.783151 (+  4138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.787986 (+  4835us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.846553 (+ 58567us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b18000d6300. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:23.085363 (+238810us) raft_consensus.cc:1685] finished
0709 13:06:23.085395 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.085616 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1777,"raft.queue_time_us":29799,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":18018,"spinlock_wait_cycles":92575360,"thread_start_us":165111,"threads_started":1,"wal-append.queue_time_us":938655}
I20260709 13:06:23.119432 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.118523 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.106719 19362 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.073055 19669 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.142836 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.152560 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:23.134042 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.104449 19876 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.110785 19947 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:23.168205 19947 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.171033 19947 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.153805 19692 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:23.155606 15512 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:23.156400 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:23.124732 15482 connection.cc:256] RPC call timeout handler was delayed by -1.7639676200000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 13:06:23.178824 15517 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:06:23.179220 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.157495 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.158293 19687 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.158548 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.159258 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:23.179332 15482 connection.cc:256] RPC call timeout handler was delayed by -1.0864663380000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 13:06:23.159621 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.119836 19834 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:23.160318 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:23.144332 19865 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.164207 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:23.171795 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 130980us
I20260709 13:06:23.108160 19867 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.172196 19467 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:23.172497 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:23.122766 19860 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:23.182937 15482 connection.cc:256] RPC call timeout handler was delayed by -1.0490719130000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 13:06:23.165342 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.172539 19915 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.151794 19670 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:23.188864 15583 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:23.149794 19810 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.199200 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.190116 15518 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:23.196277 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:23.196831 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.116645 19489 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.189539 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.205714 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.206771 15584 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:23.207041 15439 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:23.207670 19834 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.208581 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.209261 15439 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:23.207705 19467 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:23.210726 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.211874 19687 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.211997 19467 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.212698 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.214264 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.214883 19687 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.215139 15437 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:23.215931 15438 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:23.216952 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.217496 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.181403 19692 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:23.206236 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:23.123705 15586 rpcz_store.cc:276] 0709 13:06:21.307032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.317081 (+ 10049us) service_pool.cc:224] Handling call
0709 13:06:21.317441 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:21.607002 (+289561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.607034 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.417124 (+810090us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b2c00033248. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:06:22.418614 (+  1490us) log.cc:844] Serialized 26 byte log entry
0709 13:06:22.575094 (+156480us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:22.814133 (+239039us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.828669 (+ 14536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.034355 (+205686us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540024ac54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:23.034439 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.034500 (+    61us) raft_consensus.cc:1685] finished
0709 13:06:23.034518 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.042724 (+  8206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4944,"prepare.queue_time_us":36386,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":53,"raft.queue_time_us":14708,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":18443,"spinlock_wait_cycles":662922496,"thread_start_us":391388,"threads_started":2,"wal-append.queue_time_us":253988}
W20260709 13:06:23.225940 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.223845 15590 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:23.125713 19836 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.228451 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:23.228580 19935 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.229102 15592 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:23.229509 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:23.230055 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 111827us
I20260709 13:06:23.145421 19688 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.232820 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:23.210649 19834 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.198031 19670 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.118319 19671 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.223582 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.241321 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.243484 19837 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:23.244433 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.245498 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.246192 15441 raft_consensus.cc:2368] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:06:23.246632 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.247251 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.254288 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.232582 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.255852 19860 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.258384 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.261881 15434 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:23.263572 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.197151 19362 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.262996 15588 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
W20260709 13:06:23.273860 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47176.7us
I20260709 13:06:23.285029 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.225518 19550 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.266541 19670 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:23.226459 19867 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.289628 19963 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:23.197611 19865 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.285833 15441 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:23.292434 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:23.294373 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.297881 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:23.300948 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.299796 19489 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.305183 15435 raft_consensus.cc:2410] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:06:23.306507 15585 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:23.232470 19692 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.240754 19935 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.340554 15439 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:23.334514 15438 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:23.344713 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.345685 15512 raft_consensus.cc:2410] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:23.347203 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:23.351468 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45312.2us
W20260709 13:06:23.357048 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.385151 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.386837 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.388041 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 47550.8us
I20260709 13:06:23.389072 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:23.390271 15583 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:23.350381 19876 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.301970 19837 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.408576 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.409547 15518 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:23.300760 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:23.376988 19836 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.427095 15437 raft_consensus.cc:606] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:23.427702 15437 raft_consensus.cc:614] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:23.405254 19810 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.434651 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.434829 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.416666 19798 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:23.522715 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 217564us
I20260709 13:06:23.425881 19876 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:23.533277 19976 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:06:23.561990 19963 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:23.635460 15518 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:23.659004 15585 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
W20260709 13:06:23.635896 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.635460 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 201133us
I20260709 13:06:23.671677 19876 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.639256 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:23.644958 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.677662 15515 raft_consensus.cc:2410] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:06:23.429468 15587 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:06:23.674932 19963 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:23.685124 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.686667 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50881.1us
I20260709 13:06:23.697363 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.706049 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:23.705868 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.739957 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:23.739223 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:23.739817 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.708233 15438 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:23.744769 15517 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:23.740819 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.745110 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.738592 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:23.703285 19671 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:23.746055 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.746754 19550 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.746872 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.700269 19798 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.698933 19362 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:23.738611 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:23.759022 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.748472 15514 raft_consensus.cc:2410] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:06:23.770085 15518 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.771831 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.758314 15442 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:23.778286 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:23.779207 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:23.741729 19867 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.790560 15518 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:23.795993 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:23.796986 15510 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:23.797312 19692 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.792474 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.792968 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.721681 19670 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:23.794762 19915 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.595s	user 0.014s	sys 0.004s
I20260709 13:06:23.797468 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:23.797928 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.771508 19836 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:23.803216 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:23.803792 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 108999us
W20260709 13:06:23.716404 19835 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.005s
I20260709 13:06:23.806412 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:23.823848 15441 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:06:23.813064 15435 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:23.814391 15512 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:23.817665 15513 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:06:23.817900 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.825618 15515 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:23.819993 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.736090 19985 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:23.742767 19865 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:23.728685 19860 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:23.840795 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:23.843358 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.736580 19981 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:23.848768 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.875196 15440 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:23.876773 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:23.849577 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.877776 16173 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:23.878433 15437 raft_consensus.cc:2410] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:06:23.850405 15441 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:23.851963 15436 raft_consensus.cc:2410] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:23.828761 19798 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.859086 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.861191 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.863726 19836 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:23.881335 15509 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:23.882175 19836 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.864383 19867 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.865331 16174 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:23.821208 19915 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:23.869975 15518 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:23.863907 15439 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:23.884202 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.881357 15434 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:23.885205 15509 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:23.821039 19550 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.885946 19550 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.852962 19985 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.888928 19835 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:23.861045 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.813628 19688 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:23.854974 15514 raft_consensus.cc:2376] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12. Re-sending same reply.
I20260709 13:06:23.877156 15440 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:06:23.907006 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 79575.3us
I20260709 13:06:23.913331 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:23.918553 15517 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:23.889362 19467 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:23.936371 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 259513us
I20260709 13:06:23.947697 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:23.948779 15443 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:23.949875 19550 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.951164 19837 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.951969 19961 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.952608 19961 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.955056 19961 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.883761 19867 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.962680 19867 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:23.957552 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:23.970273 19985 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.971410 19467 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.972071 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:23.981997 15442 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:23.974799 19467 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.986861 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:23.989713 15509 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:23.990381 19798 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.923837 19670 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.958454 19949 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:23.993042 19949 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:23.916095 19835 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:06:23.997066 16173 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:23.997277 19935 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:23.997895 19991 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:23.998445 19991 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.998437 19835 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:23.998903 19991 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:23.999185 19835 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:24.000389 19835 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:23.995862 19949 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:24.013171 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.018404 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.018829 19836 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:24.019760 19949 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:24.020313 19949 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:24.021332 19949 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.025210 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.026222 15587 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 14: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:24.030329 19981 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:24.031246 15591 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:24.031638 19835 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:24.031742 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.032532 15584 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:24.033305 15583 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:24.034962 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.035048 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.039391 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:24.043978 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 171678us
I20260709 13:06:24.045571 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:24.045862 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:24.010491 19489 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:24.047269 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:24.047749 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.049305 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.050344 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.050963 15585 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:24.051667 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.052244 15509 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:24.039752 19777 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.048736 16174 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:24.053653 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.046456 19834 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.062809 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.052392 19489 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.068271 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.077289 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:24.077749 19489 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.077991 15440 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:24.068957 19334 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:24.066205 19671 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:06:24.080401 19671 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:24.081014 19671 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:24.070082 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:24.083792 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.084836 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.085165 19989 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:24.086012 19876 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:24.060576 19777 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.088511 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:24.089285 15513 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:24.089556 19777 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.089852 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.090422 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:24.091475 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:24.092177 15517 raft_consensus.cc:2376] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12. Re-sending same reply.
I20260709 13:06:24.072580 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.094849 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.095731 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.094457 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.096580 15514 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:24.096730 15518 raft_consensus.cc:2410] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:06:24.073395 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.095973 15511 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:06:24.074389 19834 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.098774 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.082566 19671 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.078065 16175 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:24.104089 15509 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:24.105449 15513 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:24.107070 15556 leader_election.cc:400] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:06:24.107463 15556 leader_election.cc:403] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:06:24.112123 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.112385 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.113813 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:24.120652 15511 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
W20260709 13:06:24.121785 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 57107.5us
I20260709 13:06:24.126179 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:24.121048 19998 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:06:24.120527 19670 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:24.129350 19670 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.129705 19670 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:24.114228 19981 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:24.139518 19467 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:24.142323 19467 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:24.144618 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.145622 19467 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:24.145824 19991 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.137216 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.137382 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.147708 19997 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:24.148178 19997 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.148458 19991 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.131090 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.148558 19997 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.149502 15517 raft_consensus.cc:2410] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:06:24.152889 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.153131 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.154932 15513 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:24.146185 19467 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:24.155787 19467 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:24.156819 19835 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:24.157001 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:24.156163 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.166214 15511 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:24.160147 15556 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.134647 19671 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:24.169183 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.157716 19981 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.171166 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.180227 19981 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.172468 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:24.173864 20002 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:24.168475 19992 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:24.175716 19984 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:06:24.169937 19998 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:24.175215 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.179036 19991 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:24.197885 19998 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:24.198076 19991 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.198411 15513 raft_consensus.cc:2410] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:06:24.205117 19999 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:06:24.185539 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:24.190492 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.190923 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.191823 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.191987 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.212751 15438 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:24.197163 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.198541 19991 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:24.160499 19834 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.206789 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:24.207708 15511 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:24.198411 19998 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:24.211735 15516 raft_consensus.cc:2376] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9. Re-sending same reply.
W20260709 13:06:24.169417 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 211854us
I20260709 13:06:24.210654 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.223403 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.260447 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.261441 19835 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:24.261937 19835 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.224129 19984 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:24.262499 19835 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:24.262972 19984 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:24.263623 19984 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:24.225858 19489 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.226926 19777 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:24.268395 15442 raft_consensus.cc:606] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.268842 15442 raft_consensus.cc:614] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.230603 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:24.224315 20004 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.241670 19670 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.270576 20004 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.272114 19489 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.272905 19670 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.273021 20004 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:24.273845 19777 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:24.274293 19777 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:24.274698 19777 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:24.277920 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:24.278621 15591 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:24.279760 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 49270.3us
I20260709 13:06:24.282513 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:24.283913 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.284173 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:24.284250 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:24.284670 15584 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:24.285208 16175 raft_consensus.cc:2410] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:06:24.285158 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:24.244313 19798 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:24.286861 19798 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.288311 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:24.288951 15592 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.289358 19798 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:24.244837 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.291004 19992 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:24.246968 15509 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:06:24.291705 15509 pending_rounds.cc:85] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 8
I20260709 13:06:24.291954 15509 pending_rounds.cc:107] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:06:24.292218 15509 raft_consensus.cc:2889] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:24.247021 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.292980 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.293624 15517 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:24.293874 15585 raft_consensus.cc:2410] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:06:24.252755 19467 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.294845 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:24.296036 19467 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.296779 19981 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.253700 19997 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.284720 15440 raft_consensus.cc:606] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.300493 19997 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.256997 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.262179 15556 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.301666 19865 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:24.303206 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d40d294abeec453098d547799a79f7c5"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:24.303983 15440 raft_consensus.cc:606] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.304302 15440 raft_consensus.cc:614] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.246109 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.265273 19984 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.304996 15511 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
W20260709 13:06:24.308043 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52265.1us
I20260709 13:06:24.311749 15591 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:24.311273 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:24.316756 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.315639 16175 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:24.316731 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.310266 15337 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:24.305270 19985 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:24.324050 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:24.324769 15585 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.328675 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.329598 15434 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:24.329807 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:24.330646 15437 raft_consensus.cc:2368] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:06:24.325950 19865 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.331624 19865 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.332108 15439 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:24.334048 19865 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:24.334533 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.334661 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.335621 19865 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:24.336687 19991 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.337215 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.338201 19935 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:24.338644 19935 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:24.339054 19935 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.326227 19985 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:24.341197 19985 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:24.343283 15438 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:24.324222 19992 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:24.344204 19992 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:24.345285 19992 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.345952 19777 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.351152 15337 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 9 to 11, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:24.353492 15337 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 9 to 12, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 12 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:24.323364 15592 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:24.352320 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.361040 15556 leader_election.cc:400] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:06:24.361518 15556 leader_election.cc:403] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:06:24.369554 15406 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.371121 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.355830 20004 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:24.374894 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.376300 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:24.377381 15438 raft_consensus.cc:606] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:24.377779 15438 raft_consensus.cc:614] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.375924 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.380239 15585 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:24.373471 15337 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.386706 15337 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 9 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 12 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.390190 15337 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:24.394819 15337 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 3 to 7, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 7 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.375492 19865 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:24.401787 19777 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:24.402300 19998 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:24.403201 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 51009.1us
I20260709 13:06:24.404366 19991 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:24.404816 19981 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.381243 19334 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:24.414731 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:24.414273 19985 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.417058 19834 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:24.379315 20004 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.398339 15337 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 6 to 10, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:24.429517 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:24.434665 15590 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:24.433934 15337 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.381018 19949 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:24.381732 19798 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:06:24.374042 19837 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:24.427477 19836 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.436020 15337 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 8 to 10, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:24.445950 15337 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 9, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 9 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.435210 20004 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.446414 15436 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
W20260709 13:06:24.474862 15341 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 204) took 32151 ms (client timeout 15000 ms). Trace:
I20260709 13:06:24.436707 19334 raft_consensus.cc:697] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:24.481496 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 105670us
W20260709 13:06:24.482084 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.490552 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 100947us
I20260709 13:06:24.507740 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:24.512915 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:24.513898 15585 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:24.515185 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:24.516217 16173 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:24.480189 15341 rpcz_store.cc:269] 0709 13:05:52.323513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.323786 (+   273us) service_pool.cc:224] Handling call
0709 13:06:24.474623 (+32150837us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:23.282626 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:23.283594 (+   968us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:23.283658 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:06:23.283679 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:23.349442 (+ 65763us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:23.375364 (+ 25922us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:23.378706 (+  3342us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:23.686476 (+307770us) tablet.cc:701] Row locks acquired
0709 13:06:23.697668 (+ 11192us) write_op.cc:260] PREPARE: finished
0709 13:06:23.708775 (+ 11107us) write_op.cc:270] Start()
0709 13:06:23.740206 (+ 31431us) write_op.cc:276] Timestamp: P: 1783602383701817 usec, L: 0
0709 13:06:23.740253 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:06:23.846636 (+106383us) log.cc:844] Serialized 599 byte log entry
0709 13:06:24.119596 (+272960us) op_driver.cc:464] REPLICATION: finished
0709 13:06:24.143090 (+ 23494us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd52e28 00007fcf7f78d581 00007fcf7f78cd58 00007fcf7f7919f1 00007fcf7f7919a9 00007fcf7f791939 00007fcf7f791901 00007fcf7f790b2d 000000000038f354 000000000038f199
0709 13:06:24.173166 (+ 30076us) write_op.cc:301] APPLY: starting
0709 13:06:24.173300 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:24.175095 (+  1795us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:24.175137 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:24.199988 (+ 24851us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:24.200424 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:06:24.200509 (+    85us) write_op.cc:312] APPLY: finished
0709 13:06:24.200883 (+   374us) log.cc:844] Serialized 25 byte log entry
0709 13:06:24.201140 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:24.201254 (+   114us) write_op.cc:454] Released schema lock
0709 13:06:24.201331 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:24.231590 (+ 30259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:24.231630 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":226765,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":50031,"apply.run_cpu_time_us":5237,"apply.run_wall_time_us":41015,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":231200,"prepare.run_cpu_time_us":60674,"prepare.run_wall_time_us":860728,"raft.queue_time_us":48128,"raft.run_cpu_time_us":4257,"raft.run_wall_time_us":18882,"replication_time_us":379127,"spinlock_wait_cycles":71559552,"thread_start_us":395982,"threads_started":4,"wal-append.queue_time_us":221482}]]}
I20260709 13:06:24.515921 19935 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.520395 19935 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:24.524329 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:24.527842 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47271.1us
W20260709 13:06:24.530783 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.541260 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.545756 15509 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:24.548345 15516 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:24.551422 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.557749 15518 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:06:24.561060 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.562170 15513 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:24.565274 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.558259 15518 pending_rounds.cc:85] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 7
I20260709 13:06:24.566867 15518 pending_rounds.cc:107] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:06:24.567226 15518 raft_consensus.cc:2889] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:24.566462 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.568806 15514 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:24.569973 15515 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:24.571257 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.575225 15511 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:24.583516 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:24.587636 15516 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.593973 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:24.594656 15513 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.535984 19835 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.600124 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:24.601047 15514 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:24.573159 19777 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:24.604126 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:24.609838 16173 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:24.611903 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:24.613550 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45670.8us
I20260709 13:06:24.617131 19950 raft_consensus.cc:993] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:06:24.618701 19777 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:24.620172 19777 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.624373 19950 raft_consensus.cc:1081] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:06:24.624897 19985 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.626354 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.627116 19835 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.627959 19489 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:24.628643 19890 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:24.629168 19890 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:24.629635 19890 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.590936 19998 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.636147 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.583611 19334 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:24.613256 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 58795us
I20260709 13:06:24.664837 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.667078 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.668762 15512 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:24.671855 19865 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:24.672878 20014 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:24.673576 15406 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.680200 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:24.691156 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.696216 15516 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:24.696905 15590 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:24.698205 15513 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:24.700934 15514 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
W20260709 13:06:24.714159 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.737s (SENT)
W20260709 13:06:24.745045 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 71589.8us
I20260709 13:06:24.703329 19798 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:24.737862 19992 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:24.762285 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 256828us
I20260709 13:06:24.766247 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:24.766991 15592 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:24.749293 19978 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:24.751972 19835 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:24.776185 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62081us
W20260709 13:06:24.779762 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 3.157s (SENT) [suppressed 16 similar messages]
I20260709 13:06:24.775432 15583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:06:24.791872 15583 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.792390 15583 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:24.785107 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:24.794842 15441 raft_consensus.cc:2368] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:24.795882 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:24.797869 18966 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:24.782363 19835 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.799227 19835 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:24.800370 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:24.776954 19997 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:24.785192 19978 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.804891 19997 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:24.805401 19997 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.806139 19978 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.807116 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:24.807983 15436 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:24.764735 19798 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.810806 19798 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.782275 19865 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:24.802901 20004 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.814922 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.815869 20004 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.818145 15556 leader_election.cc:400] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:24.818661 20024 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:24.820683 15510 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:24.821046 20024 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.822288 15556 leader_election.cc:403] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:06:24.772280 19992 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.820248 15443 raft_consensus.cc:2368] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:06:24.830976 15592 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:24.827622 19985 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:24.837018 20024 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.822933 19890 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.822496 19777 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.847188 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 167072us
I20260709 13:06:24.853911 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
W20260709 13:06:24.849545 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69825.5us
W20260709 13:06:24.869284 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 122564us
I20260709 13:06:24.871177 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.871572 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.874653 15441 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:24.878974 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 212029us
I20260709 13:06:24.885080 16181 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:24.890404 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:24.877398 19836 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:24.883373 20004 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.907496 20004 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.910162 20004 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.914330 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.916227 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.902339 19997 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.919453 19997 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.896076 20023 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:24.920527 20023 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:24.921646 20023 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.893733 20021 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:24.923946 20021 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.925928 20028 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:24.926822 20021 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.870214 19777 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.917459 19865 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:24.878096 20033 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:24.929545 19777 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.933236 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:24.933748 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 49749.9us
I20260709 13:06:24.901265 15583 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:24.934962 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55767.9us
I20260709 13:06:24.935459 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:24.933971 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.933308 19992 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.938362 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:24.938290 20029 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:24.941041 15583 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:24.942158 20033 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:24.947988 20033 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:24.954241 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:24.961009 19961 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:24.963203 19890 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:24.973783 15592 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:24.983732 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:24.990510 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:24.996302 15590 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:24.997195 19990 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:24.997735 19990 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:24.998224 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:24.998474 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:24.998919 15585 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:24.995957 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:25.001077 15586 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:24.997645 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:24.966073 19961 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:25.005820 19961 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:24.984776 20032 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:25.009792 20032 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:25.013283 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:25.016371 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:25.017102 15514 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.019447 15516 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:24.999006 15587 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.022558 15556 leader_election.cc:400] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:06:25.023123 15556 leader_election.cc:403] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:24.963490 19835 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.030710 19998 consensus_queue.cc:1059] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:25.028822 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 58765.7us
I20260709 13:06:25.032613 20028 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:25.032881 20029 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.033478 15437 raft_consensus.cc:2368] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:06:25.033592 20029 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:24.998224 19990 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.010900 20032 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.052289 15556 leader_election.cc:400] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:06:25.052714 15556 leader_election.cc:403] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:25.063750 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 96656.4us
I20260709 13:06:25.065488 15441 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:25.070430 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:25.071262 15442 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:25.071653 15442 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:25.075251 15589 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:25.033003 19835 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:25.078680 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:25.081751 15439 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:25.084124 16181 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:25.084909 15437 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:25.085757 15442 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.101575 15442 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.096598 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:25.105912 15514 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:25.100642 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:25.078959 19998 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:06:25.092595 19798 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:25.110970 15556 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:25.116925 15443 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:25.118355 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:25.120850 18966 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:25.122988 18966 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:25.119068 15514 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.122540 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:25.114094 19670 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:06:25.131750 20024 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:25.132340 20024 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:25.132763 20024 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:25.123380 18966 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:25.136775 15514 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:25.140532 15407 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:25.141814 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.553s (SENT)
I20260709 13:06:25.146299 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:25.113878 19865 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:25.159868 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:25.161617 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:25.162276 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:25.162442 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 65982.2us
I20260709 13:06:25.149097 15442 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:25.162400 15514 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:25.164001 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:25.117000 19935 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:06:25.116658 19798 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:25.151117 18966 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.171504 15590 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:25.172442 18966 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:25.170446 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:25.179809 15583 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:25.117187 19984 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:06:25.147429 20029 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:25.156237 19950 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:25.193226 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:25.195261 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:25.195942 15514 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.181260 19669 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:25.199504 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:25.202454 15510 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:25.182475 19688 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:25.187436 19824 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:06:25.190248 19950 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.204285 20021 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:25.185814 19837 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:25.175041 19550 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:06:25.210243 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 70546.6us
I20260709 13:06:25.212214 20021 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:25.222059 20021 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.211880 19950 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:25.226104 20040 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 13:06:25.229321 19798 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.231031 19837 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:25.232292 19837 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.208554 19489 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:25.238554 19489 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.238775 20021 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.239075 19489 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:25.205729 20013 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:25.197263 19777 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:25.264542 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:25.265331 15518 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.269074 15514 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
W20260709 13:06:25.257961 20037 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:06:25.278143 15586 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:25.254797 20013 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.258559 19798 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.267998 19990 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:25.299026 19990 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:25.302789 19489 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:25.304071 16173 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:25.317009 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:25.324700 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:25.325851 15512 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.306799 20013 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:25.368055 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:25.368834 15586 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:25.374090 15587 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:25.342208 20024 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:25.375077 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50947.1us
I20260709 13:06:25.387483 20033 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:25.396577 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:25.378659 19981 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:06:25.397622 19949 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.398195 19949 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.405218 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:25.406455 15509 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:25.412330 20033 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:25.413166 20033 raft_consensus.cc:697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:25.413748 19998 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:06:25.414857 20033 consensus_queue.cc:237] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.419982 19489 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:25.425946 15513 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:25.429463 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:25.429760 15511 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:25.430306 15513 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:25.435245 15586 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:25.369091 20029 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:06:25.443064 20029 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:25.443113 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:25.443629 20029 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:25.444562 20029 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:25.445909 20029 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:25.451762 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.455302 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:25.455755 15441 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:06:25.465862 15518 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:25.509433 15518 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:25.509924 15518 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:25.510859 15518 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:25.511977 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:25.512713 15517 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:25.512857 19949 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:25.518056 19950 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.534132 16181 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:06:25.537209 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.539106 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.541221 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:25.542436 15514 raft_consensus.cc:2410] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:06:25.546933 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 339399us
W20260709 13:06:25.549091 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.742s (SENT)
I20260709 13:06:25.549347 15514 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:25.549664 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:25.554971 15592 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:25.571624 15517 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
W20260709 13:06:25.588883 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.593521 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:25.594656 19890 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:25.595346 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:25.595232 19890 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:25.603823 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54773.2us
W20260709 13:06:25.605561 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.779s (SENT)
I20260709 13:06:25.608448 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:25.551138 19998 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:06:25.636754 15592 raft_consensus.cc:2410] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:06:25.577162 19981 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:25.616053 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:25.622720 15584 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:25.557864 20013 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.607378 20015 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:25.557411 19949 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:06:25.628530 19950 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:25.628866 20032 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.631953 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 49637us
I20260709 13:06:25.634338 15512 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:25.638062 15509 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:25.610735 19890 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:25.833072 20051 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:25.820292 15439 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
W20260709 13:06:25.679634 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74132.2us
I20260709 13:06:25.641292 19935 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:06:25.821512 20013 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:25.827780 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 187986us
I20260709 13:06:25.836127 20032 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.838487 15515 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:25.854200 15555 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.842s (SENT)
I20260709 13:06:25.865980 20028 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:25.838642 20021 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.010s
I20260709 13:06:25.878120 15441 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:25.854372 20032 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:25.879145 20028 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.881641 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:25.881217 15555 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.846s (SENT)
I20260709 13:06:25.882390 15586 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:25.882350 15587 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:25.888309 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:25.889495 15584 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:25.874289 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 241596us
W20260709 13:06:25.820055 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.820863 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 221453us
W20260709 13:06:25.877867 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 235479us
I20260709 13:06:25.836683 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:25.891557 20015 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:25.892602 20015 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:25.897320 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60750.1us
W20260709 13:06:25.888427 20055 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.302s	user 0.004s	sys 0.000s
I20260709 13:06:25.897574 19836 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:25.918499 19836 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:25.918358 20032 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:25.919631 19836 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:25.896685 15556 leader_election.cc:400] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:25.886729 20024 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:25.924546 15556 leader_election.cc:403] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.928624 20013 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:25.884181 20028 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:25.942909 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.939653 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50577.4us
I20260709 13:06:25.906015 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:25.951439 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 111) took 1913 ms. Trace:
I20260709 13:06:25.906947 15518 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:25.950307 15586 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
W20260709 13:06:25.959364 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.888386 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:25.956825 15337 rpcz_store.cc:276] 0709 13:06:23.998454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.998715 (+   261us) service_pool.cc:224] Handling call
0709 13:06:24.060933 (+ 62218us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:24.122157 (+ 61224us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b5400002490. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c33640 00007fcf81b0ab76 00007fcf81c14c3e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:25.911485 (+1789328us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:24.498024 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:24.524097 (+ 26073us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:24.524142 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:06:24.524159 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:24.525283 (+  1124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:24.525347 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:24.525373 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:24.526328 (+   955us) tablet.cc:701] Row locks acquired
0709 13:06:24.526347 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:24.526541 (+   194us) write_op.cc:270] Start()
0709 13:06:24.526668 (+   127us) write_op.cc:276] Timestamp: P: 1783602384526473 usec, L: 0
0709 13:06:24.526688 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:06:24.527429 (+   741us) log.cc:844] Serialized 4367 byte log entry
0709 13:06:24.892894 (+365465us) op_driver.cc:464] REPLICATION: finished
0709 13:06:25.127252 (+234358us) write_op.cc:301] APPLY: starting
0709 13:06:25.127369 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:25.167299 (+ 39930us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:25.167428 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:25.615126 (+447698us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:25.615486 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:06:25.615535 (+    49us) write_op.cc:312] APPLY: finished
0709 13:06:25.615900 (+   365us) log.cc:844] Serialized 105 byte log entry
0709 13:06:25.616085 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.616252 (+   167us) write_op.cc:454] Released schema lock
0709 13:06:25.616307 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:25.616782 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.616811 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47084,"reported_tablets":16,"spinlock_wait_cycles":128440960,"child_traces":[["op",{"apply.queue_time_us":228817,"apply.run_cpu_time_us":22487,"apply.run_wall_time_us":489528,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":1370,"prepare.run_cpu_time_us":4573,"prepare.run_wall_time_us":43618,"replication_time_us":355090,"thread_start_us":128857,"threads_started":1}]]}
W20260709 13:06:26.012230 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59242.7us
W20260709 13:06:26.012279 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 45984.5us
I20260709 13:06:26.023525 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:25.966236 20024 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:26.034368 19798 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:26.039371 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:26.038161 20028 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:26.053282 20058 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:06:26.057471 20035 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:26.058307 20035 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:26.012799 19981 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:06:26.064013 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:26.068172 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 186970us
W20260709 13:06:26.070087 15555 leader_election.cc:336] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.851s (SENT)
I20260709 13:06:26.070513 15518 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:26.077980 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:26.081360 19949 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:26.082193 19949 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.082854 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:26.087764 19489 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:26.091403 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:26.092484 15518 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:26.085955 20032 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:26.092420 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:26.098258 15512 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:26.084966 20029 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:26.094894 15555 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.998s (SENT)
I20260709 13:06:26.106992 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:26.107851 15510 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:26.075620 20028 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:26.087381 20014 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:26.091276 20033 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:26.112280 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:26.116585 15585 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:06:26.124738 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 218895us
I20260709 13:06:26.125844 15509 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:26.128237 20033 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:26.059406 20035 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:26.131649 20033 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:26.138291 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 121090us
I20260709 13:06:26.145218 15512 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:26.122383 20014 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:26.157306 15509 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
W20260709 13:06:26.201773 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.202817 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 85389.8us
W20260709 13:06:26.212560 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 117705us
W20260709 13:06:26.214550 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.227216 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 97760.6us
I20260709 13:06:26.227533 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:26.218739 20068 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.225337 15555 leader_election.cc:336] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.952s (SENT)
I20260709 13:06:26.241688 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:26.244251 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:26.261157 19950 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:26.261704 19950 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.262079 19950 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:26.244488 20068 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:26.239691 19890 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:06:26.239691 20014 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:26.284991 15518 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:26.243917 20049 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:26.283901 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 84977.6us
W20260709 13:06:26.290670 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 138244us
W20260709 13:06:26.296247 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 70953.5us
I20260709 13:06:26.302860 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:26.260043 19981 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:26.304548 20062 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:06:26.312063 20066 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:06:26.295365 15584 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
W20260709 13:06:26.329241 20064 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:06:26.335911 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44497.6us
I20260709 13:06:26.336681 20068 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:26.341140 20015 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:26.354988 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:26.356281 15514 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:26.359678 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:26.367940 19876 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:26.368495 19876 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.368870 19876 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:26.371966 20028 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:26.381147 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.363667 20067 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.389545 20067 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:26.417075 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.026s (SENT)
W20260709 13:06:26.429491 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.152s (SENT)
W20260709 13:06:26.429847 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.430124 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:26.431533 15555 leader_election.cc:336] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.157s (SENT)
I20260709 13:06:26.432025 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:26.432283 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 164228us
I20260709 13:06:26.431461 20020 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:26.438763 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:26.441108 15585 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:26.439528 15441 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:26.406332 19981 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.508616 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 77053.1us
I20260709 13:06:26.541663 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:26.626425 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 136378us
I20260709 13:06:26.521623 19981 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:26.580318 19798 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:26.580845 20049 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:26.623786 16173 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:06:26.641952 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.650557 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 128617us
W20260709 13:06:26.637607 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 127879us
I20260709 13:06:26.683109 19876 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:26.691035 19876 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:26.703022 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:26.704618 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:26.706058 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:26.706941 15513 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:26.645313 20024 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.650255 15338 catalog_manager.cc:5697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.645632 20067 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:26.720103 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 288564us
I20260709 13:06:26.727089 20087 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.726732 15338 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:26.737066 15338 catalog_manager.cc:5697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.702234 20020 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:26.728091 20087 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:26.759385 20065 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.542s	user 0.000s	sys 0.003s
I20260709 13:06:26.765466 19981 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:26.716821 20049 raft_consensus.cc:2764] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:06:26.717980 20024 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:26.696806 19950 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:26.784432 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:26.785367 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 61480us
I20260709 13:06:26.785964 20087 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:26.787143 20024 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:26.788761 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:26.789805 20049 raft_consensus.cc:2764] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:26.790344 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:26.790834 20049 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:26.794328 15482 leader_election.cc:400] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:06:26.795050 15482 leader_election.cc:403] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:26.798612 15513 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:26.800207 20078 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:26.802711 20059 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.770s	user 0.007s	sys 0.000s
I20260709 13:06:26.807826 15338 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:26.767406 20073 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.456s	user 0.007s	sys 0.003s
I20260709 13:06:26.809784 15338 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 10, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.811231 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2778) took 1266 ms. Trace:
I20260709 13:06:26.812597 15589 rpcz_store.cc:276] 0709 13:06:25.544994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.545180 (+   186us) service_pool.cc:224] Handling call
0709 13:06:25.545735 (+   555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.547304 (+  1569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.547337 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.573933 (+ 26596us) log.cc:844] Serialized 26 byte log entry
0709 13:06:25.700372 (+126439us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:25.700440 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.700555 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.801652 (+1101097us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:26.810864 (+  9212us) raft_consensus.cc:1685] finished
0709 13:06:26.810888 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.811160 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":763,"raft.queue_time_us":1384,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":45675,"spinlock_wait_cycles":3944320,"thread_start_us":86545,"threads_started":1,"wal-append.queue_time_us":276302}
W20260709 13:06:26.748821 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.221s (SENT)
I20260709 13:06:26.817106 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:26.826938 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:26.776473 19950 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:26.827809 15338 catalog_manager.cc:5697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.822799 20078 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:06:26.880525 15338 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 11 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 12 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:26.882257 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:26.883009 15509 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:26.883821 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:26.896109 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 171681us
I20260709 13:06:26.882429 15338 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 5 to 8, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 8 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:26.913089 15338 catalog_manager.cc:5697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.880200 20028 raft_consensus.cc:2764] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:06:26.838523 19798 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:26.915864 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 89072.3us
I20260709 13:06:26.916743 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:26.917764 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:26.919381 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.242s (SENT)
I20260709 13:06:26.924232 15513 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:26.924490 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:26.926993 20105 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
I20260709 13:06:26.926311 15338 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 5 to 6, term changed from 5 to 7, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.929530 20078 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:26.930001 20078 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.930356 20078 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:26.935505 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.936131 20028 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:26.936861 20028 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.937256 20028 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:26.937543 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.939415 20092 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 13:06:26.939565 15555 leader_election.cc:336] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.525s (SENT)
W20260709 13:06:26.941177 15555 leader_election.cc:336] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.828s (SENT)
I20260709 13:06:26.941654 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:26.936218 20020 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:26.942736 19998 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:26.943565 20104 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.944226 20104 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:26.945528 20068 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:26.946214 20068 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:26.946997 20104 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:26.948415 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 192873us
I20260709 13:06:26.928756 15338 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 11, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.949363 15407 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:26.959863 15509 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:26.978530 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:26.952970 20049 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:26.988157 15516 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:26.982023 20013 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:26.986976 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:26.987749 15517 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:26.989522 15514 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:26.999311 15338 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 10 to 11, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.013335 15338 catalog_manager.cc:5697] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.015461 20101 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.021137 19798 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.005085 20013 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:27.026659 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45179.8us
I20260709 13:06:27.027118 15338 catalog_manager.cc:5697] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 8, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.029349 20013 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.022053 19798 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:27.032771 20110 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:06:27.034854 19798 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:27.005425 19991 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:06:27.049111 15512 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:26.991765 20049 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.062636 15338 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:27.064800 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 86431.5us
I20260709 13:06:27.070696 15338 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 9, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.026062 19890 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:27.075212 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47768.6us
I20260709 13:06:27.082180 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:27.081888 15338 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.048378 20113 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.022358 20101 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.109148 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.110051 15584 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:27.107758 15338 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.111629 15338 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 10, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.124890 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:27.079407 19890 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:27.130872 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.131095 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.138407 15587 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:27.123059 19798 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.120481 19670 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:27.181954 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.189142 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:27.190231 16174 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:27.191677 16180 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:27.194701 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:27.196310 19998 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:27.200987 15555 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.950s (SENT)
I20260709 13:06:27.201532 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:27.200642 15482 connection.cc:256] RPC call timeout handler was delayed by -2.721517576999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 13:06:27.203137 15482 connection.cc:256] RPC call timeout handler was delayed by -2.6009175769999047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:06:27.203442 15482 connection.cc:256] RPC call timeout handler was delayed by -2.5946175769998945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:06:27.203748 15482 connection.cc:256] RPC call timeout handler was delayed by -2.5496175769999354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 13:06:27.203867 15585 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:06:27.204319 15482 connection.cc:256] RPC call timeout handler was delayed by -2.5064175769999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:06:27.204676 15482 connection.cc:256] RPC call timeout handler was delayed by -2.4722175769999239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:06:27.205163 15482 connection.cc:256] RPC call timeout handler was delayed by -2.3957175769999139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:06:27.205444 15482 connection.cc:256] RPC call timeout handler was delayed by -2.3012175769998748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:06:27.206053 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:27.088645 20113 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.217746 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.218590 15589 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:27.220288 20100 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:27.221127 20049 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.133565 20078 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.224597 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.225378 15589 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:27.228207 20113 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.231742 20122 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:27.235586 15590 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:27.191749 20020 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:27.132486 20068 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.182075 19798 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.210203 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:27.270135 15585 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.242849 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.272193 15586 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:27.243954 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.243314 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.273633 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.199064 19998 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:06:27.197963 19670 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:27.254444 20122 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:27.268128 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62166.7us
I20260709 13:06:27.234694 19777 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.292665 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 197991us
I20260709 13:06:27.280795 20078 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.274709 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.283885 20119 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:27.287122 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:27.298127 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:27.283664 20014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.007s	sys 0.011s
I20260709 13:06:27.310889 15585 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
W20260709 13:06:27.320241 20071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.000s	sys 0.010s
I20260709 13:06:27.326336 15515 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:27.327003 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.327304 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:27.330027 20071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.001s	sys 0.011s
W20260709 13:06:27.326256 20014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.007s	sys 0.011s
I20260709 13:06:27.338697 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:27.344707 20033 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:27.351222 19670 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:27.293761 19777 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:27.367079 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.368772 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.371465 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:27.385077 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46474.4us
I20260709 13:06:27.329694 20122 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:27.387876 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.308233 20049 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:06:27.389104 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.386752 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:27.391255 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:27.392092 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.392387 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.404170 15438 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:27.398588 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:27.404559 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.368558 20121 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:27.362851 20028 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.405730 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.410598 15439 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
W20260709 13:06:27.412292 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 103482us
I20260709 13:06:27.388921 20078 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:27.420039 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.421356 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:27.405695 20119 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:27.397342 20100 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.433789 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:27.440603 15435 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:27.440526 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.444738 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.455051 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.432338 20121 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:27.423141 20078 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.423106 20084 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.439383 20119 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.439075 20101 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:27.478057 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:27.498685 20127 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:27.500784 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.508523 15583 raft_consensus.cc:2410] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:27.471275 20078 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.467104 20121 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.479092 20084 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:27.533121 20121 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:27.476895 20114 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:27.450913 20100 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.537926 20100 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:27.512915 15589 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:27.524631 15588 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:27.530341 20028 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.531670 19777 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:27.531925 19890 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:27.482963 20119 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:27.532511 19798 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:27.545704 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:27.549288 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:27.565443 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 98115us
I20260709 13:06:27.535295 20084 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:27.552621 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 154089us
I20260709 13:06:27.545780 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.573251 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.567241 15435 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
W20260709 13:06:27.570315 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 138103us
I20260709 13:06:27.574647 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.575314 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:27.568701 15515 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:27.577661 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.578326 15515 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:27.579317 15514 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:27.580636 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.582461 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.587890 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.587364 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.612747 19935 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.613511 19935 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.616468 15509 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:27.617700 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.618965 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.608069 20049 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.622864 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.623237 20049 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.623981 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.624440 19935 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:27.625221 15509 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:27.625521 20049 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.626111 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.626890 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.627470 15516 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:27.631232 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.632715 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.633311 15513 raft_consensus.cc:2376] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11. Re-sending same reply.
I20260709 13:06:27.634172 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.581722 19992 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:27.627453 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.626228 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.636968 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.637609 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.638031 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:27.639829 15516 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:27.635268 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.644658 15513 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:27.644029 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.647994 15516 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:27.642069 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.651861 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.653410 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.656764 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.659132 15516 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:27.661813 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.666536 15516 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:27.664544 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.669734 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.670388 15517 raft_consensus.cc:2376] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13. Re-sending same reply.
I20260709 13:06:27.672302 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.673382 15512 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:27.671280 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.674237 15517 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:27.659742 15514 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:27.675223 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:27.678506 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.678692 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.679190 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.679484 15511 raft_consensus.cc:2368] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
W20260709 13:06:27.677896 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 100930us
I20260709 13:06:27.680437 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.679421 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.684448 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:27.681169 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:27.690359 15586 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:27.679431 15516 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:27.691948 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.685386 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.693410 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.696100 15591 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:27.683749 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.696238 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:27.699071 15509 raft_consensus.cc:2368] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9.
I20260709 13:06:27.701022 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.682371 20078 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.709885 20078 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.710788 15586 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:27.712241 20114 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:27.712348 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 166931us
I20260709 13:06:27.713465 20114 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:27.714354 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 145287us
I20260709 13:06:27.715004 15407 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:27.715174 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:27.716845 18966 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:27.717428 20134 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:27.717911 20134 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.718242 20134 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.718887 20071 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:27.719256 20071 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.719563 20071 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.694965 19836 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:27.722218 20080 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:27.694671 20029 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:06:27.732002 20121 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.733412 15513 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:27.740542 15515 raft_consensus.cc:2410] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:06:27.703135 20049 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:27.750170 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:27.751119 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:27.798314 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57898.9us
I20260709 13:06:27.802393 15591 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:27.804282 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:27.861656 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 142844us
W20260709 13:06:27.863381 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 276502us
I20260709 13:06:27.865051 15438 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:06:27.865152 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 61046.7us
I20260709 13:06:27.866132 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:27.759420 20078 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:27.875612 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76130.1us
I20260709 13:06:27.880410 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:27.881300 15584 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:27.879511 20137 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:27.884235 20137 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:27.880470 20078 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:27.886957 20078 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.885386 20137 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.870193 20134 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.735430 20119 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.896193 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:27.901793 20013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.000s	sys 0.008s
W20260709 13:06:27.902429 20013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.001s	sys 0.008s
I20260709 13:06:27.893051 15584 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:27.885211 20138 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.905704 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:27.907730 20078 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:27.903591 20138 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:27.911092 20138 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.912649 20117 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:06:27.941290 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45172.3us
W20260709 13:06:27.915108 20132 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.594s	user 0.000s	sys 0.003s
I20260709 13:06:27.915781 20035 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:27.941890 20077 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:27.942479 20035 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:27.943528 20035 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:27.945654 19950 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:27.938668 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:27.918754 15555 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.472s (SENT)
I20260709 13:06:27.878369 20112 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:06:27.880577 20121 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.922302 20119 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.903303 20049 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:27.927668 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48436.7us
I20260709 13:06:27.929216 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:27.929749 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:27.894466 20134 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:27.933121 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.968385 15518 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:06:27.968161 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.936162 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.953106 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.955343 20012 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:06:27.958089 15587 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:06:27.960351 15555 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.129s (SENT)
I20260709 13:06:27.962296 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:27.970938 15517 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:27.965602 15514 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:27.973968 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:27.976106 15555 leader_election.cc:336] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.166s (SENT)
I20260709 13:06:27.977557 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:27.966199 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:27.974792 15514 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:27.987741 15509 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:27.995334 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:27.995364 15514 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:06:27.997967 15514 pending_rounds.cc:85] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 7
I20260709 13:06:27.998412 15514 pending_rounds.cc:107] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:06:27.998916 15514 raft_consensus.cc:2889] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:27.932109 20084 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:06:28.002552 15517 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:28.006863 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:28.051795 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 65021.2us
I20260709 13:06:27.987041 20097 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:28.109352 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 114083us
I20260709 13:06:27.990293 20101 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:27.988541 20078 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:28.112818 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:27.997177 20119 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:28.131758 20137 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:28.114491 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 61346.7us
I20260709 13:06:28.088212 20100 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:28.139312 15591 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:28.132735 20028 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:27.984658 20049 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:28.158699 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:28.160935 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:28.163506 20028 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:28.168591 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:28.169507 15441 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:28.168591 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:28.172796 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:28.173394 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:28.177896 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:28.175943 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:28.181636 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:28.127743 20138 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:28.187021 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:28.187820 15592 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.132429 20159 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.190577 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:28.119432 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:28.187582 20028 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:28.141670 20100 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:28.303258 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 94174.2us
W20260709 13:06:28.357331 20154 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:06:28.357336 20153 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.248s	user 0.000s	sys 0.002s
I20260709 13:06:28.357484 20107 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:28.360872 20107 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:28.359790 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:28.366715 20107 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:28.372007 20028 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:28.372856 20028 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:28.375470 20028 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:28.380293 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 260955us
I20260709 13:06:28.382190 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:28.206701 20159 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:28.396016 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.445999 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 63926.9us
I20260709 13:06:28.447453 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:28.449491 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:28.302626 20021 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:28.455309 20021 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:28.459378 20021 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:28.270017 15592 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
W20260709 13:06:28.387599 20071 consensus_meta.cc:287] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.003s
I20260709 13:06:28.465672 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:28.470427 15511 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.383275 20028 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:28.451195 20138 raft_consensus.cc:2764] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:06:28.466212 20035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.014s
I20260709 13:06:28.453685 20101 raft_consensus.cc:476] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:28.492199 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:28.497653 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:28.509014 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 149369us
I20260709 13:06:28.300565 20078 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:28.451189 20093 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:28.462788 20142 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:06:28.487685 20035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.007s	sys 0.014s
W20260709 13:06:28.608155 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 158750us
I20260709 13:06:28.610904 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:28.646337 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:28.477802 20071 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:28.722579 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 225101us
I20260709 13:06:28.513377 20028 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:28.512701 20121 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:28.524067 20112 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:28.519511 20080 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:28.805757 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 159532us
I20260709 13:06:28.717229 20101 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:28.817139 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:28.520421 20119 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:28.737893 20157 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:28.735383 20117 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:28.795738 20097 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:28.845002 15441 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.003s
I20260709 13:06:28.815757 20112 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.737253 20021 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:06:28.803915 20156 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:28.822377 20049 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:28.846328 15441 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
W20260709 13:06:28.849375 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 402065us
W20260709 13:06:28.853798 20155 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.468s	user 0.001s	sys 0.000s
I20260709 13:06:28.854949 19998 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:06:28.856223 20169 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:06:28.854952 20162 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 13:06:28.815521 19837 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:28.869176 20097 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:28.820007 20028 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.967388 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:28.988833 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2959) took 1030 ms. Trace:
I20260709 13:06:28.915643 20112 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:28.823118 20080 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:28.985996 20049 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:28.917688 20157 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:28.959645 20156 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:28.999954 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.000131 19837 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:28.840430 20119 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:29.016630 15409 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.019s	sys 0.025s
I20260709 13:06:28.995786 15516 rpcz_store.cc:276] 0709 13:06:27.958911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.962982 (+  4071us) service_pool.cc:224] Handling call
0709 13:06:27.963305 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.966904 (+  3599us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:28.133860 (+166956us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.987419 (+853559us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.988374 (+   955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.988439 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:28.988502 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.988587 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.988753 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25079,"prepare.queue_time_us":298647,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":98,"raft.queue_time_us":73654,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":199169,"thread_start_us":940284,"threads_started":3,"wal-append.queue_time_us":327175}
W20260709 13:06:29.017486 15409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.020s	sys 0.026s
I20260709 13:06:29.007766 19949 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.010946 20093 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.060279 20093 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.048337 20159 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:29.001518 20028 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.064186 15588 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:29.050405 19949 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.051720 20171 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.008617 20157 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.056468 20119 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.058311 20114 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:29.039559 20100 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.012038 20049 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:29.102413 15592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.003s	sys 0.031s
W20260709 13:06:29.114583 15592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.004s	sys 0.031s
W20260709 13:06:29.106663 20155 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:06:29.117571 15406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.012s	sys 0.013s
I20260709 13:06:29.103813 20028 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.102612 20173 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.110288 20142 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:29.122138 15406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.012s	sys 0.013s
W20260709 13:06:29.133464 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 623580us
W20260709 13:06:29.122190 15590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.016s	sys 0.012s
I20260709 13:06:29.108693 20159 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:29.134758 15590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.016s	sys 0.012s
I20260709 13:06:29.116371 20071 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.112742 20170 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.113088 20100 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.121598 20119 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.142329 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2155) took 1216 ms. Trace:
I20260709 13:06:29.101289 20171 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.121701 20160 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.113395 20114 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:29.138701 20164 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:06:29.153523 15515 rpcz_store.cc:276] 0709 13:06:27.926125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.926284 (+   159us) service_pool.cc:224] Handling call
0709 13:06:27.926680 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.927110 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.927138 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.935041 (+  7903us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.100826 (+165785us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:28.177959 (+ 77133us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.178609 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.178704 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.141951 (+963247us) raft_consensus.cc:1685] finished
0709 13:06:29.142102 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.142261 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3542,"prepare.queue_time_us":198936,"prepare.run_cpu_time_us":5875,"prepare.run_wall_time_us":92409,"raft.queue_time_us":743,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":12754,"thread_start_us":216994,"threads_started":2,"wal-append.queue_time_us":270318}
W20260709 13:06:29.162325 15511 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.691s	user 0.014s	sys 0.000s
I20260709 13:06:29.162801 15511 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:29.135411 20028 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:29.140203 20159 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.157485 20170 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.164608 19949 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.167702 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2973) took 1031 ms. Trace:
I20260709 13:06:29.167982 20097 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.180430 15511 rpcz_store.cc:276] 0709 13:06:28.136084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.166693 (+1030609us) service_pool.cc:224] Handling call
0709 13:06:29.167094 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.167308 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.167337 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.167385 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:29.167422 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.167479 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.167632 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.144469 19670 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:29.140201 20093 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:29.221138 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 404044us
W20260709 13:06:29.224092 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 194612us
I20260709 13:06:29.225740 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:29.216775 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 81613.3us
I20260709 13:06:29.137310 20142 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.178188 19837 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.236523 16180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 674) took 1690 ms. Trace:
I20260709 13:06:29.118271 19997 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:29.248337 20183 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.249143 20183 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:29.251914 20184 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.252682 20184 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.255267 20184 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.255906 20171 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.257130 20183 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:06:29.257818 20159 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:29.258204 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2156) took 1331 ms. Trace:
I20260709 13:06:29.258654 15510 rpcz_store.cc:276] 0709 13:06:27.926459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.926591 (+   132us) service_pool.cc:224] Handling call
0709 13:06:27.926933 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.143413 (+216480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.156110 (+ 12697us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.157103 (+   993us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.471066 (+313963us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:28.511139 (+ 40073us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.511438 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.511574 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.257907 (+746333us) raft_consensus.cc:1685] finished
0709 13:06:29.257932 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.258129 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6443,"prepare.queue_time_us":36589,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":281552,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":8021,"spinlock_wait_cycles":11583744,"thread_start_us":480998,"threads_started":2,"wal-append.queue_time_us":655657}
I20260709 13:06:29.257788 20183 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:29.180874 20160 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.265930 20160 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.269321 15555 leader_election.cc:400] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
W20260709 13:06:29.270186 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46283.9us
I20260709 13:06:29.244230 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2838) took 1045 ms. Trace:
I20260709 13:06:29.159960 20119 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.135483 20173 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.237071 16180 rpcz_store.cc:276] 0709 13:06:27.545732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.565564 (+ 19832us) service_pool.cc:224] Handling call
0709 13:06:27.565949 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.566642 (+   693us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:27.579534 (+ 12892us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.801692 (+1222158us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18004717c0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a 00007fcf7bd61a2a
0709 13:06:29.116232 (+314540us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.120928 (+  4696us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.121775 (+   847us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:29.127516 (+  5741us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.142915 (+ 15399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.143025 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.236217 (+ 93192us) raft_consensus.cc:1685] finished
0709 13:06:29.236249 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.236440 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15213,"prepare.queue_time_us":13153,"raft.queue_time_us":20159,"raft.run_cpu_time_us":736,"raft.run_wall_time_us":20747,"spinlock_wait_cycles":18315776,"thread_start_us":313414,"threads_started":1,"wal-append.queue_time_us":1538313}
I20260709 13:06:29.175910 20100 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.271648 15585 rpcz_store.cc:276] 0709 13:06:28.198936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.199237 (+   301us) service_pool.cc:224] Handling call
0709 13:06:28.199818 (+   581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.200145 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:28.481458 (+281313us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.188711 (+707253us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.243575 (+ 54864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.243679 (+   104us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:29.243766 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.243892 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.244129 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81329,"prepare.queue_time_us":702825,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":100,"raft.queue_time_us":99916,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":8200,"thread_start_us":895361,"threads_started":3,"wal-append.queue_time_us":623645}
I20260709 13:06:29.278877 20176 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.286476 20176 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:29.286507 20174 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:06:29.239645 20178 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.272037 20080 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.282670 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:29.292239 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2970) took 1286 ms. Trace:
W20260709 13:06:29.284931 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48625.3us
I20260709 13:06:29.274489 20185 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.303102 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:29.313944 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:29.313102 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2972) took 1202 ms. Trace:
I20260709 13:06:29.315939 20049 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.316243 20080 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:29.273998 19997 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:29.316828 20166 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.249s	user 0.000s	sys 0.002s
I20260709 13:06:29.315392 15515 rpcz_store.cc:276] 0709 13:06:28.128213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.164358 (+1036145us) service_pool.cc:224] Handling call
0709 13:06:29.164735 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.165005 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:29.165490 (+   485us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.293538 (+128048us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.312637 (+ 19099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.312716 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:29.312788 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.312870 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.313024 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2085,"prepare.queue_time_us":1079,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":96,"raft.queue_time_us":138,"thread_start_us":127181,"threads_started":1}
I20260709 13:06:29.316884 20080 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:29.320405 20114 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.320940 20170 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.320744 20080 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:29.321735 20177 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:06:29.322008 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2978) took 1056 ms. Trace:
I20260709 13:06:29.322444 15509 rpcz_store.cc:276] 0709 13:06:28.266029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.321041 (+1055012us) service_pool.cc:224] Handling call
0709 13:06:29.321421 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.321666 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.321693 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.321744 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:29.321773 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.321834 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.321948 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.324071 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2967) took 1352 ms. Trace:
I20260709 13:06:29.324535 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2841) took 1051 ms. Trace:
I20260709 13:06:29.324477 15518 rpcz_store.cc:276] 0709 13:06:27.971995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.002770 (+ 30775us) service_pool.cc:224] Handling call
0709 13:06:28.003216 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.194904 (+191688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.194938 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.194996 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:28.195030 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.323815 (+1128785us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002026d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:29.323863 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.323991 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440243072}
I20260709 13:06:29.324942 15583 rpcz_store.cc:276] 0709 13:06:28.272951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.276958 (+  4007us) service_pool.cc:224] Handling call
0709 13:06:28.304235 (+ 27277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.304769 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.304817 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.305548 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.928790 (+623242us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:28.995212 (+ 66422us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.006365 (+ 11153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.006508 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.317260 (+310752us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18000de040. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:29.324216 (+  6956us) raft_consensus.cc:1685] finished
0709 13:06:29.324341 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.324476 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62475,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":12620,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":80080,"spinlock_wait_cycles":61277824,"thread_start_us":456212,"threads_started":1,"wal-append.queue_time_us":586233}
I20260709 13:06:29.303438 20142 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:29.289927 20156 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.327581 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2963) took 1357 ms. Trace:
I20260709 13:06:29.329192 15517 rpcz_store.cc:276] 0709 13:06:27.970358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.978301 (+  7943us) service_pool.cc:224] Handling call
0709 13:06:27.999414 (+ 21113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.003086 (+  3672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.327329 (+1324243us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b54001e46d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:29.327481 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47799680}
I20260709 13:06:29.329998 20122 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:29.330489 20122 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:29.331250 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2980) took 1047 ms. Trace:
I20260709 13:06:29.331699 15517 rpcz_store.cc:276] 0709 13:06:28.283872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.330278 (+1046406us) service_pool.cc:224] Handling call
0709 13:06:29.330685 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.330893 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.330920 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.330966 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:29.330995 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.331056 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.331181 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.331427 20122 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.333236 20122 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.241148 20093 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:06:29.336508 15517 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:29.338137 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2976) took 1161 ms. Trace:
I20260709 13:06:29.338609 15515 rpcz_store.cc:276] 0709 13:06:28.176934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.319436 (+1142502us) service_pool.cc:224] Handling call
0709 13:06:29.337234 (+ 17798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.337425 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.337449 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.337491 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:29.337522 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.337956 (+   434us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.338081 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.311750 15513 rpcz_store.cc:276] 0709 13:06:28.006448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.488009 (+481561us) service_pool.cc:224] Handling call
0709 13:06:28.516045 (+ 28036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.516350 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:28.735720 (+219370us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.291691 (+555971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.291762 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:29.291829 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.291928 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.292152 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40937,"prepare.queue_time_us":265941,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":179774,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":514378,"threads_started":2,"wal-append.queue_time_us":401982}
W20260709 13:06:29.298537 20168 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:06:29.319275 19997 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.357489 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:29.348438 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65922.7us
W20260709 13:06:29.333717 20077 consensus_meta.cc:287] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.391s	user 0.014s	sys 0.001s
W20260709 13:06:29.360395 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45219.4us
I20260709 13:06:29.361588 15555 leader_election.cc:400] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16.
I20260709 13:06:29.366613 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:29.371724 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.309775 19837 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.377501 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:29.379117 15555 leader_election.cc:400] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9.
I20260709 13:06:29.379786 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:29.380983 15555 leader_election.cc:403] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:29.356257 20142 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:29.404141 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.404647 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.384827 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:29.355813 20049 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.372951 20077 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:29.311264 20178 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.407408 15442 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 15. Ops: []
I20260709 13:06:29.408175 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.409035 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.410173 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.412528 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:29.394271 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.423767 15440 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:29.377429 20157 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:29.411322 20160 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:29.439441 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.389501 19798 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:29.378134 19837 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.389401 20024 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9.
I20260709 13:06:29.389990 20170 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.444912 20189 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.445487 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2975) took 1276 ms. Trace:
I20260709 13:06:29.445873 20195 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.446449 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:29.446837 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.447110 20183 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.473546 19837 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:29.489982 15510 rpcz_store.cc:276] 0709 13:06:28.169222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.261163 (+1091941us) service_pool.cc:224] Handling call
0709 13:06:29.261598 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.261843 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:29.262571 (+   728us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.444906 (+182335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.445001 (+    95us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:29.445069 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.445172 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.445384 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37877,"prepare.queue_time_us":249,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":49673,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":132935,"threads_started":1,"wal-append.queue_time_us":145329}
W20260709 13:06:29.493106 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80696.2us
I20260709 13:06:29.494159 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:29.493106 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46754.9us
I20260709 13:06:29.496304 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:29.424295 20049 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.455144 20077 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:29.458577 20143 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.590s	user 0.019s	sys 0.026s
I20260709 13:06:29.471529 15512 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:29.384727 20192 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:29.343230 20185 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.403116 20142 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.411774 19692 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:29.492250 20183 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.512850 15517 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:29.499761 20078 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.513761 20182 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.514209 20178 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:29.514462 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 908) took 1236 ms. Trace:
I20260709 13:06:29.552690 15518 rpcz_store.cc:276] 0709 13:06:28.278484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.325849 (+1047365us) service_pool.cc:224] Handling call
0709 13:06:29.326223 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.352965 (+ 26742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.353019 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.354291 (+  1272us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.410795 (+ 56504us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:29.410848 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.410937 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.514184 (+103247us) raft_consensus.cc:1685] finished
0709 13:06:29.514209 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.514388 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68641,"raft.queue_time_us":45497,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":18308,"thread_start_us":56115,"threads_started":1,"wal-append.queue_time_us":125387}
I20260709 13:06:29.521587 15584 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:29.525890 15439 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:29.482326 20157 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:29.539989 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43796.1us
I20260709 13:06:29.555532 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2979) took 1281 ms. Trace:
I20260709 13:06:29.541157 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2832) took 1362 ms. Trace:
W20260709 13:06:29.544973 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50946us
I20260709 13:06:29.501139 20156 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:29.559527 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:29.557314 15586 rpcz_store.cc:276] 0709 13:06:28.178515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.178709 (+   194us) service_pool.cc:224] Handling call
0709 13:06:28.179215 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.184912 (+  5697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.184967 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.264359 (+ 79392us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.498692 (+234333us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:28.498771 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.498893 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.524652 (+1025759us) raft_consensus.cc:1685] finished
0709 13:06:29.524684 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.541054 (+ 16370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5138,"raft.queue_time_us":11280,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":6129,"thread_start_us":118246,"threads_started":1,"wal-append.queue_time_us":620188}
I20260709 13:06:29.546507 20171 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:29.543998 20142 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:29.573621 20097 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:29.584245 20097 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.586920 20097 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:29.574110 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134290us
I20260709 13:06:29.595989 20013 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:29.565459 19692 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.552245 20024 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:29.600212 19692 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.600620 20176 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.500002 20189 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.556181 15509 rpcz_store.cc:276] 0709 13:06:28.274310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.323480 (+1049170us) service_pool.cc:224] Handling call
0709 13:06:29.323891 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.363311 (+ 39420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.363349 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.375302 (+ 11953us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.555006 (+179704us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:29.555082 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.555184 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.555250 (+    66us) raft_consensus.cc:1685] finished
0709 13:06:29.555268 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.555445 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58341,"raft.queue_time_us":47374,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":112,"thread_start_us":131396,"threads_started":1,"wal-append.queue_time_us":109522}
I20260709 13:06:29.500423 20195 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.558429 20182 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.493323 20170 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.570791 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:29.617419 15586 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:06:29.618854 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48229us
I20260709 13:06:29.619796 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:29.575500 20178 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.563175 20078 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.634348 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:29.603461 20167 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.730s	user 0.002s	sys 0.000s
I20260709 13:06:29.635257 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.641228 15586 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
I20260709 13:06:29.634841 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.650550 19998 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:29.654671 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.655630 15583 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:29.657810 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.658686 15583 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:29.604602 20156 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.661514 15587 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:06:29.665926 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 99533.4us
I20260709 13:06:29.663331 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.664188 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.661518 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.605091 20119 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:29.668922 15484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.031s	sys 0.093s
W20260709 13:06:29.669744 15484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.031s	sys 0.093s
I20260709 13:06:29.629247 20024 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:29.672690 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.673255 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.677037 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.677666 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.680687 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.666528 20189 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.686614 20099 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:29.693812 20024 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.701836 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2835) took 1516 ms. Trace:
I20260709 13:06:29.702893 15589 rpcz_store.cc:276] 0709 13:06:28.185793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.186109 (+   316us) service_pool.cc:224] Handling call
0709 13:06:28.186579 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.186902 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.186942 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.207668 (+ 20726us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.487931 (+280263us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:28.487980 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.488064 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.602638 (+1114574us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:29.701528 (+ 98890us) raft_consensus.cc:1685] finished
0709 13:06:29.701551 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.701764 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9245056,"thread_start_us":197195,"threads_started":1,"wal-append.queue_time_us":520265}
I20260709 13:06:29.703845 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2974) took 1542 ms. Trace:
I20260709 13:06:29.704347 15511 rpcz_store.cc:276] 0709 13:06:28.161760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.183756 (+1021996us) service_pool.cc:224] Handling call
0709 13:06:29.184295 (+   539us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:29.184839 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.184877 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:29.228068 (+ 43191us) log.cc:844] Serialized 52 byte log entry
0709 13:06:29.409358 (+181290us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:29.409408 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.409481 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.703611 (+294130us) raft_consensus.cc:1685] finished
0709 13:06:29.703635 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.703781 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63404,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":55,"thread_start_us":141786,"threads_started":1,"wal-append.queue_time_us":142257}
I20260709 13:06:29.707939 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.708551 15511 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:29.710676 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.710825 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:29.733189 15511 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:29.712914 20170 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.705727 19998 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.733201 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.734261 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.715029 20021 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:29.737475 20021 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.740489 20012 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:29.741032 20012 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:29.742100 20012 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.743264 20012 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.718642 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.720073 20049 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.779536 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2969) took 1806 ms. Trace:
W20260709 13:06:29.724874 20196 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:06:29.731305 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.732175 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.679700 20187 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:29.734383 15586 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:06:29.714442 20195 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.734930 15511 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 4.
I20260709 13:06:29.736279 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.736583 19998 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.717144 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:29.748855 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.700366 20099 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.752266 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.753858 20182 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.702304 20024 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.756506 20078 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.758123 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.671020 20156 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:29.770751 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60042.9us
I20260709 13:06:29.707999 20080 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:29.783270 15585 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:29.809854 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.784406 20157 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:29.811236 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.789798 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2839) took 1582 ms. Trace:
I20260709 13:06:29.789448 15588 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 4.
W20260709 13:06:29.793385 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 76348us
I20260709 13:06:29.797487 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.795430 15510 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:29.814069 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.814611 15510 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:29.799787 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.815706 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.799932 15592 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:29.816017 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:29.816367 15585 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:29.817395 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.818077 15589 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 2.
I20260709 13:06:29.795150 19991 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:06:29.820812 20032 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:29.821408 20032 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:29.822291 20032 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.823576 20024 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.770241 20185 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:29.789058 20187 consensus_queue.cc:1243] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:29.820880 19998 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.788661 20101 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:29.829519 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.829453 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.830531 16174 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:29.812083 15590 rpcz_store.cc:276] 0709 13:06:28.207577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.207859 (+   282us) service_pool.cc:224] Handling call
0709 13:06:28.208382 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.209041 (+   659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.209100 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.209810 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.779019 (+1569209us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b5400185c20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bcce6b8 00007fcf7bd5792b 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c
0709 13:06:29.779091 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:29.779159 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.779255 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.779305 (+    50us) raft_consensus.cc:1685] finished
0709 13:06:29.779318 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.789739 (+ 10421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8229,"raft.queue_time_us":56112,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7858,"spinlock_wait_cycles":7758720,"thread_start_us":928221,"threads_started":1,"wal-append.queue_time_us":908212}
I20260709 13:06:29.826629 15512 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:29.788055 20097 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.828547 15436 raft_consensus.cc:2410] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:06:29.831775 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:29.819216 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:29.829357 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.833036 15511 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:29.833969 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:29.834465 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.835306 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.797101 20195 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:29.795771 20170 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.836002 15511 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:29.836802 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:29.842691 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.827963 20145 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:29.853559 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.858294 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.860679 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.799835 19950 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:06:29.861733 19950 consensus_queue.cc:1243] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:29.862192 15441 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:29.862565 15441 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:29.862726 20156 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.856933 20170 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.824302 20080 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.850704 20119 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:29.852609 20182 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:29.850963 20097 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.828315 20159 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:29.851567 20032 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:29.835152 20078 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.882594 20170 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.863517 15441 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:29.883314 15439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2060) took 1725 ms (client timeout 1643 ms). Trace:
I20260709 13:06:29.875859 20173 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.877180 20099 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.867779 20134 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:29.885061 20134 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:29.885483 20134 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.887665 15441 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.881325 20097 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:29.877974 20080 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.881611 20159 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.889606 20159 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:29.892277 20122 consensus_meta.cc:287] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.559s	user 0.014s	sys 0.000s
I20260709 13:06:29.882325 20078 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.895129 15515 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:29.897089 20078 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:29.898820 20112 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.885s	user 0.015s	sys 0.000s
I20260709 13:06:29.899329 20112 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:29.901892 20112 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.825299 20157 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.902770 20157 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:29.907173 20178 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:29.906589 20145 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:29.883862 15439 rpcz_store.cc:269] 0709 13:06:28.158084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.158270 (+   186us) service_pool.cc:224] Handling call
0709 13:06:29.883068 (+1724798us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540006a254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:29.883199 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2932558208}
I20260709 13:06:29.851939 19998 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:29.910960 20097 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:29.917003 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.919919 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.921399 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:29.921557 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.958961 15583 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:29.959721 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.922140 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.924113 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.928320 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.928910 15515 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:29.802177 20021 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:29.939913 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:29.948195 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.956224 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.962833 16179 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
W20260709 13:06:29.963698 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.964676 15441 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:29.967628 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.968124 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.968717 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.964594 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.969851 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.970067 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.969856 15438 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:06:29.971305 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.971833 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:29.973611 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:29.977310 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:29.978072 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.978744 15438 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:29.979665 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.979950 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:29.980543 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.981724 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.981750 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:29.987907 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.989974 15587 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:29.993083 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.994359 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:29.993114 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.006693 15586 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:29.780134 15514 rpcz_store.cc:276] 0709 13:06:27.972823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.005539 (+ 32716us) service_pool.cc:224] Handling call
0709 13:06:28.006114 (+   575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.110287 (+104173us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:29.723794 (+1613507us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b180037f360. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7f74f3c7 00007fcf7bd619a7 00007fcf7bd710bf
0709 13:06:29.724024 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.779116 (+ 55092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.779182 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:29.779229 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.779304 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.779462 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38494,"prepare.queue_time_us":334165,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":98,"spinlock_wait_cycles":12999424,"thread_start_us":335245,"threads_started":2}
I20260709 13:06:30.015167 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:29.967882 20097 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:30.017982 20097 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:30.019824 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.020578 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.021412 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:30.024102 20088 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.024755 20088 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:30.024945 20134 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.026110 15443 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:30.027952 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:30.028270 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:30.028892 15442 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:30.030258 20093 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:30.030948 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.030838 20093 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.031903 19334 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:30.032661 19334 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.033208 20093 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:30.034399 15556 connection.cc:256] RPC call timeout handler was delayed by -1.1244005319999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 13:06:30.023326 20145 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:30.036636 20021 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.037163 20021 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.027494 15437 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:30.031920 16174 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:30.020658 16179 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:30.039426 20021 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:30.043682 20122 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:30.046178 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:30.039305 20159 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.047318 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:30.047744 20077 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:30.048036 15592 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:30.048514 20200 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:30.048983 20200 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:30.049387 20200 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.050577 20157 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:29.957638 19998 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:30.046396 20088 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:30.034670 19334 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:30.051092 20093 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:30.052168 20199 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:30.004112 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.027211 20134 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:29.982786 19950 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:06:30.003311 20078 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:29.997032 20049 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:30.056725 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:30.061494 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 81685.3us
W20260709 13:06:30.064790 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 83118us
I20260709 13:06:30.051167 20159 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:30.066536 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.052081 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:30.105471 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:30.083086 20122 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:30.082996 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:30.102164 15591 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:30.102696 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50732.2us
I20260709 13:06:30.100356 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:30.112006 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:30.114073 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:30.115650 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:30.103842 15438 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:30.091655 15583 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:30.122329 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:30.124297 20170 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:30.124786 20170 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:30.126772 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:30.081694 19998 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.132167 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:30.125319 20187 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:30.134004 20159 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:30.116773 20122 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.141331 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:30.125156 20170 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.157374 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:30.145707 15583 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:30.125619 20021 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:30.156553 19670 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:06:30.097126 20195 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:30.142434 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:30.160657 20122 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.125545 20102 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:06:30.125792 20173 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:30.139243 20182 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.099483 20049 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:30.157202 20159 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.170725 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.188265 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:30.189953 15434 pending_rounds.cc:85] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 4
I20260709 13:06:30.140833 20119 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:30.190804 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:30.191735 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46574.6us
I20260709 13:06:30.323992 15434 pending_rounds.cc:107] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:06:30.324401 15434 raft_consensus.cc:2889] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:30.195351 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:30.224989 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.324028 15437 raft_consensus.cc:2376] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9. Re-sending same reply.
I20260709 13:06:30.137454 20089 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:30.173380 20142 consensus_meta.cc:287] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.002s
I20260709 13:06:30.335616 20142 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.338163 20142 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:30.320737 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.322387 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.340066 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.173758 20187 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.328874 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.334823 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.342324 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:30.343359 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.349483 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 187798us
I20260709 13:06:30.169664 20024 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:30.345248 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 183058us
I20260709 13:06:30.352123 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:30.347121 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.354233 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:30.174726 20021 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:30.355485 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.184038 19935 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:30.182958 20182 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.160766 20121 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.183s
I20260709 13:06:30.324652 20049 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.329866 20159 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.331601 20119 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:30.385299 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:30.357810 20021 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.353225 20187 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:30.407812 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:30.315891 20195 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:30.397415 16146 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.776s (SENT) [suppressed 24 similar messages]
I20260709 13:06:30.358187 20024 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.415617 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.418542 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.419983 15442 raft_consensus.cc:606] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:30.381708 20182 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.443681 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:30.437253 20024 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:30.409283 20119 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.455695 19334 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:30.456760 19334 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:30.413817 20078 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.457237 19334 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:30.446877 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:30.410069 20142 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:30.441344 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.509222 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:30.452669 20173 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:30.503121 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:30.483316 20142 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.481819 20099 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:30.534847 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:30.542038 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.553442 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:30.554612 15442 raft_consensus.cc:606] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:30.555112 15442 raft_consensus.cc:614] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:30.561354 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:30.529896 20157 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:30.568126 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:30.538092 20142 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.536535 20216 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.537873 20099 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:30.588191 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.558988 20121 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:30.567414 20078 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:30.624974 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:30.615805 20078 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.637183 20078 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:30.640128 15436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:30.640905 15436 raft_consensus.cc:606] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:30.641120 20222 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.642135 20222 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.641296 15436 raft_consensus.cc:614] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:30.604267 20099 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:30.652153 20213 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:06:30.656423 20100 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:30.666800 19334 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:30.545120 20173 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.706137 19334 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:30.675704 20200 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.005s
I20260709 13:06:30.614629 20121 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.603060 20216 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:30.724375 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 156385us
I20260709 13:06:30.743079 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:30.744100 15438 raft_consensus.cc:606] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:30.746969 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:30.748276 15435 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
W20260709 13:06:30.775998 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 378626us
I20260709 13:06:30.736529 20195 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:30.714504 20200 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:30.788872 20195 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:30.795459 19998 consensus_meta.cc:287] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.006s
I20260709 13:06:30.804852 20121 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:30.805593 20121 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.805262 19998 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:30.806125 20121 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.802840 20200 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:30.810742 20137 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.811381 19998 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:30.811342 20137 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.813771 20137 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:30.797036 20221 log.cc:927] Time spent T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:30.818542 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:30.819360 15438 raft_consensus.cc:606] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:30.800264 20170 consensus_meta.cc:287] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.010s
I20260709 13:06:30.824574 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:06:30.833702 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 214008us
I20260709 13:06:30.854884 15556 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:30.804178 20195 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.877363 15556 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:30.882685 15556 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:30.912106 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:30.885123 20217 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.902884 20100 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.920270 20121 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:30.826807 20159 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:30.850090 19998 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.830235 20170 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:30.948136 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:30.949473 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.957892 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2971) took 2877 ms. Trace:
I20260709 13:06:30.959810 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 913) took 1417 ms. Trace:
I20260709 13:06:30.960645 15517 rpcz_store.cc:276] 0709 13:06:29.542093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.637045 (+ 94952us) service_pool.cc:224] Handling call
0709 13:06:29.637421 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.844256 (+206835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.844296 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.844343 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:29.844407 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.959372 (+1114965us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54003f66d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:30.959462 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.959718 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475107072}
I20260709 13:06:30.962555 15516 rpcz_store.cc:276] 0709 13:06:28.080315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.040273 (+959958us) service_pool.cc:224] Handling call
0709 13:06:29.040744 (+   471us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:29.999923 (+959179us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b2c000603d8. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a007291 00007fcf7a0220ca 00007fcf7bd504ad 00007fcf7bd56e1b 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:06:30.029717 (+ 29794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.029748 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:30.479784 (+450036us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b2c00031148. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:06:30.514506 (+ 34722us) log.cc:844] Serialized 52 byte log entry
0709 13:06:30.752229 (+237723us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:30.767842 (+ 15613us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.956403 (+188561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.957504 (+  1101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.957567 (+    63us) raft_consensus.cc:1685] finished
0709 13:06:30.957585 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.957807 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52590,"prepare.queue_time_us":19725,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1760,"raft.queue_time_us":252364,"raft.run_cpu_time_us":538,"raft.run_wall_time_us":539,"spinlock_wait_cycles":144546432,"thread_start_us":460543,"threads_started":3,"wal-append.queue_time_us":326229}
I20260709 13:06:30.947197 20121 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.944012 20223 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.982005 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:30.982852 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:30.929838 20142 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:30.968441 20049 consensus_meta.cc:287] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.005s
I20260709 13:06:30.985558 15517 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:30.987211 20078 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:30.988834 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:30.991101 15516 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
I20260709 13:06:31.016875 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:31.017951 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:31.018685 15516 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.995934 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:30.996411 20183 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:30.956586 20184 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.973261 20192 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:30.951100 20100 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.947788 20217 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:30.952226 20173 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.019224 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:30.997671 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2858) took 1067 ms. Trace:
I20260709 13:06:30.948127 19998 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.028522 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:31.030997 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:30.977679 20218 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:31.035471 15592 rpcz_store.cc:276] 0709 13:06:29.930522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.972502 (+ 41980us) service_pool.cc:224] Handling call
0709 13:06:29.972996 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.048562 (+ 75566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.997339 (+948777us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54000c1a54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:30.997581 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172076928}
I20260709 13:06:30.984650 20216 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.044140 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:31.047181 15592 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:31.044551 15589 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:06:31.052032 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:31.054031 19334 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:06:31.054031 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 274640us
I20260709 13:06:31.057776 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.047376 20218 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.009075 20121 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.028667 20049 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:31.067436 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.069868 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:31.009435 20119 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:31.046576 20100 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.072625 20142 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.044936 20192 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.077483 15516 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:31.079263 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.056732 20173 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.043620 20217 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.088615 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:31.074996 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 101825us
I20260709 13:06:31.044621 20184 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.085016 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:31.080440 20029 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:31.072631 19998 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.091001 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:31.070106 20089 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.069679 19949 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:31.097018 19961 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:31.080709 20234 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.120801 20183 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:31.125839 20183 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.128459 20183 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.135823 20100 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.140195 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:31.141026 15517 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:31.142212 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:31.142881 15517 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
W20260709 13:06:31.097587 20021 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.002s
I20260709 13:06:31.097752 20134 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:31.097957 20101 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.098731 20078 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:31.100298 20119 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:31.102596 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.169611 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.103907 15516 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:31.170332 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.180858 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2177) took 1027 ms. Trace:
I20260709 13:06:31.173736 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:31.181411 15516 rpcz_store.cc:276] 0709 13:06:30.153710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.084649 (+930939us) service_pool.cc:224] Handling call
0709 13:06:31.180776 (+ 96127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.104609 15514 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:31.143867 20121 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:31.150880 20187 consensus_meta.cc:287] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.696s	user 0.006s	sys 0.005s
I20260709 13:06:31.096616 20099 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:31.108701 20028 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.194128 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 2988) took 1814 ms. Trace:
I20260709 13:06:31.117898 20195 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.105147 20173 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.069931 20218 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:31.164870 20170 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:31.183137 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:31.160401 20183 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:31.186370 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 83875.1us
I20260709 13:06:31.180259 19998 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.114802 20089 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:31.189297 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.226295 15515 rpcz_store.cc:276] 0709 13:06:29.379368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.379505 (+   137us) service_pool.cc:224] Handling call
0709 13:06:31.193855 (+1814350us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000eb854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:31.194031 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182481280}
I20260709 13:06:31.162709 20200 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.195284 20134 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:31.183872 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.172447 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:31.164844 20021 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:31.257438 15437 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:31.242769 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.243070 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2998) took 1463 ms. Trace:
I20260709 13:06:31.227823 20216 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.258827 15517 rpcz_store.cc:276] 0709 13:06:29.779771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.199328 (+1419557us) service_pool.cc:224] Handling call
0709 13:06:31.242122 (+ 42794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.242570 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.242613 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.242678 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:31.242727 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.242813 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.242985 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.133328 20159 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.179845 20101 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:31.227154 20182 consensus_meta.cc:287] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.004s
I20260709 13:06:31.251036 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 918) took 1425 ms. Trace:
I20260709 13:06:31.225529 20121 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:31.254817 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 65612.2us
I20260709 13:06:31.245294 20178 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.225163 20187 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.265751 15515 rpcz_store.cc:276] 0709 13:06:29.825449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.249871 (+1424422us) service_pool.cc:224] Handling call
0709 13:06:31.250340 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.250590 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.250628 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.250690 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:31.250737 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.250811 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.250965 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.273396 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:31.121987 20234 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.289862 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:31.274473 15407 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:31.282580 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 213739us
I20260709 13:06:31.291934 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.298461 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 920) took 1432 ms. Trace:
I20260709 13:06:31.299166 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.255906 20170 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:31.294497 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2866) took 1361 ms. Trace:
I20260709 13:06:31.303864 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:31.298945 15515 rpcz_store.cc:276] 0709 13:06:29.866062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.284580 (+1418518us) service_pool.cc:224] Handling call
0709 13:06:31.285092 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.285325 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.285362 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.285425 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:31.285473 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.298251 (+ 12778us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.298379 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.230315 20028 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.265910 20029 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:31.307636 15407 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.309492 20159 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:31.327251 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.310035 20240 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:31.310083 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:31.252566 20183 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.312152 20119 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.336927 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:31.313851 20024 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.864s	user 0.012s	sys 0.003s
I20260709 13:06:31.282322 20182 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.314695 20228 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.301637 20195 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:31.360317 20195 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:31.360888 20195 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:31.254909 19998 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.342231 20024 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.365619 19998 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.315243 20137 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.366492 20137 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.316852 20089 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.287495 20121 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.367513 20024 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.368167 15584 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:31.342041 20119 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.317910 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:31.370515 15588 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.284614 20032 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:31.372128 20119 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.257881 20200 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.377128 20028 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.322175 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:31.303855 15591 rpcz_store.cc:276] 0709 13:06:29.932555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.030037 (+ 97482us) service_pool.cc:224] Handling call
0709 13:06:30.030350 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.108817 (+ 78467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.294085 (+1185268us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54000c1054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:31.294406 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164585344}
I20260709 13:06:31.330061 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3001) took 1323 ms. Trace:
I20260709 13:06:31.289796 20178 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:31.378733 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56773.4us
I20260709 13:06:31.273115 20142 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:31.379294 20200 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.379932 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:31.380061 15583 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:31.378845 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.326944 20078 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:31.304270 20134 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:31.327936 20159 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.381199 20078 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:31.381618 20159 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:31.382118 20119 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:31.379205 15515 rpcz_store.cc:276] 0709 13:06:30.006587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.328767 (+1322180us) service_pool.cc:224] Handling call
0709 13:06:31.329286 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.329548 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.329587 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.329650 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.329720 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.329795 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.329948 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.382740 20119 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.383173 20119 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:31.383496 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:31.384399 15515 raft_consensus.cc:2393] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 5: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:31.381836 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:31.385756 15591 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.342073 20223 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:31.381218 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:31.388420 20170 raft_consensus.cc:2804] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:31.388566 20099 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:31.388963 20170 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:31.389452 20170 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:31.389914 20122 consensus_meta.cc:287] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.065s	user 0.012s	sys 0.004s
I20260709 13:06:31.390401 20122 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.391710 20228 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.393196 15518 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:31.342547 20240 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:31.395143 20240 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.349463 20049 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:31.396572 20049 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:31.356746 20238 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:06:31.358464 20021 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:31.358582 20187 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.341778 19935 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.369737 20121 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.379801 20142 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:31.299850 20214 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.957s	user 0.000s	sys 0.007s
I20260709 13:06:31.381003 20178 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:31.395830 15509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.011s	sys 0.017s
I20260709 13:06:31.333678 20112 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:31.272467 20216 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.317178 20234 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.346990 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 919) took 1481 ms. Trace:
I20260709 13:06:31.460773 15517 rpcz_store.cc:276] 0709 13:06:29.865740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.259906 (+1394166us) service_pool.cc:224] Handling call
0709 13:06:31.288590 (+ 28684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.288848 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.288874 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.299776 (+ 10902us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.344317 (+ 44541us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:31.344380 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.344503 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.346676 (+  2173us) raft_consensus.cc:1685] finished
0709 13:06:31.346701 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.346909 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":44055,"threads_started":1,"wal-append.queue_time_us":44569}
W20260709 13:06:31.461925 15509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.020s	sys 0.022s
W20260709 13:06:31.404819 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71555.3us
I20260709 13:06:31.405284 15588 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:06:31.378654 20173 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.413138 15591 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
W20260709 13:06:31.460453 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 161742us
I20260709 13:06:31.466815 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.467312 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.468128 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:31.477478 15588 raft_consensus.cc:2393] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 5: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:31.399451 20049 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:31.473193 20183 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.438146 20134 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:31.414938 20242 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:06:31.398914 20217 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.409554 20078 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:31.510079 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.510330 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.512202 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:31.513099 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:31.513967 15435 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:31.524066 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.526889 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.408075 19935 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:31.531064 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2296) took 1571 ms. Trace:
I20260709 13:06:31.531695 15443 rpcz_store.cc:276] 0709 13:06:29.959533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.959694 (+   161us) service_pool.cc:224] Handling call
0709 13:06:29.960044 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.026537 (+ 66493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.530689 (+1504152us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b5400225bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:31.530964 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151480064}
I20260709 13:06:31.532505 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:31.534231 15511 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:31.535651 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:31.536598 15511 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:31.537626 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:31.459582 20121 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:31.485893 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 92773.5us
I20260709 13:06:31.484364 20049 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.492322 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:31.551627 15438 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:31.552223 15517 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:31.494545 20215 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.979s	user 0.000s	sys 0.003s
I20260709 13:06:31.484156 20032 consensus_queue.cc:1059] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:06:31.497555 20216 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:31.497701 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 917) took 1767 ms. Trace:
I20260709 13:06:31.598599 15514 rpcz_store.cc:276] 0709 13:06:29.730640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.016441 (+285801us) service_pool.cc:224] Handling call
0709 13:06:30.016809 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.183936 (+1167127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.497425 (+313489us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400203fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:31.497637 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501020928}
I20260709 13:06:31.600149 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:31.498620 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2997) took 1734 ms. Trace:
I20260709 13:06:31.498558 20134 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.541131 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.543936 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:31.610994 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 82485.4us
I20260709 13:06:31.624399 15514 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:31.547132 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.547335 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.438230 20028 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:06:31.552250 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.571702 15406 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.594161 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:31.601341 15518 rpcz_store.cc:276] 0709 13:06:29.764479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.138258 (+373779us) service_pool.cc:224] Handling call
0709 13:06:30.138747 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.393663 (+1254916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.498369 (+104706us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400212d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:31.498553 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2884498304}
I20260709 13:06:31.485687 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:31.607780 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 299466us
I20260709 13:06:31.548310 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.410354 19961 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:06:31.628252 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.629758 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.635716 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.636395 15439 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:31.634362 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:31.635124 15511 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:31.641196 15511 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:31.641294 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 155704us
I20260709 13:06:31.641894 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3004) took 1543 ms. Trace:
I20260709 13:06:31.642510 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.642339 15511 rpcz_store.cc:276] 0709 13:06:30.098724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.640667 (+1541943us) service_pool.cc:224] Handling call
0709 13:06:31.641014 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.641648 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.641839 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.644755 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3006) took 1513 ms. Trace:
I20260709 13:06:31.645161 15511 rpcz_store.cc:276] 0709 13:06:30.131316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.643952 (+1512636us) service_pool.cc:224] Handling call
0709 13:06:31.644251 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.644442 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.644469 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.644512 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:31.644545 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.644597 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.644702 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.647257 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3007) took 1503 ms. Trace:
W20260709 13:06:31.650292 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 78743.2us
I20260709 13:06:31.650134 15511 rpcz_store.cc:276] 0709 13:06:30.143873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.646419 (+1502546us) service_pool.cc:224] Handling call
0709 13:06:31.646743 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.646924 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.646949 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.646994 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:31.647040 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.647093 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.647200 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.651427 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.653072 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2178) took 1499 ms. Trace:
W20260709 13:06:31.651178 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 60385.2us
I20260709 13:06:31.653558 15511 rpcz_store.cc:276] 0709 13:06:30.154165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.651823 (+1497658us) service_pool.cc:224] Handling call
0709 13:06:31.652393 (+   570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.652689 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.652717 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.652767 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.652800 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.652860 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.653005 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.656569 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.596113 20080 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.544461 19935 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.656837 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2167) took 1972 ms. Trace:
I20260709 13:06:31.667956 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2999) took 1882 ms. Trace:
W20260709 13:06:31.669801 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 117648us
I20260709 13:06:31.671007 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.672505 15435 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:31.672497 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:31.624163 20185 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.676849 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:31.677592 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:31.678376 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:31.667230 15512 rpcz_store.cc:276] 0709 13:06:29.688743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.853559 (+164816us) service_pool.cc:224] Handling call
0709 13:06:29.853935 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.854408 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.854446 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.920639 (+ 66193us) log.cc:844] Serialized 26 byte log entry
0709 13:06:30.189267 (+268628us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:30.496239 (+306972us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.497008 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.497130 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.242164 (+745034us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:31.638444 (+396280us) raft_consensus.cc:1685] finished
0709 13:06:31.656609 (+ 18165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.656773 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":163270,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3864,"raft.queue_time_us":2356,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":276,"spinlock_wait_cycles":22781184,"thread_start_us":414721,"threads_started":2,"wal-append.queue_time_us":421241}
I20260709 13:06:31.688342 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2181) took 1530 ms. Trace:
I20260709 13:06:31.688787 15512 rpcz_store.cc:276] 0709 13:06:30.158166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.687427 (+1529261us) service_pool.cc:224] Handling call
0709 13:06:31.687777 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.687975 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.688002 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.688049 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:31.688082 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.688136 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.688266 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.675163 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:31.690251 15512 raft_consensus.cc:1240] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:31.683305 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:31.693408 15590 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:31.696534 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 924) took 1527 ms. Trace:
I20260709 13:06:31.697975 15512 rpcz_store.cc:276] 0709 13:06:30.168556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.689778 (+1521222us) service_pool.cc:224] Handling call
0709 13:06:31.690077 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.695607 (+  5530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.696274 (+   667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.650897 20245 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.611145 20217 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:06:31.664058 20029 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:31.668947 15516 rpcz_store.cc:276] 0709 13:06:29.785869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.245407 (+1459538us) service_pool.cc:224] Handling call
0709 13:06:31.245865 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:31.252723 (+  6858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.252761 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:31.257932 (+  5171us) log.cc:844] Serialized 52 byte log entry
0709 13:06:31.407740 (+149808us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:31.643312 (+235572us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.667436 (+ 24124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.667595 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.667657 (+    62us) raft_consensus.cc:1685] finished
0709 13:06:31.667677 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.667872 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43042,"raft.queue_time_us":24789,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":20494,"spinlock_wait_cycles":751872,"thread_start_us":328830,"threads_started":2,"wal-append.queue_time_us":239171}
I20260709 13:06:31.658918 20254 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:31.622723 20121 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.664474 20236 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:31.717191 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.717469 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:31.688527 20173 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:31.704573 20183 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:31.724925 15516 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:31.738300 15517 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:31.739813 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:31.741261 15435 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:31.710098 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:31.712499 20176 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.735277 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3009) took 1562 ms. Trace:
I20260709 13:06:31.797322 15512 rpcz_store.cc:276] 0709 13:06:30.172722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.703153 (+1530431us) service_pool.cc:224] Handling call
0709 13:06:31.707278 (+  4125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.709831 (+  2553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.710053 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.710344 (+   291us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.710575 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.710963 (+   388us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.735198 (+ 24235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.684644 20225 consensus_queue.cc:1059] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:06:31.787335 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3010) took 1611 ms. Trace:
I20260709 13:06:31.788224 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3011) took 1471 ms. Trace:
I20260709 13:06:31.719851 20216 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:31.805444 15516 rpcz_store.cc:276] 0709 13:06:30.176170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.721000 (+1544830us) service_pool.cc:224] Handling call
0709 13:06:31.724736 (+  3736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.787082 (+ 62346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.787272 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.681537 20080 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.704682 20185 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.831166 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:31.823235 15516 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.723975 20029 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:31.828011 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:31.834342 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3012) took 1500 ms. Trace:
I20260709 13:06:31.737601 20122 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.807216 15517 rpcz_store.cc:276] 0709 13:06:30.317282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.787128 (+1469846us) service_pool.cc:224] Handling call
0709 13:06:31.787483 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.787725 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.787768 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.787832 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:31.787888 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.787970 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.788148 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.836973 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:31.820469 16173 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:31.840250 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2987) took 2456 ms. Trace:
I20260709 13:06:31.801743 20028 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:31.853271 20246 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:06:31.852650 15513 rpcz_store.cc:276] 0709 13:06:29.379016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.379172 (+   156us) service_pool.cc:224] Handling call
0709 13:06:29.379733 (+   561us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:29.411860 (+ 32127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.411912 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:29.412828 (+   916us) log.cc:844] Serialized 52 byte log entry
0709 13:06:30.083477 (+670649us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18002a1fc0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:30.171900 (+ 88423us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:30.171945 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.172023 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.493876 (+1321853us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:31.835167 (+341291us) raft_consensus.cc:1685] finished
0709 13:06:31.835198 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.835392 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31498,"raft.queue_time_us":36238,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":16876,"spinlock_wait_cycles":51944192,"thread_start_us":88109,"threads_started":1,"wal-append.queue_time_us":1013451}
I20260709 13:06:31.836021 15516 rpcz_store.cc:276] 0709 13:06:30.333809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.808557 (+1474748us) service_pool.cc:224] Handling call
0709 13:06:31.819777 (+ 11220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.833983 (+ 14206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.834267 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.836884 20029 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:31.847800 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2185) took 1493 ms. Trace:
I20260709 13:06:31.801542 20234 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.856772 15517 rpcz_store.cc:276] 0709 13:06:30.354456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.846839 (+1492383us) service_pool.cc:224] Handling call
0709 13:06:31.847178 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.847378 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.847408 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.847454 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:31.847498 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.847629 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.847734 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.848261 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:31.802294 20245 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.861368 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3017) took 1438 ms. Trace:
I20260709 13:06:31.862212 15516 rpcz_store.cc:276] 0709 13:06:30.423568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.859040 (+1435472us) service_pool.cc:224] Handling call
0709 13:06:31.860326 (+  1286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.860948 (+   622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.860986 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.861037 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:31.861079 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.861153 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.861291 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.860924 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 141885us
I20260709 13:06:31.827606 20178 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:31.744272 20159 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.841054 20216 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:31.865689 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:31.807585 20176 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:31.876441 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3013) took 1507 ms. Trace:
I20260709 13:06:31.883435 15435 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:31.861151 20028 raft_consensus.cc:697] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:31.863732 20142 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:31.860920 20217 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:31.867895 20137 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:31.894060 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2164) took 2211 ms. Trace:
W20260709 13:06:31.899271 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 256115us
I20260709 13:06:31.957772 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:31.889400 15517 rpcz_store.cc:276] 0709 13:06:30.368845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.858049 (+1489204us) service_pool.cc:224] Handling call
0709 13:06:31.875873 (+ 17824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.876087 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.876118 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.876163 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:31.876194 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.876249 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.876376 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.882237 20101 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.004s
W20260709 13:06:31.943493 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 255073us
I20260709 13:06:31.944020 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3018) took 1501 ms. Trace:
I20260709 13:06:31.976560 15516 rpcz_store.cc:276] 0709 13:06:30.442866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.885822 (+1442956us) service_pool.cc:224] Handling call
0709 13:06:31.886248 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.886517 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.886560 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.886625 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.886673 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.886751 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.943955 (+ 57204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.939567 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 222134us
I20260709 13:06:31.978662 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:31.864396 20234 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.954265 15510 rpcz_store.cc:276] 0709 13:06:29.682602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.855053 (+172451us) service_pool.cc:224] Handling call
0709 13:06:29.855402 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:29.921213 (+ 65811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.921244 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:29.944837 (+ 23593us) log.cc:844] Serialized 52 byte log entry
0709 13:06:31.225499 (+1280662us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b180034bca0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:31.344068 (+118569us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:31.699503 (+355435us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.873840 (+174337us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.874386 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.876996 (+  2610us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.893792 (+ 16796us) raft_consensus.cc:1685] finished
0709 13:06:31.893816 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.893994 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114589,"prepare.queue_time_us":359673,"prepare.run_wall_time_us":42,"raft.queue_time_us":82337,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":41855,"spinlock_wait_cycles":22715136,"thread_start_us":620787,"threads_started":3,"wal-append.queue_time_us":1594379}
I20260709 13:06:31.878569 20233 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:31.869122 20245 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:31.971498 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 114427us
I20260709 13:06:31.939013 20122 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.984205 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3020) took 1500 ms. Trace:
W20260709 13:06:31.970623 20246 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:06:31.991237 15586 raft_consensus.cc:1240] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:31.899618 20176 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.890828 20145 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:06:31.952625 20223 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:31.994808 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:32.010218 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:31.877324 20178 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:31.974712 19991 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:32.019996 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.020910 15592 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:32.020030 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.022527 15589 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
W20260709 13:06:32.023277 20170 consensus_meta.cc:287] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.006s
I20260709 13:06:32.023826 20170 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.025082 15513 raft_consensus.cc:1240] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:32.006871 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3021) took 1503 ms. Trace:
I20260709 13:06:32.027046 15517 rpcz_store.cc:276] 0709 13:06:30.503980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.987845 (+1483865us) service_pool.cc:224] Handling call
0709 13:06:32.006354 (+ 18509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.006556 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.006582 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.006624 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:32.006657 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.006711 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.006811 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.030694 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:31.966697 20217 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:31.888067 20119 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.010957 15586 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:31.997084 20122 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:32.013419 20218 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.761s	user 0.013s	sys 0.000s
I20260709 13:06:32.038570 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3022) took 1533 ms. Trace:
I20260709 13:06:32.014411 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.016768 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.040020 15590 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:32.019351 20178 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:32.025075 20188 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:31.997141 20222 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:32.036981 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.047842 15589 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:32.004437 20264 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.039018 15517 rpcz_store.cc:276] 0709 13:06:30.504782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.029013 (+1524231us) service_pool.cc:224] Handling call
0709 13:06:32.038030 (+  9017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.038221 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.038247 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.038291 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:32.038323 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.038376 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.038505 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.053335 15517 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:31.986346 20101 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.042964 15592 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:32.055296 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3023) took 1540 ms. Trace:
I20260709 13:06:32.055799 15517 rpcz_store.cc:276] 0709 13:06:30.514765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.052828 (+1538063us) service_pool.cc:224] Handling call
0709 13:06:32.053160 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.055001 (+  1841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.055232 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.026503 19692 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:06:32.000582 15510 rpcz_store.cc:276] 0709 13:06:30.484419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.983258 (+1498839us) service_pool.cc:224] Handling call
0709 13:06:31.983643 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.983842 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.983867 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.983914 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:31.983956 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.984013 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.984136 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.995393 20233 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.054332 20028 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.011464 20216 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.076834 20170 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:32.074179 15585 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:32.081490 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3024) took 1551 ms. Trace:
I20260709 13:06:32.065672 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:32.082161 15517 rpcz_store.cc:276] 0709 13:06:30.530122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.056804 (+1526682us) service_pool.cc:224] Handling call
0709 13:06:32.080967 (+ 24163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.081166 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.081190 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.081230 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:32.081258 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.081307 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.081418 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.083858 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:32.052412 20264 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:32.067466 20256 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.206s	user 0.002s	sys 0.002s
I20260709 13:06:32.066409 19991 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:32.028939 20223 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.063448 20121 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.085696 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.101123 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.044869 20218 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.092953 15510 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:06:32.104255 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 104538us
I20260709 13:06:32.105597 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3026) took 1560 ms. Trace:
I20260709 13:06:32.107590 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3025) took 1573 ms. Trace:
I20260709 13:06:32.105470 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:32.092536 15586 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:32.091291 20178 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:32.087076 20080 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.091710 20252 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:32.107972 15517 rpcz_store.cc:276] 0709 13:06:30.545526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.083417 (+1537891us) service_pool.cc:224] Handling call
0709 13:06:32.083915 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.084174 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.084213 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.084275 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:32.084325 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.084405 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.105523 (+ 21118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.138303 15586 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:32.103263 20275 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.092430 20274 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:06:32.135784 20264 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:32.179875 20276 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:32.166741 20225 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:32.180856 20225 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.181348 20225 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:32.167927 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54988us
I20260709 13:06:32.185375 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.191224 15586 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:32.193749 15586 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:32.202325 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 316789us
I20260709 13:06:32.097179 20185 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.108101 15510 rpcz_store.cc:276] 0709 13:06:30.533940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.070251 (+1536311us) service_pool.cc:224] Handling call
0709 13:06:32.070607 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.107179 (+ 36572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.107492 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.088562 20049 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.109077 20240 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.173491 16173 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:32.219175 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.220191 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.140096 20159 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.177110 20021 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.114959 20178 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.177659 20192 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.202586 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:32.136821 15588 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:32.184160 20264 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.167613 20252 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.212635 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 927) took 1425 ms. Trace:
I20260709 13:06:32.233933 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.216156 15592 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:32.216799 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.217108 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:32.218194 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.221726 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.223384 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.238291 15510 rpcz_store.cc:276] 0709 13:06:30.787138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.209450 (+1422312us) service_pool.cc:224] Handling call
0709 13:06:32.209797 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.210022 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.210055 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.210108 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:32.212306 (+  2198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.212413 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.212555 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.241175 15441 raft_consensus.cc:2393] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:32.219931 15442 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:32.192783 20089 consensus_queue.cc:1059] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:06:32.204727 20119 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.226420 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:32.231328 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.261188 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:32.183863 20278 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:06:32.214244 20100 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:32.242965 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.229705 20021 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:32.258419 20122 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.225642 20216 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.271930 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.235526 20178 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.248962 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3027) took 1431 ms. Trace:
I20260709 13:06:32.293716 15510 rpcz_store.cc:276] 0709 13:06:30.817764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.241380 (+1423616us) service_pool.cc:224] Handling call
0709 13:06:32.248181 (+  6801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.248454 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.248486 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.248553 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:32.248611 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.248694 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.248875 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.294775 20218 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.295473 15510 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:32.296241 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3028) took 1375 ms. Trace:
I20260709 13:06:32.296555 15510 rpcz_store.cc:276] 0709 13:06:30.920955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.294860 (+1373905us) service_pool.cc:224] Handling call
0709 13:06:32.295257 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.295945 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.296181 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.298301 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3029) took 1307 ms. Trace:
I20260709 13:06:32.298640 15510 rpcz_store.cc:276] 0709 13:06:30.990696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.297337 (+1306641us) service_pool.cc:224] Handling call
0709 13:06:32.297679 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.297892 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.297923 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.297973 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:32.298031 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.298093 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.298239 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.267026 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.213183 20280 consensus_queue.cc:1059] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:06:32.301239 20280 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.301631 20280 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:32.304674 20049 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:32.305784 20185 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.306419 20185 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.308897 20185 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.308756 20029 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.312047 20216 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.314513 20216 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.241843 20176 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.318257 20228 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.319239 20101 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.322824 20200 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:32.324159 20099 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.324633 20099 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:32.325676 20099 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.326786 20099 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.329900 20233 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:32.330818 19935 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.001s
I20260709 13:06:32.323390 20200 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:32.332753 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 2996) took 2568 ms. Trace:
I20260709 13:06:32.333069 20200 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.334435 20200 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.333181 15509 rpcz_store.cc:276] 0709 13:06:29.763987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.125872 (+361885us) service_pool.cc:224] Handling call
0709 13:06:30.126237 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:30.144372 (+ 18135us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:30.171302 (+ 26930us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.462414 (+1291112us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:31.476517 (+ 14103us) log.cc:844] Serialized 52 byte log entry
0709 13:06:31.476758 (+   241us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:31.792873 (+316115us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.794194 (+  1321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.332281 (+538087us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400296654. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:32.332334 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.332501 (+   167us) raft_consensus.cc:1685] finished
0709 13:06:32.332517 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.332690 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3813,"prepare.queue_time_us":428862,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":95,"raft.queue_time_us":25606,"raft.run_cpu_time_us":514,"raft.run_wall_time_us":43141,"spinlock_wait_cycles":31754112,"thread_start_us":1419286,"threads_started":2,"wal-append.queue_time_us":653850}
I20260709 13:06:32.338716 20176 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.235296 20252 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:32.274027 20281 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:06:32.275532 20195 consensus_meta.cc:287] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.914s	user 0.005s	sys 0.008s
I20260709 13:06:32.346046 20195 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.264143 20245 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.347885 15511 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:32.349330 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2180) took 2194 ms. Trace:
I20260709 13:06:32.349804 15511 rpcz_store.cc:276] 0709 13:06:30.154873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.655067 (+1500194us) service_pool.cc:224] Handling call
0709 13:06:31.655397 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.348360 (+692963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.348997 (+   637us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54001e4bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:32.349255 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591390080}
I20260709 13:06:32.350543 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.331338 19935 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.276754 20021 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.278041 20223 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:32.279243 20248 raft_consensus.cc:3055] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:32.283638 20184 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.352823 15586 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.351516 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3031) took 1249 ms. Trace:
I20260709 13:06:32.356563 15511 rpcz_store.cc:276] 0709 13:06:31.101789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.350726 (+1248937us) service_pool.cc:224] Handling call
0709 13:06:32.351011 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.351198 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.351224 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.351266 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:32.351296 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.351350 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.351449 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.353606 20021 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.359331 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3002) took 2304 ms. Trace:
I20260709 13:06:32.369218 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2187) took 1052 ms. Trace:
I20260709 13:06:32.369922 15516 rpcz_store.cc:276] 0709 13:06:31.317709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.367787 (+1050078us) service_pool.cc:224] Handling call
0709 13:06:32.368273 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.368599 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.368643 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.368709 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:32.368762 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.368850 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.369133 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.342233 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.376679 15591 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:32.381613 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.384572 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.385671 15516 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:32.388550 15510 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.432331 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:32.433104 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.433514 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3003) took 2346 ms. Trace:
W20260709 13:06:32.435608 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 440880us
I20260709 13:06:32.362892 15514 rpcz_store.cc:276] 0709 13:06:30.055401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.625292 (+1569891us) service_pool.cc:224] Handling call
0709 13:06:31.625690 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.625972 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:31.874784 (+248812us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.043917 (+169133us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.358347 (+314430us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b1800048760. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78be4c0a 00007fcf82324219 00007fcf7fc2b58f 00007fcf78c6a571 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd
0709 13:06:32.358871 (+   524us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.358946 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:32.359010 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.359101 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.359257 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":385829,"prepare.queue_time_us":281139,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":3597,"raft.queue_time_us":12511,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":19613,"spinlock_wait_cycles":64661248,"thread_start_us":348791,"threads_started":2,"wal-append.queue_time_us":186065}
W20260709 13:06:32.440717 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 236949us
I20260709 13:06:32.441515 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:32.447849 15439 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.447744 16181 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:32.448737 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.450791 15438 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:32.354130 19935 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:32.353176 20195 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.439410 15518 rpcz_store.cc:276] 0709 13:06:30.087676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.633556 (+1545880us) service_pool.cc:224] Handling call
0709 13:06:31.633910 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.634161 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:31.898328 (+264167us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.433100 (+534772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.433165 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:32.433214 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.433294 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.433444 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":370487,"prepare.queue_time_us":244697,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":23061,"thread_start_us":403437,"threads_started":2,"wal-append.queue_time_us":182260}
I20260709 13:06:32.396036 20222 raft_consensus.cc:697] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:32.478826 15435 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:06:32.453202 15438 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.481473 15441 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:32.463307 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:32.354928 20248 raft_consensus.cc:740] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:32.466231 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.467163 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:32.467409 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.467896 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:32.442510 20028 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:32.462109 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 313144us
I20260709 13:06:32.493891 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:32.480571 15438 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:32.488452 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.454864 20223 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:32.471655 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:32.495865 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 63667.1us
I20260709 13:06:32.501284 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:32.436841 20236 consensus_queue.cc:1059] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:06:32.504164 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.442971 20274 consensus_queue.cc:1059] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:06:32.509088 15442 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:32.513999 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:32.517712 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:32.522502 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.524705 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.526162 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.527132 15518 raft_consensus.cc:2410] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:06:32.529644 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.530491 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.531723 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.526243 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:32.500056 20223 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:32.535889 20223 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:32.495147 20142 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.539659 20142 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:32.542135 20142 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.545295 20225 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.550488 20142 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.551870 20285 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.551684 20142 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.552537 20285 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.554967 20285 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.556159 20142 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.531733 20288 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:06:32.503945 20101 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:32.557368 20288 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:32.557837 20288 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:32.557505 20101 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:32.558326 20239 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.328s	user 0.013s	sys 0.001s
I20260709 13:06:32.558797 20288 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:32.559754 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.559723 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2089) took 1815 ms. Trace:
I20260709 13:06:32.503613 20078 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:32.560854 20288 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:32.560693 15436 rpcz_store.cc:276] 0709 13:06:30.744469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.744735 (+   266us) service_pool.cc:224] Handling call
0709 13:06:30.764816 (+ 20081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:30.765522 (+   706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.765576 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:30.775178 (+  9602us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.065406 (+290228us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:31.065454 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.065530 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.557662 (+1492132us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:32.559341 (+  1679us) raft_consensus.cc:1685] finished
0709 13:06:32.559365 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.559649 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1239,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"spinlock_wait_cycles":22861056,"thread_start_us":257484,"threads_started":1,"wal-append.queue_time_us":379373}
I20260709 13:06:32.561739 20222 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.563462 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.564350 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2874) took 1893 ms. Trace:
I20260709 13:06:32.565956 20182 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.564781 15587 rpcz_store.cc:276] 0709 13:06:30.671501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.672041 (+   540us) service_pool.cc:224] Handling call
0709 13:06:30.705148 (+ 33107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.749753 (+ 44605us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:31.031964 (+282211us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.290115 (+258151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.290205 (+    90us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:31.290289 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.564094 (+1273805us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54001f4854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:32.564146 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.564291 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":352347,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":5025,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"spinlock_wait_cycles":101733248,"thread_start_us":501953,"threads_started":2,"wal-append.queue_time_us":290824,"wal-append.run_cpu_time_us":2723,"wal-append.run_wall_time_us":1227879}
I20260709 13:06:32.517081 20216 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:32.525504 20121 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:32.567569 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.568365 15587 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:32.569314 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:32.565145 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.508260 15438 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.567281 20216 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:32.581466 15518 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:32.581857 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:32.582877 15441 raft_consensus.cc:2393] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:32.581511 15438 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:32.583794 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 88750.4us
I20260709 13:06:32.577900 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.579521 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:32.584703 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:32.580313 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.586071 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.587765 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:32.589017 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.589856 15518 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:32.589107 15515 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:32.592600 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.594378 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:32.577840 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:32.600909 15442 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:32.602957 15514 raft_consensus.cc:2393] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:32.602725 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:32.603926 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:32.605273 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.605417 20217 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.606416 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.611126 15436 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:32.612577 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 160088us
I20260709 13:06:32.607487 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:32.496892 20145 consensus_queue.cc:1059] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:06:32.626513 15438 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:32.629905 15514 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:32.525128 20269 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:32.637364 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 52773.2us
I20260709 13:06:32.643163 15556 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.500075 20028 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:32.641501 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.575836 20078 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.645311 20145 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.647744 20188 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:32.651154 19935 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.651921 20290 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.632100 20015 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:32.668737 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.673229 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.674664 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.580716 20032 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:06:32.657174 20229 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:32.677112 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.682855 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:32.683688 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.659508 20078 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.661113 20145 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:32.661401 20225 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.678095 20015 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.705528 20015 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:32.708092 20078 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.710530 20078 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:32.712464 20013 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:06:32.671787 20100 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:32.681167 20218 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:32.692652 20192 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:32.714614 20229 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.678740 20185 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:32.715047 20100 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.670902 19935 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.715513 20100 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:32.686239 20289 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:32.716531 20100 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.717514 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2084) took 1425 ms. Trace:
I20260709 13:06:32.717902 15592 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:32.718626 20271 raft_consensus.cc:3055] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:32.688267 20170 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:32.719165 20271 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:32.686561 20269 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:32.722036 20271 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.693619 20028 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.717905 15585 rpcz_store.cc:276] 0709 13:06:31.292149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.298876 (+  6727us) service_pool.cc:224] Handling call
0709 13:06:32.717252 (+1418376us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540015ead4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:32.717419 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780079872}
I20260709 13:06:32.675848 20285 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.695952 20216 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.665827 20157 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:32.678911 20101 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:32.727252 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 43751.9us
I20260709 13:06:32.728322 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.727212 20200 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:06:32.677778 20290 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.703644 20178 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.740765 20178 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.704284 20145 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.742112 20145 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:32.745143 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.745751 20290 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.746678 15591 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.748661 19935 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:32.749495 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.749802 20099 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:32.715358 15584 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:32.751395 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:32.729055 15586 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:32.730301 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:32.752838 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:32.750259 15591 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:32.686920 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:32.737357 15556 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.731288 20101 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.762852 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:32.755649 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.758666 15587 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:32.764465 15591 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:32.766023 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:32.767076 15591 raft_consensus.cc:2393] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:32.759409 15584 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:32.751447 20288 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.785854 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2090) took 1476 ms. Trace:
W20260709 13:06:32.785732 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 98872.4us
I20260709 13:06:32.787173 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.787981 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 925) took 2420 ms. Trace:
I20260709 13:06:32.788295 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:32.788421 15513 rpcz_store.cc:276] 0709 13:06:30.367411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.855148 (+1487737us) service_pool.cc:224] Handling call
0709 13:06:31.855500 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.025838 (+170338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.787744 (+761906us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540036a1d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:32.787917 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389550336}
I20260709 13:06:32.789341 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:32.784848 16146 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.008s	sys 0.008s
W20260709 13:06:32.791313 16146 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.008s	sys 0.008s
I20260709 13:06:32.786355 15588 rpcz_store.cc:276] 0709 13:06:31.309313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.478187 (+168874us) service_pool.cc:224] Handling call
0709 13:06:32.785647 (+1307460us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540024ac54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:32.785789 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180887296}
I20260709 13:06:32.792303 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:32.793982 15583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2083) took 1502 ms (client timeout 1838 ms). Trace:
I20260709 13:06:32.717902 20100 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.792927 15591 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:32.794432 15586 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:32.729405 20285 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:32.795148 15583 rpcz_store.cc:269] 0709 13:06:31.291765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.292865 (+  1100us) service_pool.cc:224] Handling call
0709 13:06:32.793767 (+1500902us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b540028b4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:32.793919 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119296768}
W20260709 13:06:32.794307 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 577421us
I20260709 13:06:32.798061 15591 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:32.779389 20288 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:32.800787 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:32.801590 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:32.801787 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:32.802503 15517 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:32.773451 19935 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:32.760066 20101 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:32.729861 20157 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:06:32.806692 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:32.784868 20178 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:32.808471 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:32.790308 20021 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:32.796223 20028 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:32.792177 20078 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:32.812342 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:32.816469 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:32.780159 20015 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.796478 20245 consensus_queue.cc:1059] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:32.810222 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:33.036315 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.023942 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.032567 15513 raft_consensus.cc:1240] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:33.042201 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:33.031225 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.044375 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 234012us
I20260709 13:06:33.047369 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:33.050351 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.053586 15586 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:33.055013 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:33.057245 15337 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 11 to 14, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:33.051232 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:33.064164 20170 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:32.846364 20101 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.064853 20170 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.065364 20137 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:32.811123 20222 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.066236 20137 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.066895 20137 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:32.859438 20089 consensus_queue.cc:1059] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.205s
I20260709 13:06:33.065559 20170 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:32.807530 19935 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:32.821646 20021 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:32.850849 20029 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.082219 19935 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:33.083871 20015 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:32.851032 20223 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.832600 20290 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.266s
I20260709 13:06:33.093027 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:33.093770 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:32.876390 20278 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:33.095773 20278 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:32.819679 20028 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.097088 20028 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.097510 20278 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:32.811123 20250 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.291s
I20260709 13:06:33.100585 20021 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.101342 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.102438 20089 raft_consensus.cc:3055] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:33.102933 20089 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:32.818455 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:33.102741 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:33.110051 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.113888 15510 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.818795 20252 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.878481 20280 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:32.803270 20269 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:33.117995 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:33.119109 20032 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:33.125514 20032 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.121258 20245 raft_consensus.cc:3055] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.128778 20245 raft_consensus.cc:740] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:33.130218 20245 consensus_queue.cc:260] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.121881 20250 consensus_queue.cc:1243] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:33.120189 15585 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:33.132889 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.133671 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.133920 15438 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:33.134470 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:32.858299 20288 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.138284 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:33.139180 15513 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:06:33.139240 15435 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:33.139498 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:33.122543 20280 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.140365 15514 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:33.166242 20032 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.166348 20222 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.168620 20222 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:32.924572 20265 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:33.171577 20265 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:32.923468 20248 consensus_queue.cc:260] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.173780 20248 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.887694 20240 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:33.174767 20240 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:33.146596 15337 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 11, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 11 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:33.183261 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:32.925730 20272 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:33.185034 20272 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:33.189677 20078 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.190713 20078 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.194273 15592 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:33.203035 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3030) took 2174 ms. Trace:
W20260709 13:06:33.208730 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 157811us
W20260709 13:06:32.903501 20293 consensus_queue.cc:1175] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d225833a2cbf4a5995fdbbb1292d1918" responder_term: 5 status { last_received { term: 4 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:33.173400 20265 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.179934 20278 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.929530 20234 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.235791 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.249308 20245 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.252279 20240 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.254710 20240 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:33.259689 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:33.261750 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:33.262742 15588 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:33.228713 20269 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.265946 20269 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.272246 15337 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 12 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.273710 20269 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.276628 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 926) took 2674 ms. Trace:
I20260709 13:06:33.277129 15517 rpcz_store.cc:276] 0709 13:06:30.602432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.166233 (+1563801us) service_pool.cc:224] Handling call
0709 13:06:32.166781 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.804352 (+637571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.275969 (+471617us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54000ec754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:33.276334 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461478272}
I20260709 13:06:33.287945 20078 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.289970 20271 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.294595 16178 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:33.295158 16178 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:33.296459 16178 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.172792 20089 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.298518 16178 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:33.303009 20089 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.308665 20223 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:33.308703 15434 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:33.310225 16179 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 3.
I20260709 13:06:33.314211 19692 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.309733 16181 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:33.316068 20015 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.230011 20137 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.254798 19949 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:33.317448 20176 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:33.317708 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:33.187028 20272 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.315126 19692 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.329663 15440 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:33.329347 20176 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:33.371827 20029 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.372866 20029 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.374897 15437 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:33.375941 20302 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.169s	user 0.000s	sys 0.005s
I20260709 13:06:33.377208 20234 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:33.377935 20234 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.378376 20234 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.380256 20078 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.381676 19692 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.382699 20272 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.388125 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:33.390579 20145 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:33.356841 20248 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:06:33.392688 20291 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:33.393144 20291 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:06:33.394591 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.394371 20291 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.395838 19949 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.397764 20291 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.394351 20137 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.333396 20015 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.402433 20015 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:33.404247 20176 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.405722 20176 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.408737 15585 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:33.381106 20078 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.209699 15509 rpcz_store.cc:276] 0709 13:06:31.028230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.335499 (+1307269us) service_pool.cc:224] Handling call
0709 13:06:32.341729 (+  6230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.342015 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:33.029799 (+687784us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.136403 (+106604us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.152864 (+ 16461us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:33.178803 (+ 25939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.202543 (+ 23740us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.202788 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":686884,"prepare.queue_time_us":728163,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":153,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":3450,"spinlock_wait_cycles":5693312,"thread_start_us":47691,"threads_started":1,"wal-append.queue_time_us":147273}
I20260709 13:06:33.441198 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.367580 20222 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
W20260709 13:06:33.448756 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.422219 20078 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.426688 19949 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:33.463943 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:33.475816 15585 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:33.478284 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.480001 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.486801 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:33.487279 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.472601 15517 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:33.491736 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.506163 15509 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:33.507160 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:33.508508 20101 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.512688 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:33.520859 15592 raft_consensus.cc:1240] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:33.526122 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.528909 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 288454us
W20260709 13:06:33.536497 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.497584 20252 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:33.517056 20240 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.520838 20078 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.553287 15441 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:33.563277 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:33.564245 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.564435 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 517) took 1074 ms. Trace:
W20260709 13:06:33.565074 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.564870 15437 rpcz_store.cc:276] 0709 13:06:32.490013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.490198 (+   185us) service_pool.cc:224] Handling call
0709 13:06:33.292686 (+802488us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b5800003698. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:06:33.340756 (+ 48070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.375524 (+ 34768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.546566 (+171042us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5400120054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:33.557074 (+ 10508us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b5400120050. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:33.564337 (+  7263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178806400}
I20260709 13:06:33.566146 20288 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.541412 20223 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:33.567158 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:33.570365 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.544252 20248 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.567210 20223 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:33.574867 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.576007 20222 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.576835 20222 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.583964 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.588265 15585 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:33.593366 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:33.590348 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.540055 19935 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.604552 20288 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:33.611526 20137 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:33.596091 20222 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:33.561401 19949 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:06:33.627300 15442 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:33.634202 20032 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:33.634716 20032 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:33.637188 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.637321 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 213838us
I20260709 13:06:33.621598 20137 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:33.626911 20028 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.006s
I20260709 13:06:33.606910 20240 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.652891 15584 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:33.647209 20137 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.642469 20288 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.625442 20078 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.659814 19991 consensus_queue.cc:1059] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:06:33.681559 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 118398us
I20260709 13:06:33.683485 15588 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:33.681120 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:33.690407 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.665411 20028 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.667994 15556 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:33.635845 20032 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.672469 19991 raft_consensus.cc:3055] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:33.703694 19991 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:33.704891 19991 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.706588 19991 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.714052 15556 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:33.715173 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:33.721089 20223 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:33.721120 20029 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:33.726122 20264 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:33.726132 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 935) took 1012 ms. Trace:
I20260709 13:06:33.729867 20265 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:33.738377 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 74324.2us
I20260709 13:06:33.739137 20293 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:33.739244 20248 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.740233 20240 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:33.759910 20310 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.762213 20288 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:33.762909 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.754348 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 78427.6us
W20260709 13:06:33.770430 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.767494 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53578.1us
I20260709 13:06:33.750407 15516 rpcz_store.cc:276] 0709 13:06:32.713276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.716468 (+  3192us) service_pool.cc:224] Handling call
0709 13:06:32.716779 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.717040 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:33.033422 (+316382us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.698359 (+664937us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.698445 (+    86us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:33.698511 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.702756 (+  4245us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.725888 (+ 23132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":343529,"prepare.queue_time_us":353704,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":88,"raft.queue_time_us":91741,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":141,"thread_start_us":616793,"threads_started":2,"wal-append.queue_time_us":255208}
I20260709 13:06:33.703130 19935 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:33.771620 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71226.4us
I20260709 13:06:33.775514 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:33.763741 20278 consensus_meta.cc:287] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.003s
I20260709 13:06:33.779042 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:33.766599 20021 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:33.768091 20028 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.785435 20252 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:33.791164 20032 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.791532 20252 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.792536 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:33.785872 20021 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:33.795393 20252 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.796722 20310 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.780615 20293 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:33.816960 16178 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.518s	user 0.016s	sys 0.000s
I20260709 13:06:33.817808 16178 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:33.804225 20021 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:33.819993 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44601.3us
W20260709 13:06:33.819419 20244 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:06:33.831336 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 2892) took 1294 ms. Trace:
I20260709 13:06:33.813604 19935 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.815480 20264 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.812672 20278 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:06:33.837879 20142 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:06:33.841791 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:33.854549 20310 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.825217 20240 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:06:33.855352 20310 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.832268 15589 rpcz_store.cc:276] 0709 13:06:32.459778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.680808 (+221030us) service_pool.cc:224] Handling call
0709 13:06:32.793933 (+113125us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:32.809276 (+ 15343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.809316 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:32.818038 (+  8722us) log.cc:844] Serialized 52 byte log entry
0709 13:06:33.311716 (+493678us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:33.313825 (+  2109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.439308 (+125483us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b540028b4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:33.439366 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.591078 (+151712us) raft_consensus.cc:1685] finished
0709 13:06:33.591107 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.754015 (+162908us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540028b4d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:33.754185 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1997,"raft.queue_time_us":2648,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7586,"spinlock_wait_cycles":264557184,"thread_start_us":170113,"threads_started":1,"wal-append.queue_time_us":411801}
I20260709 13:06:33.866626 20293 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.873577 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:33.876772 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 97033us
W20260709 13:06:33.869184 20170 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.009s
I20260709 13:06:33.861985 20078 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.885188 20028 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:33.885468 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43835.5us
I20260709 13:06:33.886294 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:33.889223 20089 consensus_meta.cc:287] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.009s
W20260709 13:06:33.898222 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.856869 19935 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.902819 20310 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.881246 20240 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.903710 15516 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:33.862123 20234 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.884584 20264 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:33.903759 20222 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.915051 20222 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:33.918529 20222 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.930009 19935 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:33.932945 20234 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:33.935240 20145 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.004s
I20260709 13:06:33.935835 20145 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:33.936854 20240 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:33.933969 16174 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 5.
I20260709 13:06:33.932590 20028 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:33.948254 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 103291us
I20260709 13:06:33.882831 20170 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:33.955331 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 96960.8us
I20260709 13:06:33.912375 20078 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:33.957939 15439 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:33.962915 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:33.964071 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:33.963889 15434 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:33.906327 20293 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:06:33.968123 20313 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:33.968956 16174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52910 (request call id 487) took 1168 ms. Trace:
I20260709 13:06:33.969477 20028 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.969417 16174 rpcz_store.cc:276] 0709 13:06:32.800346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.800491 (+   145us) service_pool.cc:224] Handling call
0709 13:06:33.968700 (+1168209us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b540060d954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:33.968862 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239769984}
I20260709 13:06:33.972503 20029 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:33.973251 20013 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:33.973733 20013 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:33.973964 20029 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:33.973069 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:33.981046 15509 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:33.959439 20264 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:33.974380 20029 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:33.987524 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:33.984411 20308 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.106s	user 0.000s	sys 0.002s
I20260709 13:06:33.990449 20248 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.992552 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:33.968995 20313 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:33.993268 20170 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:33.981359 19935 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.006738 20145 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:34.006218 19950 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:33.985302 20240 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:34.023269 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:33.982272 19949 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.009740 20234 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:34.026927 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:34.024509 20145 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:34.028954 20029 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.031054 19961 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:34.031034 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.033002 19692 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:33.978360 20078 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.091043 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.040385 15589 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:34.040598 15588 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:34.041630 20137 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.043403 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.044209 15513 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:34.046195 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.047169 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.050585 20293 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.051065 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.102453 16178 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 5.
W20260709 13:06:34.051347 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.053339 15509 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:34.057569 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:34.053347 15338 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 209) took 21364 ms (client timeout 15000 ms). Trace:
I20260709 13:06:34.079789 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.090341 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.098672 15512 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:34.070719 20234 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:34.114163 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.114804 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.116309 20305 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:34.116850 16173 raft_consensus.cc:2410] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:06:34.117063 20305 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:34.117774 20137 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.090242 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:33.990159 20013 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.123027 15517 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:34.120090 20234 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.138293 20013 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:34.140121 20029 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.087105 19935 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.142946 15592 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:34.109680 20240 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:34.111101 20288 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.119442 20223 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.109417 19961 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:34.148835 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.136814 19949 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.150581 15583 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:34.164383 19949 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.168442 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:34.164911 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 107497us
I20260709 13:06:34.172670 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:34.175695 20264 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.176651 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2111) took 1376 ms. Trace:
I20260709 13:06:34.177070 15583 rpcz_store.cc:276] 0709 13:06:32.799821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.801259 (+  1438us) service_pool.cc:224] Handling call
0709 13:06:34.176348 (+1375089us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400055ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:34.176545 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200122240}
I20260709 13:06:34.179068 20137 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.181330 19961 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.181900 19949 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.183722 19991 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:34.183691 20288 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.184641 19991 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.186228 20078 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:34.186906 19991 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:34.175092 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:34.190296 20078 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:34.190760 20078 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:34.111753 20293 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.186509 20223 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:34.103873 15338 rpcz_store.cc:269] 0709 13:06:12.688738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.701342 (+ 12604us) service_pool.cc:224] Handling call
0709 13:06:34.052966 (+21351624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:27.322074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:27.322705 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:27.322744 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:06:27.322763 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:27.356981 (+ 34218us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:27.357284 (+   303us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:27.357315 (+    31us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:06:27.358843 (+  1528us) tablet.cc:701] Row locks acquired
0709 13:06:27.358861 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:27.359067 (+   206us) write_op.cc:270] Start()
0709 13:06:27.359219 (+   152us) write_op.cc:276] Timestamp: P: 1783602387358999 usec, L: 0
0709 13:06:27.359248 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:06:27.447033 (+ 87785us) log.cc:844] Serialized 7579 byte log entry
0709 13:06:27.891593 (+444560us) op_driver.cc:464] REPLICATION: finished
0709 13:06:28.269035 (+377442us) write_op.cc:301] APPLY: starting
0709 13:06:28.284081 (+ 15046us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:28.371319 (+ 87238us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:28.371462 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:29.742978 (+1371516us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:29.743345 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:06:29.743403 (+    58us) write_op.cc:312] APPLY: finished
0709 13:06:29.753608 (+ 10205us) log.cc:844] Serialized 172 byte log entry
0709 13:06:29.832078 (+ 78470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:29.937679 (+105601us) write_op.cc:454] Released schema lock
0709 13:06:29.952292 (+ 14613us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:30.096702 (+144410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.103396 (+  6694us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31243,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":298214,"apply.run_cpu_time_us":73119,"apply.run_wall_time_us":1802857,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83547,"num_ops":19,"prepare.queue_time_us":34763,"prepare.run_cpu_time_us":25062,"prepare.run_wall_time_us":283097,"raft.queue_time_us":149046,"raft.run_cpu_time_us":25920,"raft.run_wall_time_us":125090,"replication_time_us":532107,"spinlock_wait_cycles":1616128,"thread_start_us":372786,"threads_started":5,"wal-append.queue_time_us":322383,"wal-append.run_cpu_time_us":14856,"wal-append.run_wall_time_us":2215114}]]}
I20260709 13:06:34.193950 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:34.205080 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:34.191231 20078 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:34.192646 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:34.142990 19935 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:34.246253 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 53811.3us
W20260709 13:06:34.248878 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 265481us
I20260709 13:06:34.183189 20252 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.158205 20316 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:34.253803 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.261662 16179 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:34.211587 20029 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.186318 20288 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:34.259133 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.246753 20137 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.252948 19692 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.193333 20305 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.191588 20313 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.254045 20248 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.252097 20222 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:34.191391 20021 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.261101 20316 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:34.283888 15592 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:34.281685 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.295292 15513 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:34.286073 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:34.291213 15509 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:34.195910 20145 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.312132 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:34.312752 20305 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:34.291257 20222 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.281635 20265 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:34.325717 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 59698.8us
I20260709 13:06:34.270135 20029 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.296712 20288 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:06:34.333956 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 129054us
I20260709 13:06:34.330843 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:34.298951 20316 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.293741 19692 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.327877 20280 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:34.330047 20222 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:34.336333 20176 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.930s	user 0.018s	sys 0.002s
I20260709 13:06:34.331247 20015 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:06:34.333432 20265 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.352216 15556 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:34.358193 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:34.359395 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74103.3us
I20260709 13:06:34.362098 20293 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.362457 20029 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.362531 19692 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.364938 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:34.365958 20320 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:34.366763 19692 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:34.367237 19692 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.367985 19692 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.368455 20315 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:34.367123 20332 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:06:34.370537 20332 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:34.370972 20332 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:34.372246 20332 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.373713 20332 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:34.384660 15514 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:34.388447 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.389279 15511 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:34.392513 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:34.346721 20280 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.395804 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.397408 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.398150 20145 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.357007 20288 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.399325 20137 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:34.399520 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.419003 20310 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:34.419739 20223 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:34.419003 20330 consensus_queue.cc:1059] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:06:34.423020 20015 raft_consensus.cc:3055] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:06:34.400079 20319 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
W20260709 13:06:34.424194 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 74717.4us
I20260709 13:06:34.402966 20315 raft_consensus.cc:2804] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.410918 15509 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
W20260709 13:06:34.403086 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 50892.9us
I20260709 13:06:34.406594 15589 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:34.425343 15516 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:34.355564 19991 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.439023 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:34.440290 20252 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:34.423509 20015 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:34.441470 20318 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 13:06:34.441579 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:34.408545 20280 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.442553 20021 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:34.442178 20015 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.443907 20015 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.444375 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:34.445673 20310 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:34.446121 20310 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:34.446563 20310 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:34.447796 20234 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.449208 15510 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:34.450676 20234 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.453239 20137 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.457151 20288 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.434940 19991 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:34.458370 19991 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.459105 20265 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:34.462693 20310 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.467864 20028 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.427901 19692 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.467964 20310 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.477097 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:34.430910 20029 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:34.398101 20326 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.092s	user 0.000s	sys 0.004s
I20260709 13:06:34.434305 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:34.487124 16146 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:34.490242 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 51332.6us
W20260709 13:06:34.494012 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 59798.2us
I20260709 13:06:34.491513 15556 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:34.432129 20315 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:34.500941 20252 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:34.501427 20021 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.501840 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.503239 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:34.517331 20021 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.504944 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:34.508081 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.526503 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:34.528790 19949 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.529285 19949 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.529626 19949 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:34.536149 20327 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:06:34.540889 19961 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:34.486768 20265 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:34.498790 20244 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:34.544153 20244 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.543273 19961 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:34.544597 20244 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.544638 19961 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:34.485083 20245 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.545683 19961 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.476239 20223 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:06:34.547076 19961 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.546171 20245 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.549711 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:34.543195 20265 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.557396 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:34.576493 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.578320 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.579406 15592 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:34.578426 15440 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:34.451496 20234 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:06:34.497185 20029 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:34.596345 15517 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:34.599653 15511 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:34.508710 20315 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.563087 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:34.605608 15510 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.510402 20137 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.550555 20245 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.586145 20265 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.563606 19692 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.591359 20240 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:34.587598 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:34.626482 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 135107us
I20260709 13:06:34.593698 20029 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:34.644210 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:34.647812 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.648913 15589 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:34.645519 15437 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:06:34.620152 20240 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:34.654623 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.655304 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.620550 20245 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.657405 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:34.662657 15583 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 8: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:34.623883 20021 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:34.664501 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 220246us
W20260709 13:06:34.676174 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46857.5us
I20260709 13:06:34.678929 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.679952 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.681018 16180 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:34.682245 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.679757 15585 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:34.687352 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.646448 20015 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.706476 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:34.679159 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:34.652493 20029 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:34.697669 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:34.699913 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.712648 16178 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:34.667833 20240 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.707844 15435 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:34.698629 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:34.718657 15438 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.703291 16179 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:34.620255 20013 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:06:34.666806 19692 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:34.725055 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.711701 20263 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.679885 20245 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.758694 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.706355 20021 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:06:34.762647 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:34.763906 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 97499.3us
I20260709 13:06:34.764914 15556 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:34.766319 15589 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:34.717159 20015 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.772951 16181 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:06:34.775750 20015 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:34.760286 20248 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:34.776738 20248 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.777206 20248 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.758111 20222 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.738159 19692 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.782423 20222 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.782546 19692 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.783974 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:34.784659 15583 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.757479 20263 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.786728 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.787425 15589 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:34.788285 15587 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:34.788533 20263 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.789459 15514 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:06:34.800865 15438 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:34.803898 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.768079 20337 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:34.784586 20245 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.738750 20329 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:06:34.789316 20223 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.810935 15583 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:34.757803 20078 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.790496 20170 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:34.807755 15584 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:34.822023 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.806680 19935 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:34.834329 15510 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:34.832021 20223 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:34.852685 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 131159us
I20260709 13:06:34.855690 20223 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:34.856916 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.857353 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.857919 15511 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:34.858004 15513 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:34.858556 15518 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:34.860312 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.860579 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:34.861325 15517 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:34.862313 16146 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:34.863358 20245 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:34.864167 20245 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:34.864527 20245 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:34.864878 20245 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.865923 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:34.867031 15584 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:06:34.877820 15441 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:34.880596 15509 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:34.871181 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:34.876430 16146 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:34.881184 20337 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.895763 20288 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.896677 20288 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.886921 20332 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.835355 19935 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.900308 20329 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:34.908838 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:34.870391 20170 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:34.921131 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 121002us
I20260709 13:06:34.914592 20340 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.915606 20244 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.918568 19950 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:34.906581 20329 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:34.895857 20145 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:34.833029 19991 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.926294 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:34.911759 20305 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.902426 20332 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.906340 19935 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:34.922045 20316 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.002s
I20260709 13:06:34.922231 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:34.900686 20248 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.895835 20280 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.932292 19950 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:34.931115 20288 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.935590 20145 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.954850 15434 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:34.940047 20305 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.958245 20337 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.959141 20248 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:34.933555 20340 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.947269 19950 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:34.928942 20278 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:06:34.974910 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:34.960811 20240 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:34.952159 20263 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:34.981138 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 111527us
I20260709 13:06:34.986464 15439 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:34.975741 20305 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.962100 20343 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.962726 20145 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:34.946298 20316 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:34.996345 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:34.987239 20263 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.003075 20263 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.006003 20355 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:35.007876 20347 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.008716 20347 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.015156 20264 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:35.016696 20244 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.016880 19692 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:35.017520 19692 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.018800 19692 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.017604 20244 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.020485 20244 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.036366 20293 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:35.036810 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:35.037211 20293 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.037789 15509 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:35.037706 20176 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:34.997149 20343 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.038353 20176 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.043823 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:35.045272 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49072.9us
I20260709 13:06:35.044783 15585 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:35.066285 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:35.069111 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.014995 20265 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.040367 20343 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.041039 20340 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:35.011379 20347 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:35.076488 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.077267 20358 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.098845 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.078253 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.079084 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:35.079242 16181 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:35.080192 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:34.981432 20349 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:06:35.086833 15515 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:35.039307 20176 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.091225 19950 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.182240 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.095695 15585 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.043701 20355 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.041929 20078 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.196271 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.047813 20278 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:35.047565 20032 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.077431 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.201848 15584 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.107586 16174 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:35.116077 20263 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.128775 19692 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:35.175567 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.203760 15441 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:35.204838 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:34.981948 20329 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.205713 15517 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:35.180675 20244 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:35.219686 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 110330us
I20260709 13:06:35.192688 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.220748 15592 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
W20260709 13:06:35.194610 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.192334 15509 raft_consensus.cc:3060] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.996658 20170 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.093410 20265 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:35.180680 20315 consensus_meta.cc:287] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.538s	user 0.002s	sys 0.011s
I20260709 13:06:35.200076 15556 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.139211 20264 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:35.183907 20015 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:35.228220 20015 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.228693 20015 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.229612 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.091697 20352 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:06:35.230832 20264 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:35.231316 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.227303 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.233434 15588 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:35.193884 20332 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.192487 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:35.210213 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:35.211321 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.214224 20355 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.217705 15587 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:35.267295 16146 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.218576 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.206586 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:35.235801 15585 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:35.233263 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.237203 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.277037 15583 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 17: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:35.278868 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68789.7us
W20260709 13:06:35.266476 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46051.4us
I20260709 13:06:35.209062 20349 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:35.272627 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:35.231341 20264 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.234212 19991 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.280254 15510 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:35.280786 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:35.281412 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 48247.5us
I20260709 13:06:35.288350 15556 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.282943 15514 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
I20260709 13:06:35.289425 15556 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.290562 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3056) took 1146 ms. Trace:
I20260709 13:06:35.200325 20356 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:35.296794 20356 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.297283 20356 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.283493 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.285379 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.222558 20305 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.295029 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:35.295146 19950 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.209542 20032 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.280357 20341 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:35.299697 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.136680 20358 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.300756 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.328159 15585 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:35.329216 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.329574 20358 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:35.330706 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.291014 15515 rpcz_store.cc:276] 0709 13:06:34.144598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.144802 (+   204us) service_pool.cc:224] Handling call
0709 13:06:34.164502 (+ 19700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.184234 (+1019732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.286084 (+101850us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54003dc554. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:35.290468 (+  4384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065591552}
I20260709 13:06:35.298705 16145 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:35.333710 16145 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:35.333989 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:35.284159 20354 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.309451 15588 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:35.335083 15516 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:35.335479 20354 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.336022 20354 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.238420 20315 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.310902 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:35.283772 20316 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.313328 20015 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.305730 20340 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:35.315007 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:35.315627 20029 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.003s
I20260709 13:06:35.317625 20032 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.318982 20293 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.319909 15584 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:35.337810 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:35.320539 20263 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.285532 20252 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:35.356248 20252 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.356616 20372 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:35.356782 20252 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:35.287700 20244 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:35.357229 20372 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.357708 20244 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.357824 20372 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.358171 20244 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.282193 20349 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.360874 20349 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.362380 20349 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.368532 20252 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.372218 20252 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:35.308835 15509 raft_consensus.cc:2468] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:35.349929 15592 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 14: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:35.308669 19949 consensus_meta.cc:287] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.003s
I20260709 13:06:35.377880 19949 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.380290 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.380649 19949 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.381310 15588 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:35.298079 20280 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.387796 15436 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:35.307767 20347 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:35.354430 16146 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.400627 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:35.401557 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47233.6us
I20260709 13:06:35.308094 20353 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:35.346848 20358 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.403467 15591 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 3.
W20260709 13:06:35.402379 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9993628649999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:06:35.410315 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.347452 20248 raft_consensus.cc:2804] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.431282 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:35.434213 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.407413 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:35.437592 16182 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:35.433751 16180 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:35.387648 20032 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:35.440091 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.441785 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.442215 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.436864 20248 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.438755 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.446134 15439 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.397514 20340 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:35.352753 20021 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:06:35.431984 20293 raft_consensus.cc:2804] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:35.447752 15434 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:35.448590 15482 connection.cc:256] RPC call timeout handler was delayed by -1.4563877829999683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 13:06:35.352437 20029 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.452894 15435 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:06:35.375376 20244 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.450224 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:35.441843 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.681s (SENT) [suppressed 22 similar messages]
I20260709 13:06:35.476019 15438 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:06:35.432476 20347 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:35.451866 15482 connection.cc:256] RPC call timeout handler was delayed by -1.3897877829999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 13:06:35.453262 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:35.441473 20032 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:35.479913 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:35.443799 20352 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:35.480108 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.480887 15588 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:35.447502 20248 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:35.483889 15482 connection.cc:256] RPC call timeout handler was delayed by -1.3708877829999437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:06:35.484375 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1107877829999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:06:35.474864 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.477881 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.398042 19950 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:06:35.472645 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 126843us
I20260709 13:06:35.494451 15436 raft_consensus.cc:2368] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13.
I20260709 13:06:35.496944 16179 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:35.483245 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.499629 20015 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:35.483726 20032 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.505084 20029 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:35.507145 20244 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:35.492476 20245 consensus_meta.cc:287] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.005s
I20260709 13:06:35.508301 20245 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.511036 20245 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:35.511933 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.512303 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.513669 16173 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:35.515038 20240 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:35.516184 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.516898 15516 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.517261 20329 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.511657 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.518169 15588 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:35.520042 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.520639 20305 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:35.520975 15515 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:35.475737 20316 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:35.527344 15434 raft_consensus.cc:2368] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:06:35.531260 15436 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:35.478608 20293 raft_consensus.cc:697] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:35.529294 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.542047 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:35.511751 19949 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:35.483232 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.522149 20347 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.450747 20372 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.491291 15441 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:35.555732 15443 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:35.559348 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.525626 19961 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:35.560303 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.566481 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.566984 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.569142 15442 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:35.574630 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:35.575524 16182 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.576524 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:35.563697 15591 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:35.534996 20021 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.580022 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.584587 20315 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:35.528332 20352 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.587762 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.560068 20316 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.589723 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:35.590507 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 62822us
I20260709 13:06:35.584741 20264 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.591315 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:35.553980 20305 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:06:35.591593 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.647714 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.648028 15438 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:35.590390 20248 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.597862 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.649607 15514 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:35.598301 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.650686 15510 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.599882 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:35.600265 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.656489 15511 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.587778 20021 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.601751 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.659565 15512 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:35.604395 20145 consensus_meta.cc:287] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.002s
I20260709 13:06:35.607406 20032 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.567883 19961 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.609400 20372 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:35.612052 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.617233 20176 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:35.520042 20340 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:35.625123 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 218894us
I20260709 13:06:35.672050 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.628013 15588 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:35.633332 15439 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:35.631321 15435 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:35.676330 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.678300 16182 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:35.635989 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.679025 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.679307 15589 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:35.679683 15588 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:35.680004 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:35.680954 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.681718 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.637336 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:35.618688 20293 consensus_queue.cc:237] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.602614 15516 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:35.659458 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.661849 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.638417 20240 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:06:35.685706 15517 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.667424 15585 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:35.667706 15513 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.668208 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:35.670676 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.687739 15440 raft_consensus.cc:2410] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:35.664721 20353 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:35.682576 15509 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:35.689553 19961 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.695284 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.695827 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.697480 20357 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:35.697974 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.698596 15588 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.698904 20021 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:35.697979 20357 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:35.676812 20355 raft_consensus.cc:2764] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:06:35.700538 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:35.700764 20357 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.701659 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:35.701920 20032 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.702190 20357 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.702952 20078 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:35.703759 20248 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.704273 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.687487 20015 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:35.704764 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.705138 20015 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.706130 20015 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.687033 20170 raft_consensus.cc:2764] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:06:35.707796 20354 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.709147 20352 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:35.709838 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.710163 20354 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.714337 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.715682 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.717542 15587 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:35.719848 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.658245 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.721843 15516 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:35.722914 15510 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:35.664529 20145 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.731230 16181 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:35.683684 20264 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.685535 16145 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:35.737656 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52209.8us
I20260709 13:06:35.638358 20371 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:06:35.659618 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.741426 15518 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.742352 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.743979 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.744634 15509 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.744549 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.745028 20316 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.745391 15443 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:35.746451 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.747781 20343 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:35.748415 20343 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:35.748966 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.749338 20343 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.724040 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.752948 15439 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:35.682960 15437 raft_consensus.cc:2368] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15.
I20260709 13:06:35.731822 15517 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:35.759763 15509 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:35.735783 15588 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:35.736311 20145 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.703796 20078 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:35.762324 19935 consensus_meta.cc:287] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.002s
I20260709 13:06:35.763994 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:35.766992 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:35.819741 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:35.773543 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.773777 20356 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.778210 20240 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:35.779177 15556 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.777362 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.784413 20341 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.784746 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:35.785511 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:35.782994 15435 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:35.783367 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:35.823503 15434 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.836813 15435 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.837971 20348 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:35.838455 20348 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:35.733914 15511 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:35.827411 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.789963 15438 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:35.828902 15590 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 16: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:35.827874 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.843006 15587 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.833154 15443 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:35.833725 16180 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.834163 16178 raft_consensus.cc:2368] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
W20260709 13:06:35.832448 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53354.1us
I20260709 13:06:35.827000 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.787483 16146 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:35.793038 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.793226 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.794328 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:35.777237 20223 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:35.804533 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:35.802770 15440 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:35.795147 15589 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:35.861037 15437 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:35.799965 15512 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:35.790731 15441 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:35.788722 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.815864 15514 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:35.816455 15513 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:06:35.817050 15518 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:35.840725 15588 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.818490 16177 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
W20260709 13:06:35.877444 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 73049us
I20260709 13:06:35.878610 15586 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:35.882027 20145 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:35.882707 20145 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 10 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:35.883908 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.879092 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:35.889124 20354 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:35.889724 20354 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:06:35.890615 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 101960us
I20260709 13:06:35.891307 20029 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:35.891644 15407 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.891858 20029 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.892351 20029 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:35.893002 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.893144 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:35.893771 15591 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.894850 20355 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:35.895417 19950 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.895936 19950 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.896301 19950 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.896385 19949 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.896999 19949 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.890674 20354 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.789829 19961 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.904385 15406 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:35.895412 20355 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.906093 20264 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:35.906695 20264 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.906518 20355 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.907675 20264 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.908524 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:35.910419 20376 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:06:35.910678 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 123272us
I20260709 13:06:35.830358 20356 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:35.862347 20223 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:35.916623 20223 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.899266 19949 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:35.831846 20240 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.839774 20021 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.918740 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:35.917486 15434 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:06:35.920683 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:35.928856 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.909911 16180 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:06:35.931244 15510 raft_consensus.cc:3060] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.946110 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:35.883698 20145 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:35.916674 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 112) took 9590 ms. Trace:
I20260709 13:06:35.917244 20329 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:35.948412 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:35.949465 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:35.839427 20348 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.943581 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:35.944615 15407 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.920359 20176 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.818466 20353 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:35.952596 20280 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:35.833550 20341 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:35.982736 15591 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:35.983908 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:35.967146 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.876691 20337 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:35.962716 15556 leader_election.cc:400] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:06:35.994618 15556 leader_election.cc:403] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.968713 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:35.992792 15509 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:35.942780 20021 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.963384 20013 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:35.995487 15556 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:35.956128 19949 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:35.961562 20348 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.971644 20288 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:35.959065 20329 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:35.962363 20356 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:35.999886 20223 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:35.899590 20263 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:06:35.862027 19935 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:36.009685 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.006019 20280 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.991839 19692 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:36.014513 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:35.957584 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:35.957230 20352 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:06:36.004344 20021 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.957969 20029 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.006621 15588 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
W20260709 13:06:36.076184 15555 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.541s (SENT)
I20260709 13:06:35.955818 15337 rpcz_store.cc:276] 0709 13:06:26.326693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.326906 (+   213us) service_pool.cc:224] Handling call
0709 13:06:35.916538 (+9589632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:33.813738 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:33.857683 (+ 43945us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:33.869272 (+ 11589us) write_op.cc:435] Acquired schema lock
0709 13:06:33.878024 (+  8752us) tablet.cc:662] Decoding operations
0709 13:06:33.940605 (+ 62581us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:33.940725 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:33.940767 (+    42us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:33.941384 (+   617us) tablet.cc:701] Row locks acquired
0709 13:06:33.941448 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:06:33.941679 (+   231us) write_op.cc:270] Start()
0709 13:06:33.941893 (+   214us) write_op.cc:276] Timestamp: P: 1783602393941594 usec, L: 0
0709 13:06:33.941953 (+    60us) op_driver.cc:348] REPLICATION: starting
0709 13:06:33.983910 (+ 41957us) log.cc:844] Serialized 1365 byte log entry
0709 13:06:34.429959 (+446049us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:34.922659 (+492700us) op_driver.cc:464] REPLICATION: finished
0709 13:06:35.071264 (+148605us) write_op.cc:301] APPLY: starting
0709 13:06:35.071375 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:35.394189 (+322814us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:35.430710 (+ 36521us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:35.589629 (+158919us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:35.590004 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:06:35.590070 (+    66us) write_op.cc:312] APPLY: finished
0709 13:06:35.590411 (+   341us) log.cc:844] Serialized 41 byte log entry
0709 13:06:35.590627 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:35.590773 (+   146us) write_op.cc:454] Released schema lock
0709 13:06:35.590845 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:35.591431 (+   586us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:35.591465 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":971669,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":136449,"apply.run_cpu_time_us":10079,"apply.run_wall_time_us":520134,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":422743,"prepare.run_cpu_time_us":65019,"prepare.run_wall_time_us":352426,"raft.queue_time_us":399280,"raft.run_cpu_time_us":18540,"raft.run_wall_time_us":194708,"replication_time_us":950084,"spinlock_wait_cycles":3692544,"thread_start_us":659747,"threads_started":4,"wal-append.queue_time_us":266667}]]}
I20260709 13:06:36.091501 15510 raft_consensus.cc:2468] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 4.
I20260709 13:06:36.006834 20377 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:35.957019 19950 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:36.098140 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 396526us
I20260709 13:06:36.105891 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:36.060802 20013 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:36.103716 16146 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:36.108644 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 94275.8us
W20260709 13:06:36.095676 20345 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:06:36.116755 20244 raft_consensus.cc:2804] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.117746 20244 raft_consensus.cc:697] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:36.119236 20170 raft_consensus.cc:2764] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:06:36.121743 19950 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:36.124164 20013 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.125682 20029 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:36.144647 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68539.9us
W20260709 13:06:36.145956 15555 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.652s (SENT)
I20260709 13:06:36.150876 20170 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.151907 20170 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.154596 20240 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:36.146504 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.105132 20371 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
W20260709 13:06:36.160115 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54309.9us
I20260709 13:06:36.112340 20305 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.144083 16173 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:36.123427 19950 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:36.137410 20377 raft_consensus.cc:697] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:36.100850 20280 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.179778 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:36.161928 20170 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:36.119087 20244 consensus_queue.cc:237] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:36.169073 19950 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:36.192639 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:36.166292 20240 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:36.193470 15555 leader_election.cc:336] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.654s (SENT)
I20260709 13:06:36.150947 20329 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.194991 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.186344 20356 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:36.240095 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.243335 15592 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:36.245160 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.172803 20305 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.252106 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.253088 15514 raft_consensus.cc:2393] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.250315 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:36.253844 15440 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:36.253985 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.256268 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.257093 15509 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.195168 19950 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:36.259828 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.260825 15510 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.226933 20316 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:36.264245 15587 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
W20260709 13:06:36.268929 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 75500.2us
W20260709 13:06:36.269675 15555 leader_election.cc:336] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.655s (SENT)
I20260709 13:06:36.280515 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.283349 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.284543 15511 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.286799 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.200515 20170 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 13:06:36.293603 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 95727.4us
I20260709 13:06:36.295063 15510 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:36.227469 20078 consensus_queue.cc:1059] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:06:36.264995 20357 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:36.268496 20316 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:36.310360 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:36.280613 20252 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:36.313966 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:36.310799 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.318002 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:36.321374 16174 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:36.296541 20240 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:36.324755 15511 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:36.329080 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 59429.2us
I20260709 13:06:36.315850 20316 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:36.398590 20382 log.cc:927] Time spent T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:06:36.379143 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1915fdd81d344a749443e48f07a1fef8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ccb2e30f44f40c2b22339e1d4c74a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:06:36.379591 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48338.8us
W20260709 13:06:36.403708 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.403944 15555 leader_election.cc:336] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.677s (SENT)
I20260709 13:06:36.404496 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:36.405777 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.680s (SENT)
I20260709 13:06:36.406203 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.408370 20305 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:36.381395 15514 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:36.417414 15587 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:06:36.418479 15588 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:36.420095 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:36.420707 15589 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.322558 19935 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:36.424199 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:36.424865 15585 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:36.427179 15514 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:36.437675 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:36.438409 15583 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:36.315366 20357 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:36.400700 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 204774us
I20260709 13:06:36.440456 15511 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:36.442663 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:36.448518 15589 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:36.386634 20347 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:36.446729 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.465467 15514 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:36.319417 20288 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:36.316313 20393 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:06:36.474489 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:36.481053 15435 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:36.477238 15591 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:36.436926 20015 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:36.437104 20349 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.491340 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:36.494242 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 176327us
I20260709 13:06:36.468538 20240 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:36.281585 20377 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:36.498602 15514 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:06:36.476714 19935 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:36.505995 15585 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:36.500701 15583 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:36.482489 20330 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.503196 15440 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:36.492848 20384 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.333s	user 0.000s	sys 0.002s
I20260709 13:06:36.478062 19692 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:36.473394 20397 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.512722 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.512893 20015 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:36.513149 20386 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:06:36.514644 20381 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:06:36.553340 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.526093 20021 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:36.529068 20176 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 13:06:36.559476 15437 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:36.530498 20402 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.534485 19961 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.006s
I20260709 13:06:36.534364 20330 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.537011 15435 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:36.494982 20280 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:36.552466 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:36.554188 15517 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:36.557811 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.476522 20347 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.510388 20404 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:36.586138 20404 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.587764 20330 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:36.574508 20402 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:36.530504 20349 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:06:36.512775 20288 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.577929 15511 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:36.584190 20015 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.584661 20399 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:06:36.572359 20176 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:36.585404 20347 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:36.588856 20404 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:36.575738 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.604566 15513 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:36.592873 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:36.594151 15585 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:06:36.605924 15586 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:36.600366 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.600759 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.601734 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:36.608736 15592 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:36.597034 20348 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.003s
I20260709 13:06:36.615684 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.616601 15517 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:36.617914 15441 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:36.613166 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:36.620832 15583 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:36.590407 20240 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:36.619480 15556 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:36.599179 20280 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.628870 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.633396 15511 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:36.632972 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:36.574837 20293 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:06:36.634517 15585 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
W20260709 13:06:36.635789 20390 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 13:06:36.637244 15407 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:36.643630 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.642858 15406 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:36.645147 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:36.645812 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:36.569550 19692 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.646279 15435 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.646698 15434 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.648301 15511 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:36.626935 20240 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:36.652020 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:36.655131 15437 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.655669 19935 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:36.643481 20280 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.659915 20280 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:36.661860 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.662724 15517 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.626641 20404 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:06:36.663327 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.663796 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.664582 15518 raft_consensus.cc:2368] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:06:36.664888 20240 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:36.665874 20406 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:36.666437 20406 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:36.665771 20357 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:36.667510 20406 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:36.668092 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.668998 15512 raft_consensus.cc:2368] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12.
I20260709 13:06:36.669863 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.664529 15510 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.673007 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:36.673703 15434 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.684384 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.685622 15511 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:36.646955 20355 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:36.669030 20349 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:36.702164 15434 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:36.704101 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.669483 20395 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:36.710492 20349 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:36.712023 20349 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.705826 20264 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:06:36.703028 20013 raft_consensus.cc:2764] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:36.692803 20406 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:36.689527 20341 consensus_meta.cc:287] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.687s	user 0.013s	sys 0.002s
I20260709 13:06:36.670014 20176 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:06:36.706583 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.704s (SENT)
I20260709 13:06:36.735085 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.725791 15510 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:36.701622 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:36.692814 20355 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:36.702230 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56815.9us
I20260709 13:06:36.708411 20395 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.734030 15556 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:36.746410 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.747450 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:36.733708 20341 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:36.692408 19935 raft_consensus.cc:697] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:36.760272 19935 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:36.751163 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44613us
I20260709 13:06:36.763373 20402 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:36.763382 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.708s (SENT)
I20260709 13:06:36.764346 15512 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:36.764456 20350 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:06:36.765489 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.766167 15513 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:36.763882 20412 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:36.768540 20341 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:36.768719 20412 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:36.739394 20021 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:36.767915 15584 raft_consensus.cc:2393] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 8: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:36.769801 20412 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.764585 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.772485 15518 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:36.773097 20402 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:36.773432 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.773739 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.774140 15515 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:36.774963 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.775918 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.780180 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.780644 15518 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.775956 15516 raft_consensus.cc:2368] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
I20260709 13:06:36.776301 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.781814 15509 raft_consensus.cc:2393] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.752326 20357 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:36.788470 15510 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:36.781668 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.781687 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.791915 15516 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:36.775143 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:36.789911 15555 leader_election.cc:336] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.817s (SENT)
I20260709 13:06:36.794827 15515 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:36.795251 15511 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:36.797541 15589 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:36.799517 15434 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:36.803596 15589 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:36.810324 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.746454 20176 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:36.813148 15510 raft_consensus.cc:2368] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10.
I20260709 13:06:36.752893 20355 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:36.823320 15440 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:36.807960 15406 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:36.825871 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.827975 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.755362 20395 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:36.827616 15517 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:36.832008 15516 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:36.851110 19935 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:06:36.851964 20420 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:06:36.852244 19935 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.819396 20078 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.857686 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.855923 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.858669 15512 raft_consensus.cc:2376] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17. Re-sending same reply.
I20260709 13:06:36.817716 20176 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.804461 20240 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.861734 20399 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:36.863196 20409 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:36.863951 20264 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:36.825591 20330 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:06:36.881372 15512 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:36.823066 20340 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:06:36.883366 19935 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:36.884385 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.885325 15517 raft_consensus.cc:2368] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 3. Current term is 4.
W20260709 13:06:36.874749 19950 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.602s	user 0.004s	sys 0.011s
I20260709 13:06:36.895418 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:36.896706 15440 raft_consensus.cc:606] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:36.898105 20424 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:06:36.833652 20354 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:06:36.871670 20176 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:36.873919 20399 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:36.904608 15512 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:36.906076 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:36.906832 15517 raft_consensus.cc:2376] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12. Re-sending same reply.
I20260709 13:06:36.908674 20145 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:06:36.851177 20408 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:06:36.923856 20013 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:36.906122 20399 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.899228 20343 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:06:36.945101 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.879192 20376 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:06:36.874323 20078 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:36.953800 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:36.964082 15555 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.881s (SENT)
I20260709 13:06:36.964641 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.965224 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:36.967896 20357 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:36.902580 19950 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:36.955049 20248 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:06:36.982625 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.002s (SENT)
I20260709 13:06:36.983402 19950 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:36.983498 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.985615 20078 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:36.985857 20412 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:36.985659 15555 leader_election.cc:336] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.016s (SENT)
I20260709 13:06:36.987668 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:36.989473 20412 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:37.001426 20350 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:37.004449 19949 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:37.004972 19949 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:37.005409 16173 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:37.008112 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:37.011370 15512 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:37.012009 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:37.012706 15517 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:37.013273 15511 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:37.013726 15511 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:37.014662 15511 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.015990 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.016829 15510 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:37.019207 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2401) took 1139 ms. Trace:
I20260709 13:06:37.019681 15441 rpcz_store.cc:276] 0709 13:06:35.880269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.880453 (+   184us) service_pool.cc:224] Handling call
0709 13:06:35.880831 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.618546 (+737715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.018890 (+400344us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400302fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:37.019137 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694443904}
I20260709 13:06:37.005954 19949 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.024039 19949 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.033231 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:37.034245 15588 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:37.034338 16182 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:37.043723 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.044970 15517 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:37.046036 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.044020 15511 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:37.050401 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.191s (SENT)
I20260709 13:06:37.056324 15510 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:37.056474 15516 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:37.060726 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:37.062192 15589 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:37.062763 15585 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:37.069742 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.070750 15516 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:37.072616 15588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48416
W20260709 13:06:37.083992 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.558s (SENT)
I20260709 13:06:37.064574 15587 raft_consensus.cc:2955] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:37.084643 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:37.086570 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 199528us
I20260709 13:06:37.087340 15588 raft_consensus.cc:606] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Received request to transfer leadership
I20260709 13:06:37.087503 16146 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:37.089804 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.095854 15516 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:37.103114 15511 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:37.073065 20288 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:37.117460 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:37.118713 15511 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.122355 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:37.069202 20406 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:37.108034 20376 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:37.113415 20412 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:37.094161 20409 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:06:37.145102 15511 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:37.078974 19961 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:37.154549 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.133384 15339 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 6 to 7, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 7 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.124496 20288 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:37.110910 20293 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:06:37.154264 20316 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.005s
I20260709 13:06:37.182435 20316 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:37.185653 15514 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:37.185932 20423 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.330s	user 0.003s	sys 0.001s
I20260709 13:06:37.188568 20355 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.189767 20383 raft_consensus.cc:3055] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:37.190231 20383 raft_consensus.cc:740] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:37.191044 20355 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:37.191648 20350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56808 (request call id 0) took 1394 ms. Trace:
I20260709 13:06:37.174324 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:37.193295 15510 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:37.176533 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.180750 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:37.194900 15516 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:37.191165 20383 consensus_queue.cc:260] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:37.203759 20288 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:37.204421 20383 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:37.200057 15339 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:37.193352 20316 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:37.216173 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:37.217182 15440 raft_consensus.cc:606] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:37.217872 15440 raft_consensus.cc:614] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:37.220466 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:37.222295 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:37.241856 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.253695 15514 raft_consensus.cc:1275] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:37.253954 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:37.254818 15516 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:37.255774 20078 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:37.254846 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.192160 20350 rpcz_store.cc:276] 0709 13:06:35.818717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.834693 (+ 15976us) service_pool.cc:224] Handling call
0709 13:06:35.840480 (+  5787us) log.cc:844] Serialized 501 byte log entry
0709 13:06:37.191493 (+1351013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63248,"raft.queue_time_us":152526,"raft.run_cpu_time_us":688,"raft.run_wall_time_us":690,"thread_start_us":455924,"threads_started":2,"wal-append.queue_time_us":419301}
I20260709 13:06:37.259716 20406 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:37.264559 15514 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:37.268659 15511 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:37.276050 15584 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:37.233862 20355 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.281239 16182 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:06:37.282969 20432 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:37.284268 15339 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 8 to 10, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 10 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.328197 15339 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 10 to 11, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 11 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.262324 20316 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:37.336879 15590 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:06:37.336422 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 55695.3us
W20260709 13:06:37.309954 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 200291us
I20260709 13:06:37.275023 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:37.345074 15586 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:37.280794 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:37.349542 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 96218.8us
I20260709 13:06:37.362530 16180 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:37.351140 15584 raft_consensus.cc:1275] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:37.354595 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.361243 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:37.365454 16173 raft_consensus.cc:2393] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 8: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:37.366326 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:37.364792 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b97fcd3d908482fadc6fa54e513304d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:37.367444 15435 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:37.367822 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:37.369843 20437 consensus_queue.cc:1048] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:37.364253 19935 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:37.324361 20435 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:37.280483 20343 consensus_queue.cc:1048] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:06:37.396263 15443 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:37.377189 15584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48416
I20260709 13:06:37.373968 15441 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:37.397321 15584 raft_consensus.cc:606] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Received request to transfer leadership
W20260709 13:06:37.390476 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48222.3us
I20260709 13:06:37.393971 15513 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:37.403474 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:37.405818 16182 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:37.408299 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:37.376140 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 96497.8us
I20260709 13:06:37.440410 15513 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:37.343686 20355 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:37.462736 15482 leader_election.cc:400] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13.
I20260709 13:06:37.463483 15482 leader_election.cc:403] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:37.386940 20176 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.391746 20412 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:06:37.395602 19935 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.467788 15482 leader_election.cc:400] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:06:37.431749 20305 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.446857 20395 consensus_meta.cc:287] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.004s
I20260709 13:06:37.401208 20435 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:37.416882 20436 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:06:37.477607 15435 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:37.489008 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:37.488566 15339 catalog_manager.cc:5697] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 6 to 8, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 8 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.491585 15513 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:37.476903 15482 leader_election.cc:403] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:37.477003 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46141.5us
W20260709 13:06:37.465994 20399 consensus_meta.cc:287] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.004s
W20260709 13:06:37.498464 20434 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:06:37.499399 19935 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:37.501529 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.502995 20435 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:37.503855 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.485984 20395 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.510030 15339 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.512468 20399 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.513556 20409 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:37.514503 20013 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:37.514987 20078 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:37.519901 20337 raft_consensus.cc:2764] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:06:37.498600 20402 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:37.525744 20402 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:37.529933 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:37.530750 15590 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:37.531909 20350 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.532485 20350 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.534938 20350 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:37.536933 15555 leader_election.cc:336] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.681s (SENT)
I20260709 13:06:37.537617 20355 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:37.538496 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.235s (SENT)
I20260709 13:06:37.539008 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:37.540717 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:37.542948 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 75477.3us
I20260709 13:06:37.543874 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:37.547166 15586 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:37.526785 20402 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.567299 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "562c25b8842b442a928630e10d13e618"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:37.568240 15440 raft_consensus.cc:606] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:37.565014 20375 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:37.485920 20305 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.575574 20394 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:37.576272 20394 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:37.587411 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:37.588286 15513 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:37.593992 20447 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:37.569499 20375 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:37.592322 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:37.605417 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 232940us
I20260709 13:06:37.607640 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:37.616501 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.617674 15513 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:37.603888 20375 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:37.621994 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:37.626441 15482 leader_election.cc:400] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15.
I20260709 13:06:37.636793 15482 leader_election.cc:403] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:37.637591 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:37.647845 15515 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:37.648177 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:37.648869 15515 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:37.650813 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:37.651666 15517 raft_consensus.cc:2410] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:37.651741 15513 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.623989 20449 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:37.628379 20356 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:37.621289 20444 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:06:37.650388 15515 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.639716 20078 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15.
I20260709 13:06:37.621619 20454 raft_consensus.cc:2764] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:06:37.658648 15515 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:37.681435 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.650413 20176 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:37.714814 20451 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13.
W20260709 13:06:37.715994 20456 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:37.715875 20450 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:37.779606 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 53215.5us
I20260709 13:06:37.682808 20383 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:37.782011 15555 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.236s (SENT)
I20260709 13:06:37.782631 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:37.687567 20449 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:37.685132 20457 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.778396 20455 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:06:37.754242 20244 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.843952 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61989.1us
I20260709 13:06:37.844221 20244 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:37.849637 20244 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:37.836500 20449 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.837093 20466 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:37.824254 20450 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:37.835940 20383 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:37.788199 20454 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:37.894918 20454 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:37.896136 20454 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.870378 20305 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:37.873183 20240 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:37.878556 20421 log.cc:927] Time spent T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 1.027s	user 0.003s	sys 0.000s
I20260709 13:06:37.882041 20450 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:37.887686 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:37.892253 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 251236us
W20260709 13:06:37.865054 20458 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:06:37.916714 15555 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.224s (SENT)
I20260709 13:06:37.944859 15515 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:06:37.945518 15515 pending_rounds.cc:85] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 10
I20260709 13:06:37.944522 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:37.956947 20466 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:37.958887 15513 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:37.959864 20466 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:37.963788 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46907us
I20260709 13:06:37.976096 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:37.945875 15515 pending_rounds.cc:107] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:06:37.982861 15515 raft_consensus.cc:2889] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:37.940876 20244 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.861338 20457 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:37.947103 20305 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.005846 20443 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.398s	user 0.003s	sys 0.025s
I20260709 13:06:38.001269 20240 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:38.051831 20393 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.052726 20393 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.053751 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:38.054759 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:38.054936 20409 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:38.051980 20280 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.055869 20409 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:38.056192 20280 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.057020 20409 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:38.065403 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.997965 20244 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:38.080425 15555 leader_election.cc:336] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.098s (SENT)
I20260709 13:06:38.055058 20393 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:38.083763 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:38.087419 15440 raft_consensus.cc:606] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:38.088099 15440 raft_consensus.cc:630] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Rejecting request to transfer leadership because tablet server 8a55534dc8864943937d5b6ec0e6aaf9 is not a voter in the active config
I20260709 13:06:38.088963 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:38.067901 19692 raft_consensus.cc:993] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
W20260709 13:06:38.092644 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.004997 20305 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:37.984493 20377 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:06:38.055646 20013 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:38.116498 20280 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.077378 20240 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:38.126946 20439 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.580s	user 0.013s	sys 0.000s
I20260709 13:06:38.128268 20461 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:38.133411 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 546) took 1031 ms. Trace:
W20260709 13:06:38.142625 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62347.6us
I20260709 13:06:38.033941 20383 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.123178 20013 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.133898 15437 rpcz_store.cc:276] 0709 13:06:37.102290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.102480 (+   190us) service_pool.cc:224] Handling call
0709 13:06:37.102902 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.109427 (+  6525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.109487 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.134226 (+ 24739us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.270527 (+136301us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:37.270585 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.270670 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.062433 (+791763us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:38.133068 (+ 70635us) raft_consensus.cc:1685] finished
0709 13:06:38.133097 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.133333 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5201,"raft.queue_time_us":4591,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5252,"spinlock_wait_cycles":172080000,"thread_start_us":82778,"threads_started":1,"wal-append.queue_time_us":275768}
W20260709 13:06:38.155256 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 91648.2us
I20260709 13:06:38.131456 20280 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:38.146085 20396 raft_consensus.cc:993] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:06:38.170949 20396 raft_consensus.cc:1081] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
W20260709 13:06:38.152928 20438 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.616s	user 0.011s	sys 0.000s
I20260709 13:06:38.171901 20240 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.154915 20013 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.172317 20305 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.159001 20471 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.158739 20468 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.190846 20468 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.150655 20355 raft_consensus.cc:1081] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:06:38.194028 15406 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:38.207590 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.105s	sys 0.166s
W20260709 13:06:38.211437 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.106s	sys 0.166s
I20260709 13:06:38.146437 20461 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.200989 20361 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.212325 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 564210us
I20260709 13:06:38.220690 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:38.216346 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 221788us
I20260709 13:06:38.222167 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:38.246501 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.195884 20280 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.246912 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.250931 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:38.251971 15588 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:38.253108 15437 raft_consensus.cc:2368] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10.
I20260709 13:06:38.221961 20337 raft_consensus.cc:2764] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:06:38.257843 15584 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:38.259112 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:38.223815 20468 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:38.222965 20482 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:38.271790 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:38.270248 15435 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:38.253463 20451 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:38.253576 20244 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:38.286819 20482 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:38.290393 15585 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:38.253870 20457 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:38.226626 20361 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.276077 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:38.255978 20355 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:06:38.261051 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 196263us
I20260709 13:06:38.317924 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.278079 15440 raft_consensus.cc:2368] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18.
I20260709 13:06:38.323911 15586 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:38.324826 15588 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:06:38.329360 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.272300 20013 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:38.329067 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 92163.9us
W20260709 13:06:38.363926 15326 catalog_manager.cc:4755] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): ChangeConfig:REMOVE_PEER RPC failed for tablet 1915fdd81d344a749443e48f07a1fef8: Remote error: Service unavailable: leader transfer in progress
I20260709 13:06:38.364567 20482 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.354269 15441 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:38.367825 15584 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.368412 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.277858 20357 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:38.370337 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.375313 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:38.388427 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.381291 20472 log.cc:927] Time spent T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.248s	user 0.000s	sys 0.002s
W20260709 13:06:38.378999 20375 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.730s	user 0.015s	sys 0.000s
I20260709 13:06:38.374351 20451 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:38.401124 20476 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:06:38.408322 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.396215 20240 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:38.412472 15584 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:38.413591 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:38.426759 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.410742 20396 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.430580 15435 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:38.430480 20396 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:38.431668 20480 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:06:38.432581 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.433190 20396 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.434881 20478 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:06:38.438676 20280 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:38.414043 20240 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.439640 20240 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.439824 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3003) took 1165 ms. Trace:
I20260709 13:06:38.440487 15589 rpcz_store.cc:276] 0709 13:06:37.274790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.275269 (+   479us) service_pool.cc:224] Handling call
0709 13:06:37.330212 (+ 54943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.330647 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:37.948060 (+617413us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.244981 (+296921us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.247507 (+  2526us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.247735 (+   228us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:38.247788 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.247928 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.439557 (+191629us) raft_consensus.cc:1685] finished
0709 13:06:38.439579 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.439734 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":589956,"prepare.queue_time_us":565526,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":30310,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":9639,"spinlock_wait_cycles":20420480,"thread_start_us":291263,"threads_started":2,"wal-append.queue_time_us":371407}
I20260709 13:06:38.446767 20013 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.429559 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:38.455120 15440 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:38.454824 20467 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:38.456269 20467 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.418061 20493 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:38.458804 20493 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.460839 20467 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:38.461333 20493 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:38.463060 20361 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.468480 20461 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.469539 15584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48416
I20260709 13:06:38.470305 15584 raft_consensus.cc:606] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Received request to transfer leadership
I20260709 13:06:38.469771 20451 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.404814 20375 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:38.478353 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9878024419999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:06:38.480484 15482 connection.cc:256] RPC call timeout handler was delayed by -1.9752024419999543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:06:38.480378 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50230.5us
W20260709 13:06:38.481714 15482 connection.cc:256] RPC call timeout handler was delayed by -1.822202442000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:06:38.482352 15482 connection.cc:256] RPC call timeout handler was delayed by -1.8114024420000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 13:06:38.482700 15482 connection.cc:256] RPC call timeout handler was delayed by -1.7835024419999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20260709 13:06:38.482956 15482 connection.cc:256] RPC call timeout handler was delayed by -1.7484024420000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:06:38.483224 15482 connection.cc:256] RPC call timeout handler was delayed by -1.7241024420000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:06:38.483598 15482 connection.cc:256] RPC call timeout handler was delayed by -1.669202442000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 13:06:38.484148 15482 connection.cc:256] RPC call timeout handler was delayed by -1.572902441999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:06:38.484612 15482 connection.cc:256] RPC call timeout handler was delayed by -1.5594024419999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260709 13:06:38.484887 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:38.486824 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:38.485131 15482 connection.cc:256] RPC call timeout handler was delayed by -1.526102442000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:06:38.488152 15482 connection.cc:256] RPC call timeout handler was delayed by -1.5234024420000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:06:38.488790 15482 connection.cc:256] RPC call timeout handler was delayed by -1.4460024420000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:06:38.490082 15482 connection.cc:256] RPC call timeout handler was delayed by -1.4352024419999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
I20260709 13:06:38.491034 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.492026 15435 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:38.491123 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.492116 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:38.490564 15482 connection.cc:256] RPC call timeout handler was delayed by -1.4046024420000549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260709 13:06:38.492831 15439 raft_consensus.cc:2393] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:38.492910 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1814024420000351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2479s for a response
W20260709 13:06:38.493382 15482 connection.cc:256] RPC call timeout handler was delayed by -1.0437024420000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26320000000000005s for a response
I20260709 13:06:38.493743 15437 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:38.489557 20377 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:38.492933 20478 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:38.497711 15436 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:38.498754 20375 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.499956 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.505218 15441 raft_consensus.cc:606] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.521770 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.528632 15584 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:38.530146 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2276) took 1351 ms. Trace:
I20260709 13:06:38.530006 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:38.530629 15517 rpcz_store.cc:276] 0709 13:06:37.173784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.176195 (+  2411us) service_pool.cc:224] Handling call
0709 13:06:38.525420 (+1349225us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54000ec754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:38.525570 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051113856}
I20260709 13:06:38.533464 15584 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:38.521770 20493 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.551473 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:38.554224 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:38.558620 16182 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:38.564051 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.564889 15588 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:38.566259 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:38.527272 20305 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:06:38.527968 20478 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:06:38.579022 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.548926 20377 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:38.537200 20280 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:06:38.557132 20452 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:38.589829 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:38.589829 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.591776 16173 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:38.568538 20468 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.598523 20377 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.600435 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:38.600843 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.598826 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.602541 15588 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:38.568511 20240 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.586246 20350 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.605712 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:38.608546 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.609724 15590 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:38.609579 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.610170 15584 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:38.610632 15585 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:38.590057 20457 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:38.611773 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.612723 15588 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:38.614432 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.614802 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.616875 20494 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.570538 20471 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:38.594403 20467 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.631294 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.632018 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:38.627163 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.632503 15585 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
W20260709 13:06:38.639602 20495 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:06:38.639729 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.645021 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:38.607466 20383 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:38.649363 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 83218.5us
I20260709 13:06:38.651257 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:38.662588 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:38.663414 15585 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:38.625671 20352 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.665222 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.635109 20450 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:38.669204 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.670603 20383 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:38.671289 20507 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:38.671936 20467 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:06:38.673086 20504 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:38.674911 20484 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.675570 20484 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.614037 20350 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.647032 20454 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:38.689553 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:38.653476 20396 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:38.695573 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:38.666150 20449 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.700109 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:38.664330 20457 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:38.668735 20280 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:38.617600 20494 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.729368 20399 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.730257 20448 raft_consensus.cc:2764] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:06:38.696547 20467 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:38.736888 20395 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.741062 20484 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:38.717681 20450 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:38.742290 20450 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:38.743503 20450 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.689553 20352 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.697225 20396 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.771322 15511 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:38.773387 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:38.755951 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:38.759240 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:38.776748 15514 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:38.778258 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.696130 20487 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.758132 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:38.781049 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 69266.3us
I20260709 13:06:38.774577 15511 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:38.709784 20280 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.765280 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:38.793776 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.795465 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:38.696663 20383 consensus_queue.cc:1059] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:06:38.798180 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:38.726698 20478 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:38.801748 15518 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:38.711928 20457 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.803308 15407 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:38.781571 20396 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:38.780846 20375 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:38.798868 20280 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.724946 20451 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:06:38.827734 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:38.788765 20471 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.804819 15512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "562c25b8842b442a928630e10d13e618"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:06:38.802758 20454 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:38.832204 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:38.832993 15518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:06:38.833928 15518 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.834411 15518 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.838021 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:38.793159 20487 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.846319 15514 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:38.835764 19692 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:38.837136 20305 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:38.814808 20330 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:06:38.844821 20377 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:38.844828 20454 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:38.871968 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 65196.2us
I20260709 13:06:38.828531 20375 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.848250 20516 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:38.878299 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:38.879235 16174 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:38.880833 16180 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:38.886425 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.889865 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:38.895172 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:38.856637 19692 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.857728 20240 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:38.858726 20352 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:38.859359 20305 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.912909 15438 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:38.863965 20512 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:38.839283 20471 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:38.943836 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:38.903342 20502 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:06:38.958563 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 130981us
I20260709 13:06:38.961166 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:38.964567 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:38.965665 15590 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
W20260709 13:06:38.950286 20506 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.281s	user 0.000s	sys 0.002s
I20260709 13:06:38.939247 19692 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:38.972770 16182 raft_consensus.cc:1240] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:38.991256 15517 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:38.949213 20305 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:38.993700 15512 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.994257 15512 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.994143 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:38.994854 16182 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:38.995673 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:38.997773 15586 raft_consensus.cc:2393] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:38.966596 20491 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.234s	user 0.001s	sys 0.001s
I20260709 13:06:38.981328 15518 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:38.970960 20356 raft_consensus.cc:993] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: : Instructing follower 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:06:38.998620 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:38.971228 19961 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:38.971287 20350 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.022699 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:39.025054 15518 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.030200 15590 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:39.031587 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:39.012185 20496 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:06:39.037185 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:38.916836 20516 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.040944 16182 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
W20260709 13:06:39.044672 20515 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:06:39.045121 20503 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
W20260709 13:06:39.047300 20511 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.248s	user 0.002s	sys 0.000s
I20260709 13:06:39.012459 20395 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:39.065050 20395 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:39.065616 20395 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.019655 19961 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:39.053495 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 51411.3us
I20260709 13:06:39.048013 20454 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.057322 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:39.006560 20514 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.266s
I20260709 13:06:39.080428 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:39.114038 20446 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 1.653s	user 0.000s	sys 0.015s
I20260709 13:06:38.957393 20512 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.082680 20494 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.083179 19961 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.059739 15512 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.085346 20409 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:06:39.077176 20452 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:39.081732 20522 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:39.065054 20518 raft_consensus.cc:1081] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Signalling peer 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:06:39.140146 20375 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:39.140952 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3002) took 1866 ms. Trace:
I20260709 13:06:39.141505 15583 rpcz_store.cc:276] 0709 13:06:37.274480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.274608 (+   128us) service_pool.cc:224] Handling call
0709 13:06:37.284298 (+  9690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.284662 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.284701 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.285306 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.334479 (+ 49173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:37.334546 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.334657 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.113070 (+1778413us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:39.140561 (+ 27491us) raft_consensus.cc:1685] finished
0709 13:06:39.140586 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.140865 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1346,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"spinlock_wait_cycles":214452096,"thread_start_us":48617,"threads_started":1,"wal-append.queue_time_us":110205}
I20260709 13:06:39.117877 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:39.093022 20493 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.544s	user 0.014s	sys 0.000s
I20260709 13:06:39.145102 20493 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:39.099215 20468 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:39.145426 20516 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.146653 15584 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:39.034880 20377 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.099854 20457 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:39.129997 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48430.2us
I20260709 13:06:39.049124 20356 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:06:39.094923 20471 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.113525 20524 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:39.093845 20354 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:39.155738 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:39.166337 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 134991us
I20260709 13:06:39.106069 20305 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.153620 15407 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:39.174115 20361 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.147764 20377 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.185353 20013 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:39.219461 15584 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:39.185652 20354 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:39.178094 20330 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:39.199947 20494 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.140211 20522 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.171813 20524 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:39.242973 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 296720us
I20260709 13:06:39.222384 20457 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:39.256829 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:39.257552 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:39.257169 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.257028 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:39.257946 16182 raft_consensus.cc:2410] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:06:39.259881 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:39.261008 15443 raft_consensus.cc:2410] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:06:39.261516 20473 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 1.141s	user 0.000s	sys 0.002s
I20260709 13:06:39.262197 20305 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.262671 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:39.263440 15587 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:39.264716 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:39.265384 15587 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:39.266386 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:39.267017 15587 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:39.266695 20457 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.245421 20494 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.272611 20494 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.269867 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:39.277171 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:39.239826 20013 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:39.287606 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:39.286705 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:39.285473 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:39.288484 15434 raft_consensus.cc:2393] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:39.288657 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3000) took 2015 ms. Trace:
I20260709 13:06:39.217013 20361 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.287446 20516 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.289151 15592 rpcz_store.cc:276] 0709 13:06:37.273737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.282175 (+  8438us) service_pool.cc:224] Handling call
0709 13:06:37.282518 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.325642 (+ 43124us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:37.895206 (+569564us) log.cc:844] Serialized 14 byte log entry
0709 13:06:37.947527 (+ 52321us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.985201 (+ 37674us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.985381 (+   180us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:37.985419 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.985491 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.260877 (+1275386us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:39.276478 (+ 15601us) raft_consensus.cc:1685] finished
0709 13:06:39.288445 (+ 11967us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.288588 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577314,"prepare.queue_time_us":569897,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":1502,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":44097,"spinlock_wait_cycles":7354112,"thread_start_us":50536,"threads_started":1,"wal-append.queue_time_us":122349}
I20260709 13:06:39.294927 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:39.286120 20471 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:39.297817 20545 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:39.298681 15443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:46590
I20260709 13:06:39.300800 20013 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.302305 15443 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.287578 20454 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:39.303768 15443 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.290750 20512 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:39.298883 20354 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.311832 20454 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.314415 20454 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.314765 15512 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.318162 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:39.318579 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:39.329717 15585 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:39.331130 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:39.299331 20471 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:39.337872 20471 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.318534 19692 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.341266 19692 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.332248 15592 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.320732 20393 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:39.352285 20393 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.370772 20395 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.376344 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:39.376889 20377 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:39.320734 20396 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.365504 15443 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.379972 15592 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:39.355432 20393 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.391276 15443 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.391462 15585 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:39.392343 15585 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:39.388700 20376 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.854s	user 0.014s	sys 0.019s
W20260709 13:06:39.394609 20478 consensus_meta.cc:287] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.007s
I20260709 13:06:39.395208 15585 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.411404 15585 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.420218 16145 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:39.424190 20361 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.425226 20478 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:39.425817 19961 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:39.426657 20280 consensus_meta.cc:287] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.003s
I20260709 13:06:39.428200 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2147) took 1102 ms. Trace:
I20260709 13:06:39.428336 15439 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:39.431862 15583 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:39.399170 20376 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.864s	user 0.014s	sys 0.019s
I20260709 13:06:39.434311 20396 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.434789 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:39.436532 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:39.437278 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:39.440403 15585 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:39.444846 15442 rpcz_store.cc:276] 0709 13:06:38.325820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.328888 (+  3068us) service_pool.cc:224] Handling call
0709 13:06:39.427106 (+1098218us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002260d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:39.428091 (+   985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369841536}
I20260709 13:06:39.481081 15518 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:39.481101 15514 raft_consensus.cc:2410] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:06:39.481221 20551 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
W20260709 13:06:39.477322 20513 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.740s	user 0.003s	sys 0.000s
I20260709 13:06:39.446205 20361 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:39.477352 20395 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.491236 15585 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.487337 19961 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.441228 20471 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.472568 20280 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:39.517869 20441 log.cc:927] Time spent T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 2.053s	user 0.005s	sys 0.007s
I20260709 13:06:39.519730 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 793) took 2411 ms. Trace:
I20260709 13:06:39.520184 15591 rpcz_store.cc:276] 0709 13:06:37.108562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.109461 (+   899us) service_pool.cc:224] Handling call
0709 13:06:37.123525 (+ 14064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.151638 (+ 28113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.151692 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.152482 (+   790us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.293602 (+141120us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:37.293671 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.293786 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.517024 (+2223238us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:39.519271 (+  2247us) raft_consensus.cc:1685] finished
0709 13:06:39.519304 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.519628 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21515,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":7201,"spinlock_wait_cycles":170175360,"thread_start_us":90011,"threads_started":1,"wal-append.queue_time_us":223759}
I20260709 13:06:39.521349 20394 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.512112 20457 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:39.560475 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:39.565200 20484 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.565577 20396 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:39.566097 20484 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.566938 20487 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.567870 20487 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.568353 20487 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.569386 20078 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:39.569980 20078 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.570712 20487 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.573658 20280 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.578871 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3146) took 2168 ms. Trace:
I20260709 13:06:39.580341 20078 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.585517 20468 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.586234 20468 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.587260 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:39.588618 20468 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:39.589710 20471 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:39.591019 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 419218us
I20260709 13:06:39.566236 20396 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.591455 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:39.593422 20396 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.594348 20522 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.596628 15482 leader_election.cc:400] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10.
I20260709 13:06:39.597064 15482 leader_election.cc:403] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:39.597759 20078 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10.
I20260709 13:06:39.598850 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:39.601243 20484 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:39.607128 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:39.608197 16174 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.579432 15509 rpcz_store.cc:276] 0709 13:06:37.410411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.633491 (+223080us) service_pool.cc:224] Handling call
0709 13:06:37.633918 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.576353 (+1942435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.576405 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.576455 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:39.576492 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.578566 (+  2074us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54002a1554. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:39.578630 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.578793 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4459819904}
I20260709 13:06:39.624938 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:39.630931 15482 leader_election.cc:400] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18.
I20260709 13:06:39.616822 20466 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.636175 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:39.628317 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:39.641019 16174 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:06:39.647694 20383 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:39.649250 20484 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:39.649827 20484 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.650389 20484 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:39.661123 20510 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.943s	user 0.001s	sys 0.000s
I20260709 13:06:39.667246 20471 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.668200 20471 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:39.669258 20509 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.943s	user 0.002s	sys 0.000s
I20260709 13:06:39.670915 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2432) took 1168 ms. Trace:
I20260709 13:06:39.671322 15437 rpcz_store.cc:276] 0709 13:06:38.502269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.502458 (+   189us) service_pool.cc:224] Handling call
0709 13:06:38.502864 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.518149 (+ 15285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.518208 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.518999 (+   791us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.604948 (+ 85949us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:38.605008 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.605083 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.668151 (+1063068us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:39.670525 (+  2374us) raft_consensus.cc:1685] finished
0709 13:06:39.670559 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.670842 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17512,"raft.queue_time_us":16029,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5744,"spinlock_wait_cycles":48775552,"thread_start_us":58116,"threads_started":1,"wal-append.queue_time_us":134500}
I20260709 13:06:39.672514 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:39.675293 20471 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:39.624836 20468 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:39.681902 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1915fdd81d344a749443e48f07a1fef8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d225833a2cbf4a5995fdbbb1292d1918 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 11 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:39.634166 20447 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:39.716187 20447 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:39.706751 20468 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:39.730131 20468 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:39.730674 20402 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.738261 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:39.635638 20454 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:06:39.756280 15509 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:39.760385 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:39.763346 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:39.764218 15516 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.682361 20466 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:39.778916 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:39.784806 15516 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:39.787274 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:39.788722 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.780741 15509 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:39.792187 15512 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:39.793219 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.775761 20454 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:39.904173 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:39.906246 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:39.805183 20454 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:39.909549 15516 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.908578 15406 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:39.921753 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 285655us
I20260709 13:06:39.957350 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:39.942364 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:39.942776 15512 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
W20260709 13:06:39.965251 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56746.4us
W20260709 13:06:39.966710 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.920051 19692 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:39.972644 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:39.973590 15512 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:39.978884 15516 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:39.979887 15512 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:39.985212 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:39.987870 15509 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.995620 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:39.998409 20560 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:06:39.999464 20559 log.cc:927] Time spent T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:06:39.979660 19961 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:40.002172 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:40.006114 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.006803 15589 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:40.025817 15589 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:40.003472 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:40.024783 16146 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:40.005838 20176 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:40.008103 20546 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:06:40.041152 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 83890.9us
I20260709 13:06:40.042016 15509 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:40.044056 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.044783 15518 raft_consensus.cc:2376] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10. Re-sending same reply.
I20260709 13:06:40.044108 20393 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.046880 15510 raft_consensus.cc:3055] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:40.047005 20393 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:40.047624 15510 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:40.047911 20393 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.048717 15510 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.049942 15510 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:39.972256 20454 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.057888 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.013700 19961 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:40.078115 15511 raft_consensus.cc:2376] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12. Re-sending same reply.
I20260709 13:06:40.080992 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:40.059500 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.022846 20466 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.084697 15509 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:40.095144 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:40.092092 20412 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.038419 20176 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:40.155418 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.159296 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:40.134990 20567 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:06:40.134421 20563 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:06:40.135740 20566 log.cc:927] Time spent T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:06:40.142930 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.164088 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.129930 20013 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.038962 20561 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:40.166412 15589 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:40.154441 20412 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.165225 20432 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:40.133673 20565 log.cc:927] Time spent T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:06:40.167618 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.131875 20383 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.103369 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:40.130441 20576 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:06:40.085557 20542 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:06:40.173589 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.110980 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.226848 15511 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:40.197942 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.199641 15510 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:06:40.204241 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.228580 15510 pending_rounds.cc:85] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:06:40.220643 15516 raft_consensus.cc:2376] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12. Re-sending same reply.
I20260709 13:06:40.228929 15510 pending_rounds.cc:107] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:06:40.229301 15510 raft_consensus.cc:2889] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.231271 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.170553 20176 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:40.190035 20561 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.180267 20013 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.243901 20524 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.193102 19961 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.239002 20575 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.246187 20575 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.247516 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2430) took 1752 ms. Trace:
I20260709 13:06:40.248013 15439 rpcz_store.cc:276] 0709 13:06:38.495430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.501651 (+  6221us) service_pool.cc:224] Handling call
0709 13:06:39.428112 (+926461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.482288 (+ 54176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.247246 (+764958us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54002260d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:40.247441 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129661696}
I20260709 13:06:40.248843 20575 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:40.253532 20412 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.256125 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.257628 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.258761 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.262284 16180 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:06:40.263049 20554 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.766s	user 0.002s	sys 0.000s
I20260709 13:06:40.264482 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.268311 15515 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:40.233911 20574 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.268456 20564 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.281s	user 0.002s	sys 0.000s
I20260709 13:06:40.277379 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.279845 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.280784 15515 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:40.281971 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.241819 20561 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:40.218737 20432 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.301581 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3156) took 2701 ms. Trace:
W20260709 13:06:40.286278 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 241614us
I20260709 13:06:40.301370 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:40.288450 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.306757 15590 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:40.308804 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:40.309170 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.309593 15437 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:40.310086 15434 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:40.310107 15437 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:40.314937 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.315917 15590 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.302126 15513 rpcz_store.cc:276] 0709 13:06:37.597562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.960462 (+362900us) service_pool.cc:224] Handling call
0709 13:06:37.961031 (+   569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.380428 (+1419397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.380482 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.384146 (+  3664us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.410005 (+ 25859us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:39.410074 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.592023 (+181949us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002e2f54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:39.592089 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.262225 (+670136us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:40.298542 (+ 36317us) raft_consensus.cc:1685] finished
0709 13:06:40.298578 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.298824 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":935,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6449,"spinlock_wait_cycles":3266107008,"thread_start_us":25359,"threads_started":1,"wal-append.queue_time_us":99077}
I20260709 13:06:40.311621 15437 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.325482 15437 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.326406 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.327114 15591 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.327874 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.328605 15442 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
W20260709 13:06:40.330571 20467 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:06:40.331184 20571 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:06:40.335870 15437 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:40.289772 20578 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:40.337248 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 427966us
I20260709 13:06:40.342749 15441 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:40.345852 15555 leader_election.cc:336] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.523s (SENT)
I20260709 13:06:40.278227 20574 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.284063 20546 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:40.338609 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:40.351068 15439 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:40.351406 15439 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:40.360697 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:40.364753 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:40.365206 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.366078 20585 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.368145 20524 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.368469 20585 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.371415 15517 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:06:40.366060 20568 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.371284 20585 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.373653 20568 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:40.374500 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.375694 20577 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:40.376418 20577 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.378775 20577 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:40.349987 20412 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.382843 16181 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:40.382913 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.358896 20576 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.380156 20524 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:40.380514 20579 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:40.379276 20587 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.382742 20412 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.379891 20575 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:40.356114 20573 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.388496 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:40.394356 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.396809 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.383888 20576 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.401192 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.402827 15584 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:40.389760 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.409581 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.411659 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:40.411891 15590 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:40.418665 15591 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:40.426975 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.415746 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:40.428503 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.347088 20578 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.432698 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.463696 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 2148) took 1562 ms. Trace:
I20260709 13:06:40.464253 15583 rpcz_store.cc:276] 0709 13:06:38.901009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.143392 (+242383us) service_pool.cc:224] Handling call
0709 13:06:39.431651 (+288259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.481930 (+ 50279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.463421 (+981491us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540016d5d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:40.463616 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661897984}
I20260709 13:06:40.466421 15583 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:40.469204 15583 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:40.436520 20432 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.438246 20412 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.393249 20579 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.393790 20587 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:40.441804 20576 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.409219 20573 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.391999 20471 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:40.446812 20467 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:40.401772 20575 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:40.447888 20583 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.492436 20578 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:40.493042 20583 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:40.493570 20583 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.430543 20577 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:40.494529 20577 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:40.494967 20577 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:40.448515 20538 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:40.495582 20402 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.746s	user 0.015s	sys 0.001s
I20260709 13:06:40.495983 20538 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.497365 20579 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:40.498715 20538 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.450359 20461 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.430346 20546 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.499773 15588 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:40.500411 20452 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.488528 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:40.454028 20500 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.905s	user 0.005s	sys 0.001s
I20260709 13:06:40.509310 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:40.455509 20447 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:40.459131 20355 raft_consensus.cc:993] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
W20260709 13:06:40.460776 20484 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.009s
W20260709 13:06:40.474922 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65455us
I20260709 13:06:40.500896 20467 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:40.513442 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.499624 20587 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:40.461051 20570 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:06:40.491454 20573 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.495281 20013 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.533624 20573 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:40.431196 20590 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:40.481766 20356 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:40.477367 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:40.534781 20557 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.634s	user 0.000s	sys 0.003s
I20260709 13:06:40.535149 15514 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:40.527340 15590 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:40.536810 15514 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:40.536876 15590 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.538357 15514 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:40.538566 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:40.538985 20454 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.539566 20340 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:40.492647 20575 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.525400 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.512241 20447 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:40.531775 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.542743 15514 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:40.532084 20576 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:40.532234 20383 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:40.542261 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:40.540009 20340 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.540489 20578 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:40.565264 20340 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.565513 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.545755 20538 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:40.447410 20393 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.567312 20538 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.569803 20393 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.570508 20538 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.499655 20461 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.518893 20484 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.572460 20447 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.548419 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.573477 20461 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.573688 20484 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.547500 20471 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:40.515807 20579 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:40.574602 20579 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.575029 20579 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:40.575681 20576 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:40.576239 20576 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:40.576712 20568 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.577234 20576 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.549829 15437 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:40.518214 19961 raft_consensus.cc:1081] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:06:40.520609 20467 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.500896 20452 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.585829 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:40.557578 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.586966 15510 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:40.587246 15584 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:40.587416 20587 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:40.588215 15434 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:40.588722 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.591585 15441 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:06:40.593211 15588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 3020) took 1979 ms (client timeout 1655 ms). Trace:
W20260709 13:06:40.593854 15588 rpcz_store.cc:269] 0709 13:06:38.614232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.614422 (+   190us) service_pool.cc:224] Handling call
0709 13:06:40.593019 (+1978597us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540024ac54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:40.593139 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4332553472}
I20260709 13:06:40.594300 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3034) took 1400 ms. Trace:
I20260709 13:06:40.585353 20412 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:40.594697 15592 rpcz_store.cc:276] 0709 13:06:39.193793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.383781 (+189988us) service_pool.cc:224] Handling call
0709 13:06:39.384180 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.384548 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.384577 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.385055 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.619950 (+234895us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:39.620017 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.620131 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.534094 (+913963us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:40.593993 (+ 59899us) raft_consensus.cc:1685] finished
0709 13:06:40.594015 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.594240 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":312,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6151,"spinlock_wait_cycles":9079040,"thread_start_us":211750,"threads_started":1,"wal-append.queue_time_us":385038}
I20260709 13:06:40.547179 15442 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:40.595917 20412 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:40.603221 15436 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:40.591003 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:40.599798 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.595389 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.601325 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.596946 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:40.605261 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.606178 15588 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 14: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:40.564183 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.605979 15435 raft_consensus.cc:2368] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 14. Current term is 15.
I20260709 13:06:40.520226 20569 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:40.615125 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51050.7us
I20260709 13:06:40.617822 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.615062 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:40.602113 16146 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.847s (SENT) [suppressed 18 similar messages]
I20260709 13:06:40.500823 20561 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.624145 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.625051 15442 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:40.625232 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.604987 15440 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:40.612684 15590 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:40.613027 15434 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:40.564211 15439 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.623035 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.626703 15439 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.627102 15443 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:40.620764 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.622815 20464 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:40.621574 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:40.548026 20585 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.631837 20585 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.634306 20585 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.634419 20078 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:06:40.620293 20587 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:40.635905 20452 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.639017 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.640707 20587 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.642064 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.611919 20412 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.643870 20590 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:40.646751 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.639477 20517 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.639791 20452 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.630812 20280 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:40.597008 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.646214 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.656626 15440 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:40.661110 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.666625 16173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 525) took 1782 ms. Trace:
I20260709 13:06:40.669592 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.671458 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.577287 20568 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.667176 16173 rpcz_store.cc:276] 0709 13:06:38.877401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.877550 (+   149us) service_pool.cc:224] Handling call
0709 13:06:38.881104 (+  3554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.881619 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.881665 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.901609 (+ 19944us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.175706 (+274097us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:39.175772 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.175884 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.344722 (+168838us) raft_consensus.cc:1685] finished
0709 13:06:39.344758 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.647583 (+1302825us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b540060d950. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:40.659248 (+ 11665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":802,"raft.queue_time_us":21411,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":28827,"spinlock_wait_cycles":2469248,"thread_start_us":178548,"threads_started":1,"wal-append.queue_time_us":291131,"wal-append.run_cpu_time_us":2823,"wal-append.run_wall_time_us":1083627}
I20260709 13:06:40.674317 15440 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:40.676431 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.692718 15434 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:40.623409 20569 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.687884 15436 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:40.688455 16181 raft_consensus.cc:2393] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:40.694303 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.654865 20517 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:40.702636 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49385.6us
I20260709 13:06:40.661556 20377 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.706459 20383 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.720446 20568 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.714035 20517 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.712411 20356 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.724565 20356 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.728412 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.728209 20377 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.648152 20176 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.731870 20471 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:40.727272 20356 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.731184 20377 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.734048 20357 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:40.734314 20176 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.734582 20357 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:40.715847 20512 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.735883 20512 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.736112 20357 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.737139 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.738039 20357 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.738776 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.733493 20471 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:40.715946 20402 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.741673 20402 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.742252 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.740711 20572 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:40.753664 20572 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:40.754632 20572 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.756259 20572 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:40.662318 20452 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.752344 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:40.761255 20452 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.761543 15441 raft_consensus.cc:1240] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:40.752893 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.767378 15434 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:40.776404 15556 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.777208 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.777843 15588 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:40.778294 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:40.778131 20452 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:40.781116 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.782776 15585 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:40.784049 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.786935 20561 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.790851 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:40.794194 15556 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.791952 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:40.792196 20471 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:40.795985 20517 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.797209 15587 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:40.796864 20577 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:40.792501 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.792866 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:40.801551 20394 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:40.803709 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.804284 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.804593 20357 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.804982 15584 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:40.805672 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:40.806133 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:40.809943 20574 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.806241 16174 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.793289 20569 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:40.793658 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:40.798000 15514 raft_consensus.cc:1240] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:40.824360 15556 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.834203 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.836735 16180 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:40.843151 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:40.843592 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.844472 15587 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:06:40.844846 15584 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:06:40.846014 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.853430 15584 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:40.857844 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.862114 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.864866 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.864091 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.869436 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.835733 20288 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:40.901930 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.719297 20383 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.890401 15584 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
W20260709 13:06:40.907758 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.909425 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.901262 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.841068 20357 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:40.900676 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:40.747233 20583 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.923017 15442 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:40.930151 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.755368 20340 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.923895 15592 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:40.888525 15588 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
W20260709 13:06:40.924011 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 59120.3us
I20260709 13:06:40.937887 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.938915 15592 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:40.895123 15439 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:40.926906 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.868070 20395 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:40.867256 20464 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:40.945016 16174 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:40.892956 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:40.954501 15590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:06:40.929764 15436 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:40.955525 15590 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.956274 15516 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:40.956247 15590 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:40.946885 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.949908 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.952618 15587 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:40.862279 20412 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.866153 20176 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:06:40.929008 20355 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:40.941093 20402 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:40.963564 19961 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:40.951527 20357 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:40.932310 20586 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:40.979627 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:40.925532 20579 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:40.922487 20288 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.967794 20377 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.001353 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 399237us
I20260709 13:06:41.020752 15590 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:40.998309 20583 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:40.950249 20395 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:41.011783 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.990347 20013 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:41.018913 15586 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:40.972357 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:40.975378 20468 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:06:41.069041 15588 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:41.022851 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:41.066280 15556 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:41.067438 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48931.9us
I20260709 13:06:41.072511 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:41.076090 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:41.067878 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:41.078117 15592 raft_consensus.cc:3060] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:40.999073 19961 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.081568 15511 raft_consensus.cc:2393] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:41.007582 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1915fdd81d344a749443e48f07a1fef8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:41.077478 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:41.145460 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.141597 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.089102 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 543541us
W20260709 13:06:41.131032 15483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.025s	sys 0.018s
W20260709 13:06:41.155488 15483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.025s	sys 0.020s
I20260709 13:06:41.157536 15516 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:41.161695 15587 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:41.169023 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:41.068442 20013 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.066140 20587 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.201138 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:41.201767 15436 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:41.226121 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:41.133358 20591 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:41.202471 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:41.203490 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:41.166673 20546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.031s	sys 0.016s
W20260709 13:06:41.146090 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 138518us
I20260709 13:06:41.210750 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:41.233644 15587 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:41.234886 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:41.188946 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 98216.3us
I20260709 13:06:41.183393 15592 raft_consensus.cc:2468] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
W20260709 13:06:41.213455 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.229020 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:41.086789 20402 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:41.156001 20467 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:41.072486 20377 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.268456 20467 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.270484 20467 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:41.272784 20594 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:06:41.274433 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2292) took 1172 ms. Trace:
I20260709 13:06:41.274993 15517 rpcz_store.cc:276] 0709 13:06:40.102434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.372456 (+270022us) service_pool.cc:224] Handling call
0709 13:06:40.372790 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.373167 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.373205 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.373782 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.664280 (+290498us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.664326 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.664413 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.274080 (+609667us) raft_consensus.cc:1685] finished
0709 13:06:41.274122 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.274346 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":280,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":290047,"threads_started":1,"wal-append.queue_time_us":557987}
I20260709 13:06:41.241305 20568 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:41.277397 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:41.279363 20383 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:41.279783 20454 consensus_meta.cc:287] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.006s
I20260709 13:06:41.280812 15518 raft_consensus.cc:2410] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:41.279385 15517 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.230767 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:41.206039 15588 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:41.145663 19961 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:41.237082 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:41.284475 15592 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:41.242059 15442 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:41.150657 20577 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:41.231938 20546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.031s	sys 0.017s
I20260709 13:06:41.245934 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:41.228346 20572 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:41.287343 20578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.030s	sys 0.047s
I20260709 13:06:41.216889 20013 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:41.253440 20597 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:06:41.254114 20512 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:41.255856 20340 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:41.336777 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.334630 15517 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:41.261169 20288 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:41.230662 20357 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:41.241544 20402 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.267051 20583 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:41.208770 20464 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:06:41.221450 20574 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:41.228328 15434 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:41.281749 16178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.014s	sys 0.053s
W20260709 13:06:41.352031 16178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.015s	sys 0.054s
W20260709 13:06:41.154907 20575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.020s	sys 0.040s
I20260709 13:06:41.232710 20587 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.082050 20176 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.157s
I20260709 13:06:41.211598 20517 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:41.232335 20437 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:41.069916 20544 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.159s
I20260709 13:06:41.226490 15590 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:41.233024 20355 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.271205 20467 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:06:41.021417 20588 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:41.277603 20579 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:41.270562 20377 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:41.310849 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 65046.6us
I20260709 13:06:41.227041 20240 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
W20260709 13:06:41.317216 20457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.037s	sys 0.057s
I20260709 13:06:41.340245 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:41.331822 20578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.034s	sys 0.048s
I20260709 13:06:41.019883 20586 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:41.342792 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:41.325362 20454 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:41.357054 15513 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.024s	sys 0.048s
I20260709 13:06:41.301064 20591 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:41.023241 20432 consensus_queue.cc:1059] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.201s
W20260709 13:06:41.365461 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.278616 20568 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:41.375098 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.344455 20402 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:41.355412 20575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.021s	sys 0.040s
I20260709 13:06:41.333598 20572 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:41.380645 20340 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:41.410535 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.359737 20574 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:41.413559 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 73460us
W20260709 13:06:41.429733 15513 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.024s	sys 0.050s
I20260709 13:06:41.430600 15517 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:41.420740 20461 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:41.405277 20588 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.438313 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:41.408725 20412 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:41.412876 20457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.037s	sys 0.057s
I20260709 13:06:41.418313 20578 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:41.471387 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2289) took 1369 ms. Trace:
I20260709 13:06:41.484366 15517 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:41.431211 20454 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:41.493234 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55023.8us
I20260709 13:06:41.518307 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.443940 20484 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:41.524833 15517 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:41.515815 15513 rpcz_store.cc:276] 0709 13:06:40.101484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.323814 (+222330us) service_pool.cc:224] Handling call
0709 13:06:40.346142 (+ 22328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.355125 (+  8983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.355163 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.364872 (+  9709us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.652543 (+287671us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:41.445177 (+792634us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.470822 (+ 25645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.470958 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.471028 (+    70us) raft_consensus.cc:1685] finished
0709 13:06:41.471046 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.471284 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":622487,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":56994,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":16149,"thread_start_us":983256,"threads_started":2,"wal-append.queue_time_us":576095}
I20260709 13:06:41.407902 20355 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:41.580709 15585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.017s	sys 0.037s
W20260709 13:06:41.582239 15585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.017s	sys 0.037s
I20260709 13:06:41.446259 20340 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:41.506283 20447 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:41.568239 20596 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:06:41.571046 20598 log.cc:927] Time spent T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:06:41.436349 20579 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:06:41.575225 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.589990 15517 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:41.591387 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.495211 20588 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:41.594786 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.596427 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.506526 20467 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:41.600683 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:41.602963 15517 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:41.500162 20461 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 11 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:41.506969 20606 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.604373 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 526999us
I20260709 13:06:41.575685 20454 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:41.606619 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.607563 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.574142 20484 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:41.616284 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:41.582479 20575 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:41.624715 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:41.617311 15407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.019s	sys 0.012s
W20260709 13:06:41.634976 15407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.020s	sys 0.012s
W20260709 13:06:41.635883 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 563466us
I20260709 13:06:41.526738 20395 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:41.631735 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 819) took 1311 ms. Trace:
I20260709 13:06:41.639946 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.638898 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:41.639854 15589 rpcz_store.cc:276] 0709 13:06:40.324665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.451116 (+126451us) service_pool.cc:224] Handling call
0709 13:06:40.451648 (+   532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.452154 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.452193 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.452850 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.904346 (+451496us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:40.904603 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.904719 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.631454 (+726735us) raft_consensus.cc:1685] finished
0709 13:06:41.631478 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.631666 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":451073,"threads_started":1,"wal-append.queue_time_us":879045}
I20260709 13:06:41.631803 20605 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.645934 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:41.646662 15513 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:41.646943 20586 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:41.652410 20484 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:41.657371 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:41.659078 20383 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:41.660171 20569 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:41.735041 15408 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.032s	sys 0.056s
W20260709 13:06:41.735635 15408 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.033s	sys 0.056s
W20260709 13:06:41.735972 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.660671 20605 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:41.661655 20288 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:41.662690 20395 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:41.664345 20583 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.668977 16178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52910 (request call id 508) took 1122 ms. Trace:
I20260709 13:06:41.670457 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:41.672078 20340 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:41.677588 20574 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:41.677969 20402 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.679092 20572 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:41.681985 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:41.760759 15438 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.018s	sys 0.087s
W20260709 13:06:41.761214 15438 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.018s	sys 0.087s
I20260709 13:06:41.762295 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.763257 15516 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:41.764621 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.682271 20355 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:41.685894 20578 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.688253 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 821) took 1214 ms. Trace:
I20260709 13:06:41.756132 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:41.740911 20587 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:41.691828 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.774878 15511 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:41.776207 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.777055 15511 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:41.603973 20601 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:41.778085 20601 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.780637 20601 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:41.606192 20467 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:41.781381 20467 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:41.782040 20561 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:41.782537 20561 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:41.695323 20590 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:41.783166 20590 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:41.696442 15518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2281) took 1640 ms (client timeout 1799 ms). Trace:
I20260709 13:06:41.609436 20591 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.701241 20579 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:41.702970 20599 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.361s	user 0.008s	sys 0.002s
I20260709 13:06:41.702801 20176 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:41.704813 20577 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:41.706395 15513 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:41.744176 20568 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:41.707736 20575 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.713977 15517 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
W20260709 13:06:41.715425 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 53013.7us
I20260709 13:06:41.818507 15440 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:41.757144 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:41.820608 15443 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:41.821013 15443 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:41.820923 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:41.821830 15513 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:41.822930 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.752911 16178 rpcz_store.cc:276] 0709 13:06:40.546744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.547590 (+   846us) service_pool.cc:224] Handling call
0709 13:06:40.610449 (+ 62859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.613213 (+  2764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.613259 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.613948 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.352738 (+738790us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:41.352808 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.352926 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.668645 (+315719us) raft_consensus.cc:1685] finished
0709 13:06:41.668678 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.668887 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5482,"raft.queue_time_us":9642,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":6924,"thread_start_us":723323,"threads_started":1,"wal-append.queue_time_us":973116}
I20260709 13:06:41.699018 20461 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:41.766631 15516 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:41.770975 20437 raft_consensus.cc:3055] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:41.773504 15586 rpcz_store.cc:276] 0709 13:06:40.474525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.645937 (+171412us) service_pool.cc:224] Handling call
0709 13:06:40.646272 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.064864 (+418592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.687933 (+623069us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54001c1454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:41.688177 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856408960}
I20260709 13:06:41.640195 20606 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.786285 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:41.787623 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:41.788626 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:41.790009 15436 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:41.784122 15518 rpcz_store.cc:269] 0709 13:06:40.056681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.057383 (+   702us) service_pool.cc:224] Handling call
0709 13:06:41.696152 (+1638769us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001e4bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:41.696369 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2549124480}
I20260709 13:06:41.794243 15587 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:41.829881 15511 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:41.829131 20437 raft_consensus.cc:740] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:41.836696 20437 consensus_queue.cc:260] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:41.806569 15515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.071s	sys 0.077s
I20260709 13:06:41.806890 20590 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.706754 20576 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:41.766153 20478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.042s	sys 0.074s
I20260709 13:06:41.817826 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:41.860416 15517 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:41.838555 20604 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.471s	user 0.004s	sys 0.001s
I20260709 13:06:41.833482 20372 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:41.841568 15515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.072s	sys 0.077s
I20260709 13:06:41.810094 20579 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.849337 15518 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:41.808801 20577 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:41.857496 20478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.043s	sys 0.075s
I20260709 13:06:41.821983 15443 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.910468 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2290) took 1808 ms. Trace:
I20260709 13:06:41.845716 15513 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:41.850747 20437 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:41.919827 15443 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:41.911790 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 2158) took 1524 ms. Trace:
I20260709 13:06:41.921236 15583 rpcz_store.cc:276] 0709 13:06:40.387756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.501244 (+113488us) service_pool.cc:224] Handling call
0709 13:06:40.511758 (+ 10514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.512213 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.512248 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.514156 (+  1908us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.940154 (+425998us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.940205 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.940288 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.702239 (+761951us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:41.855565 (+153326us) raft_consensus.cc:1685] finished
0709 13:06:41.855602 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.911682 (+ 56080us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24335,"raft.queue_time_us":320,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":6039,"spinlock_wait_cycles":17868800,"thread_start_us":417515,"threads_started":1,"wal-append.queue_time_us":798479}
I20260709 13:06:41.919482 15515 rpcz_store.cc:276] 0709 13:06:40.101801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.338701 (+236900us) service_pool.cc:224] Handling call
0709 13:06:40.339056 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.339374 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:40.661302 (+321928us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.910103 (+1248801us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.910162 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:41.910209 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.910273 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.910406 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":901585,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":3818,"thread_start_us":1551515,"threads_started":2}
I20260709 13:06:41.924146 15515 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:41.925946 15515 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:41.872515 20395 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:41.911180 20569 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:41.909746 20372 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:41.930891 20590 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:41.958936 15514 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.024s	sys 0.048s
W20260709 13:06:41.962307 15514 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.024s	sys 0.048s
I20260709 13:06:41.936708 20288 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:41.966056 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 323065us
I20260709 13:06:41.949388 20618 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.977393 15517 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:41.974309 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:41.956946 20395 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:41.972560 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 315268us
I20260709 13:06:42.060786 16146 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:41.961535 20372 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:42.000808 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 330423us
W20260709 13:06:42.021020 20613 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:06:42.027129 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.031648 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 211749us
I20260709 13:06:41.960889 20569 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.126713 15518 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:42.144888 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:41.963768 20393 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:41.972991 20568 consensus_queue.cc:1059] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:06:42.055724 16145 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:42.169879 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 114255us
I20260709 13:06:42.057309 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:42.059403 15510 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:42.171908 15436 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:42.059444 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 85307.1us
I20260709 13:06:42.173503 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:41.997247 20601 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:06:42.067229 15443 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
W20260709 13:06:42.072786 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.054016 20357 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.161892 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 95742.4us
W20260709 13:06:42.142251 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.997037 20618 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.167186 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:42.176467 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.125998 20578 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.177716 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:42.166106 20620 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.178717 20622 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.179750 20546 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:42.180279 20627 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:41.973887 20577 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.180604 16178 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:42.180945 20616 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:06:42.181370 20612 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:06:42.181638 20402 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:42.187709 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.508s (SENT)
W20260709 13:06:42.081703 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.186218 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:42.193213 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:42.197219 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.216147 20583 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:42.213778 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:42.066660 20078 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:42.201381 20614 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
W20260709 13:06:42.066279 20615 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.246s	user 0.001s	sys 0.001s
I20260709 13:06:42.058425 20340 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.127604 20383 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.229848 20627 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:42.143632 20544 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:06:42.058712 20280 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:42.220757 20572 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.248044 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:42.231859 20394 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.430s	user 0.016s	sys 0.005s
W20260709 13:06:42.277932 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 105037us
I20260709 13:06:42.258188 16146 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:42.220942 20466 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:42.261121 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 74989.9us
I20260709 13:06:42.276149 20601 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:42.263973 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:42.126266 20432 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:42.232285 20468 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.066402 20288 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.270951 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:42.296371 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 91898.5us
I20260709 13:06:42.217097 20357 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.275156 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:42.262871 19961 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.949s	user 0.017s	sys 0.000s
I20260709 13:06:42.247526 20452 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.285024 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:42.226814 20622 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.222990 20578 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.236747 20568 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:06:42.226337 20404 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.265297 20575 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:42.227843 20620 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.259594 20078 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:42.281935 20013 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.940s	user 0.012s	sys 0.004s
I20260709 13:06:42.271412 20627 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:42.388851 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1915fdd81d344a749443e48f07a1fef8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:42.296187 20402 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.274295 20280 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:42.300406 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:42.328449 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43557.2us
I20260709 13:06:42.292651 20478 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:42.270362 20340 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.247813 20395 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.292454 20396 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.378578 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3056) took 1509 ms. Trace:
I20260709 13:06:42.380111 20078 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:42.381075 20626 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:06:42.380879 20618 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:42.434298 20618 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:42.288616 20572 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.435918 20396 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.437366 15435 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
W20260709 13:06:42.381875 20621 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
W20260709 13:06:42.385926 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 107252us
I20260709 13:06:42.440814 20544 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:42.441303 20544 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:42.325218 20601 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:42.272038 20383 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.398284 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3204) took 1239 ms. Trace:
I20260709 13:06:42.332175 20452 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:41.865440 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:42.450834 15509 rpcz_store.cc:276] 0709 13:06:41.159027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.159158 (+   131us) service_pool.cc:224] Handling call
0709 13:06:41.218482 (+ 59324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:41.233298 (+ 14816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.233331 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:41.241292 (+  7961us) log.cc:844] Serialized 52 byte log entry
0709 13:06:41.800358 (+559066us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b180002bc00. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:41.975828 (+175470us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.975888 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.976131 (+   243us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.385693 (+409562us) raft_consensus.cc:1685] finished
0709 13:06:42.385721 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.398155 (+ 12434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14148,"raft.queue_time_us":22658,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"spinlock_wait_cycles":39344000,"thread_start_us":175186,"threads_started":1,"wal-append.queue_time_us":1002063}
W20260709 13:06:42.323289 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 135618us
W20260709 13:06:42.414546 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 114190us
I20260709 13:06:42.339751 20568 consensus_queue.cc:1243] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:42.291028 20466 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.427007 20280 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.318086 20468 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:42.443086 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.425341 15584 rpcz_store.cc:276] 0709 13:06:40.868789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.929985 (+ 61196us) service_pool.cc:224] Handling call
0709 13:06:40.930333 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.930708 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.930741 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.936622 (+  5881us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.478406 (+541784us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.478487 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.478596 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.378250 (+899654us) raft_consensus.cc:1685] finished
0709 13:06:42.378278 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.378497 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12286,"raft.queue_time_us":1296,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13459,"thread_start_us":460381,"threads_started":1,"wal-append.queue_time_us":846595}
I20260709 13:06:42.324019 19961 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.415020 20587 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.394485 20013 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.424266 20575 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:42.379372 20404 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.481726 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:42.439345 20572 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:42.454685 20447 consensus_meta.cc:287] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.861s	user 0.005s	sys 0.010s
I20260709 13:06:42.413458 20402 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.493782 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:42.497084 20634 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:06:42.491014 15584 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:42.492295 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3040) took 1718 ms. Trace:
I20260709 13:06:42.499037 15591 rpcz_store.cc:276] 0709 13:06:40.774408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.774574 (+   166us) service_pool.cc:224] Handling call
0709 13:06:40.775083 (+   509us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:40.775629 (+   546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.775663 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:40.927164 (+151501us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b2c00033248. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:06:40.936366 (+  9202us) log.cc:844] Serialized 52 byte log entry
0709 13:06:41.441572 (+505206us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:41.492594 (+ 51022us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.492981 (+   387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.493085 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.656889 (+163804us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b1800150580. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:42.492047 (+835158us) raft_consensus.cc:1685] finished
0709 13:06:42.492070 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.492232 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61292,"prepare.queue_time_us":50607,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":617,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":26661,"spinlock_wait_cycles":233188480,"thread_start_us":457744,"threads_started":1,"wal-append.queue_time_us":855947}
I20260709 13:06:42.472234 20524 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.503980 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 96493.8us
I20260709 13:06:42.503116 15436 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:42.518952 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:42.520884 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:42.522920 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:42.523119 15586 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
W20260709 13:06:42.489804 20636 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:06:42.525928 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:42.534610 15584 raft_consensus.cc:2393] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 9: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:06:42.527144 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 229081us
I20260709 13:06:42.544981 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:42.547052 15592 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 7.
I20260709 13:06:42.548139 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:42.549041 15585 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
W20260709 13:06:42.548633 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 290570us
I20260709 13:06:42.551630 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:42.498067 20601 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.553961 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:42.504653 20280 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:42.532748 20467 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.751s	user 0.015s	sys 0.000s
I20260709 13:06:42.597756 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:42.605329 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:42.606941 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:42.599450 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54580.8us
I20260709 13:06:42.507830 20625 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.603025 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:42.599192 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44191.7us
W20260709 13:06:42.604862 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 163386us
I20260709 13:06:42.612726 15436 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
W20260709 13:06:42.630146 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.489084 20587 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.646656 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:42.649716 15518 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17. Ops: [15.9-16.10]
I20260709 13:06:42.547803 20630 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:42.554003 20575 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:42.652354 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 98483.2us
I20260709 13:06:42.687451 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:42.524006 20644 raft_consensus.cc:2804] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:42.670395 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.717172 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.670715 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62059.3us
I20260709 13:06:42.718112 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:42.658102 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3210) took 1478 ms. Trace:
I20260709 13:06:42.676998 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:42.614272 20633 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:42.508319 20544 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.542361 20524 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.721634 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:42.677451 20618 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:42.650380 20601 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:06:42.645602 20461 consensus_queue.cc:1059] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:06:42.677973 20656 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:42.730262 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:42.720539 15514 rpcz_store.cc:276] 0709 13:06:41.179532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.186859 (+  7327us) service_pool.cc:224] Handling call
0709 13:06:41.187193 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.187404 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:41.963526 (+776122us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.657657 (+694131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.657729 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:42.657788 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.657868 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.658023 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3295,"prepare.queue_time_us":88535,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":16516,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":9688,"thread_start_us":1412297,"threads_started":3,"wal-append.queue_time_us":324598}
I20260709 13:06:42.691309 20622 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:42.719652 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:42.723016 20394 raft_consensus.cc:2764] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:06:42.740737 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 138624us
I20260709 13:06:42.722747 20633 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:42.736280 20647 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:06:42.804622 15589 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:06:42.645213 20467 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.645094 20625 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.723717 20357 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:42.810536 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 90986.5us
I20260709 13:06:42.724604 20648 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:42.734710 20578 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:42.741876 20653 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.005s
W20260709 13:06:42.809331 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 89173us
I20260709 13:06:42.701335 20575 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.830087 16180 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:06:42.831914 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:42.831435 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:42.829937 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:42.809293 20633 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.820508 20355 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:42.742090 20644 raft_consensus.cc:697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:42.816856 20622 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.798447 20618 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:42.852715 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:42.864562 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.832015 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:42.869735 16179 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:42.873111 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 556) took 2241 ms. Trace:
I20260709 13:06:42.873865 15437 rpcz_store.cc:276] 0709 13:06:40.621780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.621992 (+   212us) service_pool.cc:224] Handling call
0709 13:06:40.622338 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.622590 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:40.939822 (+317232us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.850217 (+1910395us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b180043d9e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a
0709 13:06:42.862945 (+ 12728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.863037 (+    92us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:42.863118 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.863238 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.863437 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12292,"prepare.queue_time_us":727798,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":19542,"raft.queue_time_us":20901,"spinlock_wait_cycles":16659712,"thread_start_us":731731,"threads_started":2,"wal-append.queue_time_us":864897}
I20260709 13:06:42.840204 20648 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:42.848866 20452 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:42.848539 20357 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.849960 20572 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.878371 20355 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:42.885697 20650 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:42.886433 20461 raft_consensus.cc:3055] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:42.893266 20618 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.849650 20657 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.865418 20013 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:42.858161 20468 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:42.866421 20616 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:42.797605 20631 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
W20260709 13:06:42.909660 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 263109us
I20260709 13:06:42.934700 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:42.873497 20466 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:42.920202 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:42.878087 20340 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:42.927156 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 312296us
I20260709 13:06:42.940855 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:42.904912 20627 consensus_meta.cc:287] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 13:06:42.887867 20648 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.906318 20628 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:42.937142 16180 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:42.938673 16179 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:42.905195 20452 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.948164 20627 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.908272 20404 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:42.910599 20461 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:42.880720 20622 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.992841 20659 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:42.937243 20454 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.315s	user 0.015s	sys 0.002s
I20260709 13:06:42.908411 20572 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:43.016566 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3201) took 1859 ms. Trace:
I20260709 13:06:42.924377 20643 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:06:42.982309 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:42.985689 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 101858us
I20260709 13:06:42.936621 20664 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.933966 20588 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.319s	user 0.013s	sys 0.004s
I20260709 13:06:42.907721 20357 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:42.986050 20657 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:42.980795 20601 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:42.950198 20468 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.997699 20628 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:43.017454 15512 rpcz_store.cc:276] 0709 13:06:41.157440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.157625 (+   185us) service_pool.cc:224] Handling call
0709 13:06:41.219268 (+ 61643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.500244 (+280976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.500295 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.500362 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:41.500416 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.016145 (+1515729us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400213254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:43.016232 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.016459 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645431680}
I20260709 13:06:43.032083 16181 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:43.004846 20651 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:06:42.987560 20466 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:42.995316 20447 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:43.026714 20355 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.055814 20447 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.056237 20569 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.058068 20447 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.021761 20454 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.060328 20627 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.018889 20659 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:43.032387 20437 consensus_meta.cc:287] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 1.096s	user 0.017s	sys 0.000s
I20260709 13:06:43.023803 20587 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:42.999281 20668 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.023816 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:43.049787 20561 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:42.808643 20656 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:43.030835 20404 raft_consensus.cc:2764] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:06:43.074745 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51075.4us
I20260709 13:06:43.034513 20664 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.061808 20454 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.027781 20383 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:42.995071 20452 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.078711 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:43.080602 20576 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.220s	user 0.018s	sys 0.000s
I20260709 13:06:43.090632 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:43.076038 20578 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.093333 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:43.081995 20587 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:43.095958 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 72724.8us
W20260709 13:06:43.097091 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.045428 20601 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.085445 20467 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:42.984377 20644 consensus_queue.cc:237] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:43.105569 20664 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:43.034093 20588 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.104678 20659 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.078914 20627 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:06:43.091269 20468 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:43.165367 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:43.166648 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:43.096237 20404 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:43.065408 20461 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:43.169735 15437 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:43.168347 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:43.168635 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:43.042351 20657 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.209955 20657 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:43.210577 16177 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:43.100927 20587 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:43.165951 20078 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.005s
I20260709 13:06:43.167838 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:43.164386 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:43.130120 20645 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:43.212299 20078 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:43.213259 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.213403 20645 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:43.203841 20372 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 1.042s	user 0.020s	sys 0.006s
I20260709 13:06:43.213984 20645 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:43.214164 20372 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:43.214694 20078 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:43.100147 20524 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:43.212723 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48441.4us
W20260709 13:06:43.204149 15435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 557) took 2540 ms (client timeout 2035 ms). Trace:
I20260709 13:06:43.222226 15442 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:06:43.222534 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.128468 20575 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.224498 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:43.225415 15512 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:43.216094 15437 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:43.217473 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:43.230991 15591 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
I20260709 13:06:43.232751 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:43.232841 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:43.221045 15435 rpcz_store.cc:269] 0709 13:06:40.624779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.624937 (+   158us) service_pool.cc:224] Handling call
0709 13:06:43.136502 (+2511565us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54002d0d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:43.164792 (+ 28290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4165863680}
I20260709 13:06:43.162914 20622 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:43.098152 20578 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.211803 20587 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.257298 15435 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:06:43.257357 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:43.237251 20372 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.080180 20668 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:43.263247 20603 log.cc:927] Time spent T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.653s	user 0.006s	sys 0.004s
I20260709 13:06:43.275141 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:43.290650 20675 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:06:43.291720 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 554) took 2712 ms. Trace:
I20260709 13:06:43.292202 15438 rpcz_store.cc:276] 0709 13:06:40.579719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.583670 (+  3951us) service_pool.cc:224] Handling call
0709 13:06:40.584446 (+   776us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:40.585029 (+   583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.585067 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:40.585964 (+   897us) log.cc:844] Serialized 52 byte log entry
0709 13:06:41.006559 (+420595us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:41.765600 (+759041us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.962200 (+196600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.962341 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.085211 (+1122870us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:43.291261 (+206050us) raft_consensus.cc:1685] finished
0709 13:06:43.291437 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.291649 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":401100,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":63,"raft.queue_time_us":146883,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":24604,"spinlock_wait_cycles":118487296,"thread_start_us":1292111,"threads_started":3,"wal-append.queue_time_us":905759}
I20260709 13:06:43.296801 20656 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:43.265842 20524 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:43.274427 20622 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:06:43.276940 20522 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:43.262630 20404 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:43.276113 20432 consensus_meta.cc:287] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.976s	user 0.005s	sys 0.009s
I20260709 13:06:43.215027 20645 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.164005 20628 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.269527 20648 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:43.917780 15518 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.017s	sys 0.051s
W20260709 13:06:43.519186 20478 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.099s	user 0.010s	sys 0.002s
W20260709 13:06:43.643392 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.975831 20013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.008s	sys 0.009s
W20260709 13:06:43.891875 15482 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.000s	sys 0.008s
W20260709 13:06:43.403040 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.038641 20588 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:43.917263 15509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.031s	sys 0.042s
W20260709 13:06:43.875231 15407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.008s	sys 0.000s
I20260709 13:06:43.908327 15436 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:06:44.040688 15407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.011s	sys 0.009s
W20260709 13:06:43.883100 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.042192 15518 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.017s	sys 0.065s
I20260709 13:06:43.909533 15443 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:06:43.782994 20633 consensus_meta.cc:287] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.915s	user 0.014s	sys 0.000s
I20260709 13:06:43.895363 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:43.417276 20590 consensus_meta.cc:287] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.445s	user 0.017s	sys 0.000s
W20260709 13:06:43.516687 20676 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
W20260709 13:06:44.035079 15512 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.005s	sys 0.011s
I20260709 13:06:43.907837 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:43.781560 20587 consensus_meta.cc:287] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.001s
W20260709 13:06:44.046492 15482 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.006s	sys 0.022s
W20260709 13:06:44.047006 15509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.033s	sys 0.052s
W20260709 13:06:44.050864 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.909377 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:43.891825 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:44.045007 20013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.016s	sys 0.015s
I20260709 13:06:44.058889 20432 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.570111 20664 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.495402 20622 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:43.392781 20569 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.432235 20575 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:44.054618 15512 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.005s	sys 0.012s
I20260709 13:06:43.517822 20578 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.518743 20601 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:43.516809 20680 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:43.514500 20452 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:44.074529 20648 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.074656 20680 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.054575 15435 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:43.399662 20357 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:44.080803 20578 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.081995 20578 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.082269 20569 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.402752 20668 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:43.451073 20572 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.048782 20478 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:44.078797 20587 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:43.973507 20522 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.106999 20664 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.108044 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2176) took 1589 ms. Trace:
I20260709 13:06:44.108631 15592 rpcz_store.cc:276] 0709 13:06:42.518543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.518680 (+   137us) service_pool.cc:224] Handling call
0709 13:06:44.107394 (+1588714us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54001de2d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:44.107722 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62611328}
I20260709 13:06:44.109683 20404 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.110704 20664 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:44.106330 15514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.018s	sys 0.031s
I20260709 13:06:44.113586 20622 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.123451 20546 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:44.124665 20569 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.124930 20622 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:44.134548 20466 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.132368 15514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.019s	sys 0.032s
I20260709 13:06:44.144014 20695 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:44.145346 20695 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.144023 16182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 751) took 1231 ms. Trace:
I20260709 13:06:44.148267 16182 rpcz_store.cc:276] 0709 13:06:42.910606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.910791 (+   185us) service_pool.cc:224] Handling call
0709 13:06:42.911293 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.911651 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.911691 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.925222 (+ 13531us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.099050 (+173828us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:43.099091 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.099179 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.140402 (+1041223us) raft_consensus.cc:1685] finished
0709 13:06:44.140469 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.142261 (+  1792us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":106143,"threads_started":1,"wal-append.queue_time_us":293546}
I20260709 13:06:44.150645 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:44.135612 20466 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.151669 20176 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:44.152204 20176 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:44.153609 20587 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:44.153807 20176 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.154870 20466 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:44.155158 20575 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.157557 20578 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.158936 20575 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.162860 20633 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.164813 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 2179) took 1626 ms. Trace:
I20260709 13:06:44.161978 20606 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.167112 20625 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.155311 20176 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:44.112329 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 1.14314e+06us
I20260709 13:06:44.169250 15590 rpcz_store.cc:276] 0709 13:06:42.537802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.202182 (+664380us) service_pool.cc:224] Handling call
0709 13:06:43.202684 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.233131 (+ 30447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.233161 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.244443 (+ 11282us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.338992 (+ 94549us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:43.339058 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.339184 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.164124 (+824940us) raft_consensus.cc:1685] finished
0709 13:06:44.164172 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.164491 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30535,"raft.queue_time_us":45272,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":13277,"thread_start_us":53213,"threads_started":1,"wal-append.queue_time_us":895056}
I20260709 13:06:44.198191 20695 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.198948 20633 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:44.203208 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.206394 20680 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.208884 20522 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.218326 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3223) took 1053 ms. Trace:
I20260709 13:06:44.219098 15518 rpcz_store.cc:276] 0709 13:06:43.165325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.167001 (+  1676us) service_pool.cc:224] Handling call
0709 13:06:43.220875 (+ 53874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.221210 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:44.072384 (+851174us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.217452 (+145068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.217585 (+   133us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:44.217749 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.217905 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.218209 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33102,"prepare.queue_time_us":48215,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":23864,"thread_start_us":895567,"threads_started":2,"wal-append.queue_time_us":113114}
I20260709 13:06:44.223206 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:44.223778 15509 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:44.224143 15518 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.233982 20606 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.235203 20606 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.234670 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:44.250944 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2182) took 1081 ms. Trace:
I20260709 13:06:44.251461 15437 rpcz_store.cc:276] 0709 13:06:43.168881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.200303 (+ 31422us) service_pool.cc:224] Handling call
0709 13:06:43.200715 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.230724 (+ 30009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.250276 (+1019552us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b540026be54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:44.250671 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34830080}
I20260709 13:06:44.253528 20606 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.254940 20620 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.256687 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3211) took 3040 ms. Trace:
I20260709 13:06:44.257213 15516 rpcz_store.cc:276] 0709 13:06:41.216410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.839100 (+622690us) service_pool.cc:224] Handling call
0709 13:06:41.839607 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.850080 (+ 10473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.850130 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.850189 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:41.850236 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.256037 (+2405801us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400211e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:44.256156 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.256429 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23495552}
I20260709 13:06:44.265321 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:44.266912 15515 raft_consensus.cc:2410] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:06:44.267704 15515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2329) took 1666 ms (client timeout 2062 ms). Trace:
W20260709 13:06:44.267937 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.268169 15515 rpcz_store.cc:269] 0709 13:06:42.600924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.601080 (+   156us) service_pool.cc:224] Handling call
0709 13:06:44.264793 (+1663713us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:06:44.267595 (+  2802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9854720}
I20260709 13:06:44.270720 15515 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:44.242596 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 286823us
I20260709 13:06:44.276461 20471 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:44.279307 20522 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:44.280637 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 830) took 2088 ms. Trace:
I20260709 13:06:44.280390 20522 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.281109 15583 rpcz_store.cc:276] 0709 13:06:42.192175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.192389 (+   214us) service_pool.cc:224] Handling call
0709 13:06:42.228448 (+ 36059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.489634 (+261186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.489665 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.489712 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:42.489752 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.279991 (+1790239us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54001f5754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:44.280085 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.280418 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600158592}
I20260709 13:06:44.283103 20522 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.277697 20471 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.286060 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.287304 15438 raft_consensus.cc:2410] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:06:44.287189 16173 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 11 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:44.266912 15509 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:44.288463 16173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 752) took 1376 ms. Trace:
I20260709 13:06:44.288923 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.288892 16173 rpcz_store.cc:276] 0709 13:06:42.912521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.912844 (+   323us) service_pool.cc:224] Handling call
0709 13:06:42.917338 (+  4494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.286767 (+1369429us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5400122620. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd591c0 00007fcf7bd5a231 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c
0709 13:06:44.288099 (+  1332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.288402 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47516928}
I20260709 13:06:44.267971 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 2167) took 3090 ms. Trace:
I20260709 13:06:44.292855 15587 rpcz_store.cc:276] 0709 13:06:41.177299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.238070 (+ 60771us) service_pool.cc:224] Handling call
0709 13:06:41.238567 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.832519 (+593952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.267275 (+2434756us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400114754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:44.267750 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253921664}
I20260709 13:06:44.287329 20471 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.296380 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.299158 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.301223 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.310957 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.265368 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:44.315235 15438 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:44.312079 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.314244 20606 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:44.317147 20606 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.314364 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.320549 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.323176 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.324359 15435 raft_consensus.cc:2393] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:44.324648 20606 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.328959 20606 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.329383 15515 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:44.329840 20606 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.330752 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:44.334167 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.335512 20646 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:44.336545 20646 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:44.337026 20646 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:44.338469 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.331941 15437 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:44.339726 15441 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:44.340945 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:44.341439 20280 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:44.342202 20280 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.342885 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.342478 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:44.344103 15434 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:44.327919 15440 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:44.341478 20393 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:44.340898 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.345399 20393 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.346302 20591 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.347080 20591 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.349339 20280 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.349538 20591 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.335582 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:44.333730 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.344470 15515 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:44.344404 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.354862 19961 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.357929 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.359376 20393 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.360219 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3226) took 1193 ms. Trace:
I20260709 13:06:44.364425 15443 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:44.370846 15518 raft_consensus.cc:2468] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:06:44.374409 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.375310 15442 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:44.375592 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.375849 20586 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:44.376327 15443 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:44.376861 20586 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.377671 20703 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:44.378095 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.379084 20703 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:44.379317 15443 raft_consensus.cc:2410] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:06:44.379501 20703 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:44.387617 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:44.388505 15443 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:44.390049 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.390628 15583 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:44.368069 15514 rpcz_store.cc:276] 0709 13:06:43.166282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.170206 (+  3924us) service_pool.cc:224] Handling call
0709 13:06:43.203274 (+ 33068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.228562 (+ 25288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.228611 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.249033 (+ 20422us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.359280 (+1110247us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b54000d9920. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bcce6b8 00007fcf7bd5792b 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c
0709 13:06:44.359402 (+   122us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:44.359507 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.359711 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.359805 (+    94us) raft_consensus.cc:1685] finished
0709 13:06:44.359822 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.360126 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24473,"raft.queue_time_us":24764,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":12371,"spinlock_wait_cycles":45420800,"thread_start_us":878748,"threads_started":1,"wal-append.queue_time_us":839090}
I20260709 13:06:44.400215 16145 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:44.391446 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.402225 15443 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:44.402817 15514 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:06:44.403242 15514 pending_rounds.cc:85] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 7
I20260709 13:06:44.412537 20606 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:44.405555 15589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2182) took 1860 ms (client timeout 2178 ms). Trace:
W20260709 13:06:44.413404 15589 rpcz_store.cc:269] 0709 13:06:42.544717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.729952 (+185235us) service_pool.cc:224] Handling call
0709 13:06:44.405079 (+1675127us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b54001decd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:44.405348 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7156096}
I20260709 13:06:44.413895 16181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 537) took 2226 ms. Trace:
I20260709 13:06:44.381321 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:44.415282 15438 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:44.415817 15556 connection.cc:256] RPC call timeout handler was delayed by -1.0183849300000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:06:44.416357 15556 connection.cc:256] RPC call timeout handler was delayed by -1.0183849300000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 13:06:44.418025 20661 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:44.418920 20661 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.417029 15518 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:44.420765 15509 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:44.422168 20522 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:44.414417 16181 rpcz_store.cc:276] 0709 13:06:42.187818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.187998 (+   180us) service_pool.cc:224] Handling call
0709 13:06:42.221345 (+ 33347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.046442 (+825097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.413307 (+1366865us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540060d954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:44.413628 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864036096}
I20260709 13:06:44.392205 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.404842 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.409803 16178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52910 (request call id 512) took 1580 ms. Trace:
I20260709 13:06:44.425629 15586 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:06:44.425171 16178 rpcz_store.cc:276] 0709 13:06:42.829543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.829674 (+   131us) service_pool.cc:224] Handling call
0709 13:06:44.409235 (+1579561us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54005c3fd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:44.409509 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000988928}
I20260709 13:06:44.407862 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:44.412235 16177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52910 (request call id 511) took 2154 ms (client timeout 1785 ms). Trace:
I20260709 13:06:44.409287 20704 raft_consensus.cc:2804] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:44.422518 20661 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:44.398277 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.403298 20696 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.320s	user 0.004s	sys 0.000s
I20260709 13:06:44.413034 15514 pending_rounds.cc:107] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:06:44.431321 15514 raft_consensus.cc:2889] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:44.432186 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.436618 20704 raft_consensus.cc:697] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:06:44.427341 16177 rpcz_store.cc:269] 0709 13:06:42.257734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.257900 (+   166us) service_pool.cc:224] Handling call
0709 13:06:44.411456 (+2153556us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54005f0354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:44.411871 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785559424}
I20260709 13:06:44.418042 20561 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:44.442003 20484 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:44.438097 20704 consensus_queue.cc:237] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.447038 20579 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.447938 20577 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:44.450079 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 44117.8us
I20260709 13:06:44.433529 20586 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.452147 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3227) took 1285 ms. Trace:
I20260709 13:06:44.452672 15512 rpcz_store.cc:276] 0709 13:06:43.166519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.248221 (+ 81702us) service_pool.cc:224] Handling call
0709 13:06:43.271489 (+ 23268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.271888 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.271936 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.272655 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.114146 (+841491us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:44.119132 (+  4986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.133907 (+ 14775us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.402401 (+268494us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:44.448806 (+ 46405us) raft_consensus.cc:1685] finished
0709 13:06:44.448837 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.452041 (+  3204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15123712,"thread_start_us":811294,"threads_started":1,"wal-append.queue_time_us":809753}
I20260709 13:06:44.454967 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:44.458636 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.458989 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:44.455680 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.426957 20703 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.462433 15435 raft_consensus.cc:2368] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for earlier term 14. Current term is 15.
I20260709 13:06:44.463450 15584 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:44.464181 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:44.465162 20579 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:44.468604 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:44.469126 20579 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.470207 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:44.471863 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.474116 20637 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.993s	user 0.002s	sys 0.003s
I20260709 13:06:44.476225 20661 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:44.477198 20661 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.479224 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3202) took 3320 ms. Trace:
I20260709 13:06:44.480096 20661 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:44.479758 15510 rpcz_store.cc:276] 0709 13:06:41.158292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.158432 (+   140us) service_pool.cc:224] Handling call
0709 13:06:41.158750 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.171870 (+1013120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.478566 (+2306696us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54001e46d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:44.478985 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070786944}
I20260709 13:06:44.481984 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:44.482707 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2309) took 2954 ms. Trace:
I20260709 13:06:44.483139 15511 rpcz_store.cc:276] 0709 13:06:41.528671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.910019 (+381348us) service_pool.cc:224] Handling call
0709 13:06:41.910402 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.910855 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.910900 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.946017 (+ 35117us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.232500 (+286483us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:42.277138 (+ 44638us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.287916 (+ 10778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.289442 (+  1526us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.473416 (+2183974us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b24002912d8. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78af09c4 00007fcf78aeeacb 00007fcf78ca9dc9 00007fcf78ca9a55 00007fcf78ca909d 00007fcf7b8db10e 00007fcf7b8f288c 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221
0709 13:06:44.482071 (+  8655us) raft_consensus.cc:1685] finished
0709 13:06:44.482208 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.482455 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14934,"prepare.queue_time_us":34424,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":18079,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":35417,"spinlock_wait_cycles":3171712,"thread_start_us":238072,"threads_started":1,"wal-append.queue_time_us":459029}
W20260709 13:06:44.488395 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 54146.6us
I20260709 13:06:44.489914 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:44.491855 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.479080 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:44.467653 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:44.486918 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 1.60726e+06us
I20260709 13:06:44.488777 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:44.488495 20703 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:44.490649 15556 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:44.439060 20646 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.496742 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:44.502373 15584 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:06:44.503835 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.507679 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.509570 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.512393 15515 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:44.514262 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.515759 15440 raft_consensus.cc:2410] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:06:44.519212 20618 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:44.519884 20618 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.520294 20618 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:44.520756 20574 raft_consensus.cc:3055] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:44.521234 20574 raft_consensus.cc:740] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:44.522428 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:44.572165 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.522670 20574 consensus_queue.cc:260] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.592089 15443 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:44.513541 15512 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:44.599530 15438 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:44.604738 15435 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:44.599152 20574 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:44.614392 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:44.615566 20605 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.616454 19961 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:44.616514 20605 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.618675 15512 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:06:44.619115 15512 pending_rounds.cc:85] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 7
I20260709 13:06:44.620445 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:44.615461 20680 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:44.619395 15512 pending_rounds.cc:107] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:44.599503 15511 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
W20260709 13:06:44.641045 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.647992 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.658316 15591 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:44.654125 15439 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:06:44.664209 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 185317us
I20260709 13:06:44.597980 20579 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:44.621085 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 130583us
I20260709 13:06:44.656352 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.656934 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.683795 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.731037 15512 raft_consensus.cc:2889] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:44.731954 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.732667 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.734305 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.728331 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:44.728731 20484 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 13:06:44.741477 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 83044.2us
I20260709 13:06:44.656643 20663 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:44.760628 20568 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:44.604506 20606 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.622207 20605 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.702313 20575 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.764511 20663 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:44.771817 20663 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.772378 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.772858 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:44.773244 20663 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:44.656874 20280 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:06:44.646176 20661 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:44.754678 19961 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.777515 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:44.804104 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:44.805584 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:44.810678 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.784210 20546 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:06:44.823925 20561 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:44.824841 20546 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:44.825410 20546 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:44.825906 20694 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.744s	user 0.002s	sys 0.002s
I20260709 13:06:44.826325 16174 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:44.827615 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.828398 15588 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
W20260709 13:06:44.829291 16174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52910 (request call id 510) took 2581 ms (client timeout 1623 ms). Trace:
I20260709 13:06:44.812493 20591 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:44.830999 20452 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:44.831555 20402 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:44.762107 20579 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:44.825871 20546 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.832641 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:44.832995 16174 rpcz_store.cc:269] 0709 13:06:42.248226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.249636 (+  1410us) service_pool.cc:224] Handling call
0709 13:06:44.829057 (+2579421us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54007201d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:44.829218 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5505259392}
I20260709 13:06:44.810779 20078 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.845142 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 101497us
I20260709 13:06:44.809203 20661 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:44.674355 20625 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:06:44.651485 20705 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 13:06:44.821024 20280 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:44.795761 20680 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.804884 19961 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.808267 20606 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.844436 20452 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:44.844646 20646 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:44.862069 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.849677 20591 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:44.870087 15591 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:06:44.813643 20605 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:06:44.838202 20575 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.884544 15589 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:44.891034 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.871281 20078 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.897718 20606 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.899209 20618 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.902091 20618 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.903054 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:44.903726 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.904040 15587 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:44.904578 20722 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.905341 15513 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:06:44.881951 20452 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:44.882284 20561 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.912730 15516 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:44.912915 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:44.915679 16146 connection.cc:256] RPC call timeout handler was delayed by -1.1797833110000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 13:06:44.884133 20280 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:44.879168 20574 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:44.923920 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 326327us
I20260709 13:06:44.931627 20396 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.931885 20574 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.934634 20574 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.937680 15586 raft_consensus.cc:1275] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:44.937955 20631 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.938519 20631 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.941365 20631 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:44.944000 20618 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.944890 20618 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.946758 20683 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:44.947507 20683 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:44.948987 20683 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.952474 20661 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.954030 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:44.965095 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.966406 15583 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:44.969655 20546 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.971506 20575 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.972419 20546 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.973867 20680 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.974016 20078 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:44.975365 20280 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:44.976083 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:44.978560 15556 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:44.979781 20586 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:44.980314 20586 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:44.980513 20727 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:44.980773 20586 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:44.893523 20591 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:44.983924 15587 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:44.984472 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:44.985054 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 60449.4us
I20260709 13:06:44.987224 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:44.988147 20524 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:44.989230 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.955302 15585 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:44.946825 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:44.951162 20683 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:44.994139 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:44.947427 20618 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:45.023288 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.024505 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:44.905346 20722 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.050999 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:45.059945 20457 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:45.061235 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 73764.7us
I20260709 13:06:45.062682 15591 raft_consensus.cc:2393] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:45.073000 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.073700 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:45.074103 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2481) took 2889 ms. Trace:
W20260709 13:06:45.084532 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.096982 20461 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.074735 15439 rpcz_store.cc:276] 0709 13:06:42.184315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.186783 (+  2468us) service_pool.cc:224] Handling call
0709 13:06:42.187175 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.739729 (+2552554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.073713 (+333984us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b54002b1954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:45.074000 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5671615488}
I20260709 13:06:45.111785 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:44.997779 20561 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:45.115999 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.046558 20078 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:06:45.067339 20680 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:06:45.112008 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47895.3us
I20260709 13:06:45.120401 15590 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 6.
I20260709 13:06:45.137651 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.139252 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.140301 15511 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:45.140215 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:45.141776 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 340800us
W20260709 13:06:45.143500 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.112751 20692 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.148214 15589 raft_consensus.cc:2393] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:45.118826 20568 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.118898 20680 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:45.159227 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2328) took 2507 ms. Trace:
I20260709 13:06:45.159794 15517 rpcz_store.cc:276] 0709 13:06:42.599989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.600157 (+   168us) service_pool.cc:224] Handling call
0709 13:06:44.394063 (+1793906us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:06:44.394459 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.394970 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.395002 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.443903 (+ 48901us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.497299 (+ 53396us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.516552 (+ 19253us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.595758 (+ 79206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.595880 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.078221 (+482341us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b180004d7a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:45.100430 (+ 22209us) raft_consensus.cc:1685] finished
0709 13:06:45.100475 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.106921 (+  6446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78806,"prepare.queue_time_us":18969,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":9646,"raft.queue_time_us":91063,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":3031,"spinlock_wait_cycles":60812544,"thread_start_us":52879,"threads_started":1,"wal-append.queue_time_us":179563}
I20260709 13:06:45.162354 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.163180 15517 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:06:45.156884 20394 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.164291 20394 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:45.168210 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 181087us
I20260709 13:06:45.157644 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.171522 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:45.172544 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 403405us
W20260709 13:06:45.174903 15513 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2325) took 2621 ms (client timeout 2632 ms). Trace:
W20260709 13:06:45.175462 15513 rpcz_store.cc:269] 0709 13:06:42.553569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.555166 (+  1597us) service_pool.cc:224] Handling call
0709 13:06:45.174598 (+2619432us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54002e2a54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:45.174782 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5286853888}
I20260709 13:06:45.180563 20679 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.182529 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.150738 20568 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:45.183312 15511 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:45.181233 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.155534 20680 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.193629 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:45.196597 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1915fdd81d344a749443e48f07a1fef8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:45.176857 20394 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:45.156894 20616 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:45.198774 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:45.206722 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.210232 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:45.214413 20722 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:45.218008 20738 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:45.221320 20561 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:45.222338 15514 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:45.222678 15443 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:45.224615 20457 consensus_queue.cc:1059] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:45.225736 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.226269 20620 raft_consensus.cc:3055] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:45.226703 20620 raft_consensus.cc:740] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:45.227377 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.227802 20620 consensus_queue.cc:260] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.229245 15438 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:45.229409 20620 raft_consensus.cc:3060] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.230928 15440 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:45.184158 20692 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.233435 20692 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:45.192484 20568 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:45.236168 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.236743 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.236193 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.238157 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.238648 15439 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:06:45.238971 16177 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:45.239794 20524 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:45.238150 20471 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:06:45.241824 20471 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:45.242233 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.242238 20457 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:45.243188 20471 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:45.189033 19961 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:45.202737 20703 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.695s	user 0.015s	sys 0.009s
I20260709 13:06:45.254545 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:45.255434 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54640.8us
I20260709 13:06:45.256876 20471 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.257599 15437 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:45.260167 20616 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.275226 15585 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:45.279970 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:45.277495 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.256155 20394 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:45.287509 20394 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:45.288051 20394 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.288398 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.289625 20471 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.290087 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.290849 15438 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:45.247973 20586 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.292145 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.292413 15439 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:06:45.181289 20679 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.294313 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.297277 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.298904 20658 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.299569 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.299674 20658 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.291273 15513 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:06:45.300220 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.295195 20679 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:45.301020 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.305887 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.308691 16174 raft_consensus.cc:2410] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:06:45.308440 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.313230 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.314245 16173 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:45.300963 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:45.316625 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.319072 16175 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:45.322002 16175 raft_consensus.cc:2410] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:45.323750 15511 raft_consensus.cc:2410] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:06:45.329708 16182 raft_consensus.cc:1240] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:45.338702 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.340075 15517 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:06:45.340636 15517 pending_rounds.cc:85] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 6
I20260709 13:06:45.340969 15517 pending_rounds.cc:107] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:06:45.341243 15517 raft_consensus.cc:2889] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.353209 16180 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:45.356070 20737 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:45.356925 20737 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:45.361404 20605 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:45.362046 20605 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:45.362185 20679 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:45.363241 20679 consensus_queue.cc:1243] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 6ff41728dec842afad5b53c20446a5a0 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:45.365254 20616 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:45.365933 15591 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:45.340085 15511 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:45.358363 20737 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.376225 20658 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:45.376922 20737 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.376991 20658 consensus_queue.cc:1059] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:45.378963 20461 raft_consensus.cc:3055] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:45.379370 20461 raft_consensus.cc:740] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:45.380671 20461 consensus_queue.cc:260] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.382032 20461 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.396284 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:45.397409 16176 raft_consensus.cc:2376] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14. Re-sending same reply.
I20260709 13:06:45.398551 20586 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:45.406409 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.412654 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.416164 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.418108 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.419004 15516 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:45.420123 15515 raft_consensus.cc:2410] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:06:45.422492 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.423725 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.427444 20577 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:45.428040 20577 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:45.429382 20577 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:45.449210 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.449959 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.434233 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.438953 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:45.452768 15512 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.441210 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:45.406603 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:45.463193 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 225495us
I20260709 13:06:45.466337 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.467808 15588 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:06:45.468369 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.430810 20568 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.471930 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.481086 15510 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:45.447773 20706 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:45.481344 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.484999 15588 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:45.485682 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:45.486447 15439 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.481694 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.431308 20577 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:45.488412 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.443400 20544 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.473251 20704 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:06:45.500970 20394 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.500664 20605 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.502866 20605 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.503806 15441 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:45.507834 20586 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:45.508598 20176 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:45.509109 20176 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:45.509287 20568 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:45.510277 20176 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.512224 20680 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.516836 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.518606 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.503347 20394 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:45.515276 20680 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:45.508643 20586 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:45.490044 16182 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:45.534829 15587 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:45.533407 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:45.519340 15517 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:45.536993 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.539680 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.543668 15439 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:45.539722 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:45.545200 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.545256 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.545871 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:45.546113 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.546509 16182 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.547190 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.547637 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.484557 20706 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:45.552423 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.551837 15583 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:45.551719 15592 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 15: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:45.553190 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.546901 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:45.549252 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:45.557332 15591 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:45.553193 15517 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:45.554919 15511 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:06:45.561376 15587 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:45.560429 15513 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:45.563118 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.564584 16176 raft_consensus.cc:2410] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:06:45.567808 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:45.568579 15587 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.568660 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:45.567802 15589 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.570025 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.563030 15516 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:45.574908 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.551728 20471 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.590844 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:45.590917 16180 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
W20260709 13:06:45.592674 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.591766 20402 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.596614 20402 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.597090 20402 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.597491 20402 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.597904 15584 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:45.599129 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.599856 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.600239 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:45.600703 15516 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:45.590917 20618 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:45.601734 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.601867 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:45.603189 15516 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:45.603736 20524 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.603817 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.605654 15517 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:45.606129 15515 raft_consensus.cc:1240] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:45.580071 15509 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:06:45.611763 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.612176 20586 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:45.612973 15513 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:06:45.613417 15513 pending_rounds.cc:85] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 10
I20260709 13:06:45.613683 15513 pending_rounds.cc:107] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:06:45.613945 15513 raft_consensus.cc:2889] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.614491 15586 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:06:45.618408 20746 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:45.620256 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:45.571483 20176 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.601495 20618 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.615412 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.599910 15590 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:45.630604 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:45.631996 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.633925 20737 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:45.634143 20393 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.634183 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.635028 20393 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.637323 20393 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:45.637936 20524 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.637954 16176 raft_consensus.cc:2410] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:45.646834 15515 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:45.632921 15513 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:45.627725 20586 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:45.648387 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.643663 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:45.649912 15589 raft_consensus.cc:2410] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:45.648725 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:45.658783 15512 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:45.659477 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:45.663033 15512 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:45.662788 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:45.645699 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:45.645694 20452 consensus_meta.cc:287] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.005s
I20260709 13:06:45.647775 20705 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:45.649349 20393 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.664440 15510 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:45.665587 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:45.666193 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.675750 16145 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:45.650030 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:45.615414 20471 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.707010 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:45.655099 20586 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:45.714143 16182 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
W20260709 13:06:45.712929 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 216657us
I20260709 13:06:45.724443 15511 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:45.652030 20524 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:06:45.745249 15515 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:45.732273 15439 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:06:45.746222 15439 pending_rounds.cc:85] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 7
I20260709 13:06:45.746711 15439 pending_rounds.cc:107] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:06:45.747145 15439 raft_consensus.cc:2889] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:45.741468 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.719316 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:45.743073 15482 connection.cc:256] RPC call timeout handler was delayed by -1.3112769520000711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 13:06:45.752076 20524 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:45.704469 20399 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:06:45.755752 20538 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.706974 20591 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:45.756412 15509 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:45.757133 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.681440 20705 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:45.770298 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.709934 20737 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:45.713577 20616 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:45.775415 15587 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
W20260709 13:06:45.810190 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 90971.8us
W20260709 13:06:45.776577 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 58935.1us
W20260709 13:06:45.776655 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 114228us
W20260709 13:06:45.778728 15482 connection.cc:256] RPC call timeout handler was delayed by -1.2986769520000507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 13:06:45.813434 15482 connection.cc:256] RPC call timeout handler was delayed by -1.2986769520000507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 13:06:45.780115 15512 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:45.814581 15441 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:45.727605 20683 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.723140 20586 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:45.794813 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.799438 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.800693 15590 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:45.746022 20704 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:45.832922 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.839711 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.820618 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.652395 20706 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.704530 20452 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.782867 20524 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:45.850286 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.850626 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.854386 15512 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:45.798017 20538 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.806000 20591 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.858649 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.804145 20620 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.845960 16178 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:45.862437 15592 raft_consensus.cc:2410] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:45.811611 20744 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:45.868053 15510 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:45.809523 20616 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.809497 20605 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.867151 15512 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:45.845656 20741 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:06:45.776106 20393 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:45.863785 20538 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.876322 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.798750 20546 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:06:45.839147 20704 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:45.794747 16146 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.537s (SENT) [suppressed 15 similar messages]
I20260709 13:06:45.869531 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.839035 20737 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:45.796511 15340 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 10 to 13, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 13 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.882625 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.871057 15513 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:45.775276 20432 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:06:45.866891 20646 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.907058 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.878167 20706 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:45.864012 20591 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:45.910316 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 120968us
I20260709 13:06:45.889581 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:45.832309 20738 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:06:45.838568 20683 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:45.900528 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.901124 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.904175 20355 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:06:45.898900 15584 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:06:45.879351 20616 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:45.916322 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.918529 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.926453 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.932039 15436 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:45.906595 20704 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:45.888861 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:45.943265 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.943449 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.938891 15340 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:45.921190 20546 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:06:45.949131 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.949581 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:45.929463 20748 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
I20260709 13:06:45.952081 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.883026 20605 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:45.960516 16146 leader_election.cc:336] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.634s (SENT)
I20260709 13:06:45.963929 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.971609 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.973111 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:45.974043 20605 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:45.974123 15434 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:06:45.975569 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:45.980379 20737 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:45.975703 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:45.989084 15585 raft_consensus.cc:2410] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:06:45.961297 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:45.990605 20658 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:45.991146 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 51094.3us
I20260709 13:06:45.917407 20646 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:45.992210 16146 leader_election.cc:336] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.659s (SENT)
I20260709 13:06:45.992667 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:45.993959 15586 raft_consensus.cc:2393] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:45.994192 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:45.982510 15340 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:45.995621 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:45.996507 15438 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:45.997869 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 52878us
I20260709 13:06:45.913791 20620 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:46.004817 20658 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:46.005111 15340 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 10, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:46.012758 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:45.950611 20618 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:46.015406 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.909840 20402 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.022341 20394 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:46.022737 20484 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:46.019603 20749 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:06:46.023682 20704 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:46.030539 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 78184.6us
W20260709 13:06:46.031715 15339 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 205) took 32378 ms (client timeout 15000 ms). Trace:
I20260709 13:06:46.040611 20661 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.047214 20393 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:45.949020 20705 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.050560 20705 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:46.071076 15591 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
W20260709 13:06:46.068320 15588 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.001s
I20260709 13:06:46.072470 15588 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:46.003101 20471 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:46.032218 15339 rpcz_store.cc:269] 0709 13:06:13.570529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.570786 (+   257us) service_pool.cc:224] Handling call
0709 13:06:14.365762 (+794976us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:45.941611 (+31575849us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:37.875268 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:37.895312 (+ 20044us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:37.895358 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:06:37.895386 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:37.896379 (+   993us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:37.896457 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:37.896499 (+    42us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:37.897069 (+   570us) tablet.cc:701] Row locks acquired
0709 13:06:37.897103 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:06:37.897284 (+   181us) write_op.cc:270] Start()
0709 13:06:37.897429 (+   145us) write_op.cc:276] Timestamp: P: 1783602397897226 usec, L: 0
0709 13:06:37.897452 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:37.997316 (+ 99864us) log.cc:844] Serialized 2482 byte log entry
0709 13:06:38.401590 (+404274us) op_driver.cc:464] REPLICATION: finished
0709 13:06:38.666439 (+264849us) write_op.cc:301] APPLY: starting
0709 13:06:38.667745 (+  1306us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:38.675323 (+  7578us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:38.675487 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:38.727418 (+ 51931us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:38.727706 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:06:38.727755 (+    49us) write_op.cc:312] APPLY: finished
0709 13:06:38.728079 (+   324us) log.cc:844] Serialized 65 byte log entry
0709 13:06:38.728295 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.728428 (+   133us) write_op.cc:454] Released schema lock
0709 13:06:38.728485 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:38.729013 (+   528us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.729044 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16064,"reported_tablets":49,"spinlock_wait_cycles":235061632,"child_traces":[["op",{"apply.queue_time_us":241511,"apply.run_cpu_time_us":12148,"apply.run_wall_time_us":74529,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29207,"num_ops":6,"prepare.queue_time_us":347645,"prepare.run_cpu_time_us":16364,"prepare.run_wall_time_us":315893,"raft.queue_time_us":103343,"raft.run_cpu_time_us":19276,"raft.run_wall_time_us":164785,"replication_time_us":503933,"thread_start_us":396249,"threads_started":4,"wal-append.queue_time_us":224368,"wal-append.run_cpu_time_us":11403,"wal-append.run_wall_time_us":1502596}]]}
I20260709 13:06:46.075523 15590 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
W20260709 13:06:46.100168 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 68586.9us
I20260709 13:06:46.106331 15407 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.112583 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:46.124794 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 291577us
W20260709 13:06:46.126411 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 134232us
W20260709 13:06:46.142086 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.143000 15340 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:46.002813 20524 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:46.149166 15482 connection.cc:256] RPC call timeout handler was delayed by -1.2050769520000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:06:46.149940 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1609769520000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 13:06:46.150789 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1609769520000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 13:06:46.151171 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1411769520000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 13:06:46.151794 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1411769520000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 13:06:46.152470 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1366769520000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:06:46.152882 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 140275us
W20260709 13:06:46.152902 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1366769520000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:06:46.154403 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1096769520000862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
W20260709 13:06:46.153803 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 155213us
I20260709 13:06:46.140209 20546 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:46.162369 16146 leader_election.cc:336] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.847s (SENT)
I20260709 13:06:46.162425 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:46.160914 15340 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 14 to 15, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:46.172271 15340 catalog_manager.cc:5697] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:46.176005 15340 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:46.180415 15340 catalog_manager.cc:5697] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 8 to 10, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 10 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:06:46.182219 16146 leader_election.cc:336] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 1.895s (SENT)
I20260709 13:06:46.182770 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:46.183720 20561 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:46.185621 16146 leader_election.cc:336] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 2.035s (SENT)
I20260709 13:06:46.184492 15340 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 8 to 9, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 9 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:46.198766 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.207995 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.213725 20402 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:46.213661 20762 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:46.217993 20393 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:46.221637 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:46.222555 20546 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:46.222970 20741 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:46.213310 15340 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 7 to 8, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 8 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:46.227588 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:46.234110 20741 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:46.228294 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:46.235365 20741 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:46.236296 15517 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:46.236311 20756 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:46.240707 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:46.188499 20471 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:06:46.252400 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.261085 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 50461.6us
W20260709 13:06:46.264954 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.264966 20402 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:46.277925 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 92452.9us
W20260709 13:06:46.280146 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 72257.8us
I20260709 13:06:46.267995 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:46.283627 20616 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.286213 20616 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:46.265213 20605 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:46.287739 20757 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:06:46.287896 20605 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.288501 20605 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.257808 20733 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:46.300544 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.257930 20471 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:46.305544 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.308320 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:46.268739 20683 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:46.258922 20546 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:06:46.292999 20399 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:46.318178 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62030.8us
I20260709 13:06:46.319032 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:46.328971 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.303189 20646 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:46.309902 20471 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:46.338759 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:46.313871 20176 consensus_meta.cc:287] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.685s	user 0.016s	sys 0.000s
W20260709 13:06:46.338646 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.267776 20591 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.336367 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:46.314960 20658 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:46.312497 20706 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:46.334276 20577 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:46.401185 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.339411 20680 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:46.387991 20616 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.404795 20591 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:46.406082 15437 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:06:46.335182 20683 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:46.408295 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:46.411435 15515 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:46.410465 15441 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
W20260709 13:06:46.415714 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 79113.7us
I20260709 13:06:46.416854 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:46.418939 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80289.4us
I20260709 13:06:46.423399 15515 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 17.
W20260709 13:06:46.424443 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 116252us
I20260709 13:06:46.425312 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:46.427384 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 91586.8us
I20260709 13:06:46.315439 20703 consensus_queue.cc:1048] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 13:06:46.463487 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 148706us
I20260709 13:06:46.417204 20738 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:46.469810 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 53052.5us
I20260709 13:06:46.463850 20706 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:46.474421 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 54706.9us
I20260709 13:06:46.478955 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.473619 15407 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.484221 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:46.481849 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 143905us
I20260709 13:06:46.474500 20546 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.489849 20772 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:06:46.490455 16145 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:46.505790 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:46.509713 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.517403 20772 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:46.518023 20772 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:46.520987 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:46.491075 20706 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:46.522954 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:46.511408 20461 raft_consensus.cc:2804] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:46.524034 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:46.513128 20683 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:46.528164 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:46.524127 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:46.527344 16182 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:46.533330 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.486197 20680 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.535362 15438 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:06:46.535944 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:46.528147 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:46.543442 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:46.545097 15589 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:46.546597 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:46.547628 15583 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:46.522622 20738 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.544248 16176 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:46.553383 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:46.554169 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.554169 15588 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
W20260709 13:06:46.536659 20538 consensus_meta.cc:287] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.005s
I20260709 13:06:46.522253 20778 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:46.537974 20683 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.577548 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:46.578591 16180 raft_consensus.cc:2393] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:46.551211 20461 raft_consensus.cc:697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:46.583489 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:46.555788 20661 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:46.590370 15585 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:46.592010 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:46.593868 16176 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:46.564615 20538 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.594763 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:46.574338 20778 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:46.578426 20683 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:46.601505 20764 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.603639 20744 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:46.606868 20767 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:06:46.608089 20771 log.cc:927] Time spent T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:06:46.608711 16179 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:46.593081 20738 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.578279 20780 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:46.614108 20705 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.008s
I20260709 13:06:46.615768 20706 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:46.597421 20765 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:06:46.616622 20402 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.617892 20704 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:46.622696 20586 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.763s	user 0.010s	sys 0.002s
W20260709 13:06:46.628193 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.610150 20461 consensus_queue.cc:237] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.678517 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:46.690076 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:46.690892 15584 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:06:46.692310 20586 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.697002 20538 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:46.698460 20772 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.678471 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:46.642838 20768 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:06:46.698539 15583 raft_consensus.cc:1275] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:46.679281 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:46.682515 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:46.711122 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.708652 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:46.718698 15585 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:46.643321 20544 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.732990 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.724812 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.723434 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.695317 20586 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:46.760118 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:46.760931 15585 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:46.772754 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 347503us
I20260709 13:06:46.774724 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:46.775583 15509 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:06:46.776894 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 222822us
I20260709 13:06:46.770535 20658 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:46.778549 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:46.781450 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:46.783911 20452 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:46.784240 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:46.788645 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:46.797523 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.759001 20399 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:46.652918 20738 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.706760 20471 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.787798 20780 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.817901 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 54659.9us
I20260709 13:06:46.819252 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:46.823376 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45163.7us
I20260709 13:06:46.824787 15585 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:46.843394 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:46.819684 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:46.816761 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:46.826247 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:46.796653 20605 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.836313 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:46.837018 20546 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.778596 20658 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.849771 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.804548 20705 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:46.746399 20544 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.848071 15583 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:46.852152 15436 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:46.812879 20394 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.849601 15509 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:46.820665 20399 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:46.820395 20393 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.868499 15443 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:46.852936 20452 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:46.868913 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:46.847970 20792 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:46.874800 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.884694 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:46.885455 16173 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.879201 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.857671 20658 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.887877 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:46.864152 20788 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.882089 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:46.865788 20772 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.874271 20775 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.864310 20680 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:46.863929 20394 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.881924 20577 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.867086 20791 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:46.931063 20791 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:46.931352 20782 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:06:46.933152 20779 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:46.934585 20801 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:46.935353 20801 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.938633 20801 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:46.932626 20791 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.920064 20402 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:46.922909 20432 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.851621 20780 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.878270 20452 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:46.888743 20792 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.871933 20393 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.965997 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:46.941021 20794 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:06:46.971949 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 152801us
W20260709 13:06:46.972177 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106818us
I20260709 13:06:46.850633 20778 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:46.942135 20432 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:46.960290 20680 raft_consensus.cc:2764] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:46.941156 20544 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:46.967779 20452 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:46.980780 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 196678us
I20260709 13:06:46.976200 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:46.983072 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:46.986493 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:46.969521 20705 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:46.989494 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:46.980669 20586 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:46.995776 20546 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:46.996403 20692 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:46.997350 20792 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:47.009541 20692 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.998445 20432 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:46.999748 20661 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:47.009975 20744 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.010551 20661 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.010793 20744 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.013144 20744 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:46.924292 20775 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.013077 20661 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:46.986730 20355 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:47.015626 20775 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:46.984476 20394 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:46.985715 20779 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:47.008826 20780 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:47.002384 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:47.005141 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:47.019973 16173 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:47.004401 15436 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:47.010004 20692 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:47.029925 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.033223 20779 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:47.036415 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:47.036787 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:47.016780 20471 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.045768 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:47.025468 20661 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.052484 20661 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.050676 20813 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:47.061626 20355 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:46.989013 20591 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:06:47.065086 20738 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.082170 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.040179 20779 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:47.104609 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.105430 15436 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:47.106446 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.047259 20810 consensus_queue.cc:1059] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:06:47.040131 20394 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:47.090004 20399 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.092525 20683 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.094240 15590 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:47.095762 15584 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:47.096932 15585 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:06:47.098848 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.100010 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:47.100837 20393 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:47.081578 20813 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.114627 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 127143us
I20260709 13:06:47.153430 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.113065 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:47.140615 15555 leader_election.cc:336] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.588s (SENT)
I20260709 13:06:47.156944 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:47.159678 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46721.8us
I20260709 13:06:47.161664 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:47.161850 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.163461 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.085769 20484 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:47.110891 20394 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.177597 15434 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:47.192642 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:47.192406 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:47.178442 15592 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:47.153367 20780 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.204310 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:47.197844 15517 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:47.198541 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.205739 15443 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
W20260709 13:06:47.206079 15441 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2211) took 1274 ms (client timeout 1653 ms). Trace:
I20260709 13:06:47.206679 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.207185 15442 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:47.171765 20741 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:47.173873 20471 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.207352 15443 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:47.212248 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.212857 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:47.213871 15434 raft_consensus.cc:3060] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:06:47.206473 15441 rpcz_store.cc:269] 0709 13:06:45.923294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.923662 (+   368us) service_pool.cc:224] Handling call
0709 13:06:47.184182 (+1260520us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400069854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:47.197177 (+ 12995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071631744}
I20260709 13:06:47.194643 20394 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.222043 20683 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.194305 20658 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.224583 16175 raft_consensus.cc:2368] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:06:47.225612 20658 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:47.226734 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:47.227451 15585 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:47.215277 20577 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.230324 20524 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:47.217607 15555 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.603s (SENT)
I20260709 13:06:47.209270 20605 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:47.235687 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 61316.4us
I20260709 13:06:47.236877 20778 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.243078 20778 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.240618 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:47.214839 20741 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:47.250492 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2521) took 1564 ms. Trace:
I20260709 13:06:47.252476 15437 rpcz_store.cc:276] 0709 13:06:45.685802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.686022 (+   220us) service_pool.cc:224] Handling call
0709 13:06:45.718937 (+ 32915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.410964 (+692027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.249960 (+838996us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54002b1454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:47.250380 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579554432}
W20260709 13:06:47.274761 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.170258 20813 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.174592 20705 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.211201 20780 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.287381 16176 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:06:47.290124 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:47.291683 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74120us
W20260709 13:06:47.293447 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 257124us
I20260709 13:06:47.296470 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:47.301021 20646 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:47.304526 20399 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:47.305476 16145 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:47.306752 20789 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:47.308386 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:47.312031 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:47.312850 15511 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:47.314940 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:47.315686 15510 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:47.328986 15513 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.330840 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:47.330991 15513 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:47.336107 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:47.337034 15513 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:47.307374 20789 raft_consensus.cc:697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:47.338999 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:47.344099 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:47.351660 15518 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:47.383127 15434 raft_consensus.cc:2468] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 17.
I20260709 13:06:47.328727 20775 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:47.391788 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:47.391105 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:47.389895 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:47.336030 20432 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.394624 15589 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 15: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:47.390370 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:47.340132 20538 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:47.400561 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 62581.6us
I20260709 13:06:47.411036 15556 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:47.335126 20706 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:06:47.395257 20775 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:47.426800 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 144017us
W20260709 13:06:47.411723 20817 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:06:47.417647 20402 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:47.410291 20577 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:47.421253 20812 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:06:47.418300 20683 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:47.412552 20452 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.420032 20586 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:47.466030 20819 log.cc:927] Time spent T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:47.466138 20586 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.467804 15588 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:47.413319 20432 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.412325 20546 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:47.471081 20432 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.447914 20789 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.450692 20394 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.452257 20692 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.444365 20577 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:47.484164 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:47.473390 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:47.438805 20775 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:47.499624 20355 raft_consensus.cc:3055] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:47.500113 20355 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:47.476948 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.501035 20355 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:47.502893 20815 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:06:47.505595 20692 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:47.505741 20355 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.446581 20780 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:47.506357 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46671.1us
I20260709 13:06:47.506810 20780 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:47.512771 15511 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
W20260709 13:06:47.476861 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50628.2us
I20260709 13:06:47.518375 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:47.520370 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
W20260709 13:06:47.479283 15555 leader_election.cc:336] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.849s (SENT)
I20260709 13:06:47.521405 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:47.523746 20764 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:47.474529 20683 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:47.524902 20544 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:47.475150 20661 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:47.526945 20544 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:47.527388 20544 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.527787 20544 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.528396 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:47.529187 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:47.485263 20546 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.531869 20546 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.532598 20778 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:47.533588 20784 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:47.534233 20546 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:47.472230 15443 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:47.490231 20577 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:47.541810 20822 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:06:47.542016 20816 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
W20260709 13:06:47.494745 20820 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
I20260709 13:06:47.441987 20471 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:47.545099 20471 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:47.545519 20471 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:47.546432 20471 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.547607 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:47.547838 20471 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:47.497779 20813 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:47.548506 15584 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:06:47.525441 20683 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.549199 20788 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.549688 20788 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.501065 20779 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.551944 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 575) took 1044 ms. Trace:
I20260709 13:06:47.552693 15442 rpcz_store.cc:276] 0709 13:06:46.508086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.509041 (+   955us) service_pool.cc:224] Handling call
0709 13:06:47.197968 (+688927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.207587 (+  9619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.551423 (+343836us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b5400069850. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:47.551848 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581544832}
I20260709 13:06:47.525204 20538 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:47.554157 20779 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:47.458575 20741 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.552019 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:47.555017 20538 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:47.554629 20788 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:47.555212 15585 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.464418 20402 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:47.568816 20402 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.572394 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:47.443275 15589 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:47.577642 15587 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:47.574271 15556 leader_election.cc:400] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:06:47.583716 15556 leader_election.cc:403] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.481578 20452 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.579876 15510 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:47.596179 15585 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
W20260709 13:06:47.611874 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.597405 15442 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:47.628219 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.628332 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:47.629334 15435 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:47.631069 15437 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:47.635800 15436 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:47.637367 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 301442us
W20260709 13:06:47.639390 15587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2214) took 1764 ms (client timeout 1739 ms). Trace:
W20260709 13:06:47.640012 15587 rpcz_store.cc:269] 0709 13:06:45.852383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.888412 (+ 36029us) service_pool.cc:224] Handling call
0709 13:06:47.616692 (+1728280us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000c1054. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:47.616800 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3742278528}
I20260709 13:06:47.640739 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:47.644802 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 70708.7us
W20260709 13:06:47.645617 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.591816 20738 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.555648 20538 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:47.659245 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:47.664642 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:47.638860 20788 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.668884 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:47.669601 20778 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:06:47.661603 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:47.657109 20561 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:47.644785 20524 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11.
I20260709 13:06:47.613804 20646 consensus_queue.cc:1048] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:47.660195 20808 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.693779 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:47.709280 15585 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:47.709535 15436 raft_consensus.cc:1275] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:47.696281 15590 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:06:47.711401 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:47.712188 16180 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:47.713852 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45090.1us
I20260709 13:06:47.714128 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:47.715059 16176 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:47.698515 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:47.686949 16146 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:47.713951 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:47.718591 15435 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:47.713640 20561 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:47.651851 20432 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:06:47.681367 20394 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:47.721895 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:47.717324 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:47.697548 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:47.727262 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65775us
I20260709 13:06:47.726485 15587 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:47.728374 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:47.714541 20813 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:47.736369 20813 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:47.736907 20813 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.741078 20561 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.731441 20524 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:47.683794 20661 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:06:47.744158 20524 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.744673 20788 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:47.744786 20524 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.745129 20788 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:47.662406 20738 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.729393 20784 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:47.719393 20706 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:47.779419 20586 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.746330 20788 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.790762 20618 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:06:47.792819 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 64526.4us
W20260709 13:06:47.800294 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 71492.5us
I20260709 13:06:47.789450 20546 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:47.746773 20764 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:47.778355 20808 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:47.775969 20784 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.779132 20706 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.814114 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:47.822422 16180 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:47.827560 15587 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:47.789304 20779 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:06:47.778337 20703 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:06:47.811497 20683 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.841809 20683 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.847898 20762 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:47.816001 20544 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.857060 20738 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.815210 20577 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:47.859300 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.859786 15509 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.862206 20586 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.863372 16178 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:47.820164 20784 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:47.814468 20808 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:47.854266 20524 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:47.830291 20706 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:47.905469 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.880239 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:47.928426 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.874337 20737 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.857111 20544 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:47.944593 20830 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:06:47.928304 20683 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.953956 20577 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:47.953756 20683 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:47.965826 20683 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:47.924955 20808 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.001585 15587 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 16: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:48.014218 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:48.014925 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:48.014382 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.016306 15437 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:48.016451 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.017421 15435 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:48.022244 15556 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.023705 20661 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:48.024308 20661 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.024773 20661 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:48.030900 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.032598 20764 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:48.033214 20764 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.033681 20764 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:47.984869 20737 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.076153 20683 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:48.103235 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.940397 20538 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:48.095062 20775 consensus_meta.cc:287] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.596s	user 0.013s	sys 0.001s
I20260709 13:06:48.108558 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:48.093039 20772 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:48.119432 20577 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:48.119761 20705 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:48.179939 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.185459 20813 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.188959 20524 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:48.189852 20538 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:48.185976 20831 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.319s	user 0.005s	sys 0.000s
I20260709 13:06:48.122893 20772 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:48.110545 20683 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.126020 20577 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:48.208827 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 247264us
I20260709 13:06:48.117507 20775 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.183725 20586 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:48.200066 20841 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.200393 20848 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:48.222991 20577 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:48.234397 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.241058 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.242357 20791 raft_consensus.cc:2764] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:06:48.248819 20813 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:48.271049 15590 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:48.236323 20586 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.233934 20841 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.280053 15512 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:06:48.282917 16148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.261255 20705 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:06:48.289480 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 84889.2us
I20260709 13:06:48.294809 20683 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.295761 20737 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.297108 20808 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.300694 20764 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.303200 20764 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.247099 20772 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.306391 20772 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:48.313340 20834 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.461s	user 0.006s	sys 0.021s
I20260709 13:06:48.304641 20808 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:48.304847 20844 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
W20260709 13:06:48.320611 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 506583us
I20260709 13:06:48.322499 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:48.319144 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3288) took 1008 ms. Trace:
I20260709 13:06:48.324697 15509 rpcz_store.cc:276] 0709 13:06:47.310500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.311657 (+  1157us) service_pool.cc:224] Handling call
0709 13:06:47.518186 (+206529us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32eee 0000000000375939 00007fcf80ca61e0 00007fcf80d6f0c4 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:06:47.518466 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.860285 (+341819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.318845 (+458560us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400212d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:48.319069 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789872000}
I20260709 13:06:48.237339 20848 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.319427 20762 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:48.320393 20810 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:48.288553 20705 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:48.317637 20706 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.337287 20841 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.326719 20432 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:48.339843 20848 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.343442 20762 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:48.361426 15443 raft_consensus.cc:2368] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17.
I20260709 13:06:48.332585 20544 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:06:48.348604 20705 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:48.347018 20810 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:48.375337 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.351912 20432 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.388417 20775 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.384249 20810 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:48.397831 20706 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:48.403298 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 162343us
I20260709 13:06:48.419968 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.384579 20661 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.384394 20784 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.483181 20393 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:48.539639 20859 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:48.540220 20859 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:48.540011 20393 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.540673 20859 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:48.478283 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.548295 15337 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 13, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 13 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.549319 20620 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.549870 20620 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.550516 15337 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.461223 20546 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:06:48.476064 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.552575 20620 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.499039 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:48.517273 20692 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:48.553846 15441 raft_consensus.cc:606] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:48.554270 20692 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.477710 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:48.556193 15435 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:48.557600 20661 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.476848 15556 leader_election.cc:400] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17.
I20260709 13:06:48.558187 15556 leader_election.cc:403] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:06:48.466132 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 143758us
W20260709 13:06:48.559010 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 82381.6us
I20260709 13:06:48.448109 20810 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.561518 15443 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:48.562579 20692 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:48.455158 20577 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.554639 15337 catalog_manager.cc:5697] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.415920 20762 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.564952 20620 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:48.565430 20577 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:48.438599 20788 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:48.467403 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.569067 15438 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:48.574281 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:48.575330 15441 raft_consensus.cc:606] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:48.575817 15441 raft_consensus.cc:614] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:48.527104 20705 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.578315 20620 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17.
I20260709 13:06:48.470445 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.477102 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:48.547662 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 128286us
I20260709 13:06:48.598117 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:48.599102 20841 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:48.552533 20772 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:48.599881 20772 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:48.600040 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:48.466432 20829 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:48.600970 20680 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:48.543046 20393 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:48.449393 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 157448us
I20260709 13:06:48.601521 20680 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:48.600905 20772 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.428870 20586 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.602960 20772 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:48.421720 20432 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:48.580467 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:48.603892 15443 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:48.546811 20784 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.606829 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:48.581470 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.608741 15438 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:48.581972 20762 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.587579 15337 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 12 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.614398 15337 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.616483 15337 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 12 to 15, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 15 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.619709 15337 catalog_manager.cc:5697] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.562609 20810 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:48.592039 20859 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.632746 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.594995 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:48.645138 15441 raft_consensus.cc:606] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:48.645699 15441 raft_consensus.cc:614] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:48.595752 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 124669us
I20260709 13:06:48.647765 20586 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.460142 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 623860us
W20260709 13:06:48.649497 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.648505 20586 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.649830 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.601977 20680 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:48.651178 20829 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:48.652240 20586 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.652467 20829 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:48.464282 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 136602us
I20260709 13:06:48.559725 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:48.652979 20546 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:48.599911 20841 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:48.653887 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 94255.9us
I20260709 13:06:48.655345 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:48.655748 20841 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:48.656225 15441 raft_consensus.cc:606] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:48.652979 20829 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.657312 20829 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:48.611774 20577 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.612756 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:48.660331 15509 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.621259 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.625010 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:48.657382 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.630909 20764 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:48.665069 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43922us
I20260709 13:06:48.669240 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.632817 15337 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.670791 20813 raft_consensus.cc:2764] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:06:48.670907 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:48.671667 15589 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 18.
I20260709 13:06:48.665681 20577 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:48.677757 15518 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:48.656332 20841 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.679394 20546 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:48.466755 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:48.667352 20399 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:48.679828 20841 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.680441 20399 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:48.653043 20586 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:48.681603 15590 raft_consensus.cc:1275] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:48.681756 20586 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.681448 20399 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.682212 20586 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:48.682346 20841 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:48.683152 20399 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:48.683491 15517 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:48.683682 20778 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:48.669474 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:48.670058 20393 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:48.687748 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:48.688115 15517 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:48.688483 15515 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:48.688594 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:48.689424 20813 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:48.689543 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:48.689847 20813 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:48.690292 20813 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:48.594273 20705 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:48.671916 15337 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 11, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:48.695616 20393 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:48.695955 20772 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.696193 15340 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 213) took 24678 ms (client timeout 15000 ms). Trace:
I20260709 13:06:48.696193 20810 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:48.696802 20393 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.698103 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:48.699096 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:48.656719 15441 raft_consensus.cc:614] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:48.633980 20859 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:48.699831 20832 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:48.678088 20577 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:48.668339 20618 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:48.704308 20832 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.704522 15511 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.704957 20810 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:48.684739 15437 raft_consensus.cc:3060] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:48.684136 20778 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:48.663347 20680 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.713681 15586 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:48.704773 20832 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.704768 20577 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.704936 20618 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:48.709635 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:48.728459 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:48.729020 15589 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 11: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:48.729482 15516 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:48.729511 15441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:48.710868 15590 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:48.589823 15435 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:06:48.700984 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.672741 15443 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:48.722813 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:48.735474 15441 raft_consensus.cc:606] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:48.735960 15441 raft_consensus.cc:614] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:48.723009 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 78729.4us
W20260709 13:06:48.724155 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 66600.9us
I20260709 13:06:48.710772 15509 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:48.737288 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:48.738035 15516 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:48.740947 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:48.741456 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.743240 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:48.743525 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:48.744009 16180 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:48.742736 15511 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:48.737843 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:48.696720 15340 rpcz_store.cc:269] 0709 13:06:24.018039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.019819 (+  1780us) service_pool.cc:224] Handling call
0709 13:06:24.149442 (+129623us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b5400002438. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b16173 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:48.696089 (+24546647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:46.635677 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:46.922587 (+286910us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:46.934926 (+ 12339us) write_op.cc:435] Acquired schema lock
0709 13:06:46.934963 (+    37us) tablet.cc:662] Decoding operations
0709 13:06:46.936376 (+  1413us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:46.936513 (+   137us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:46.936546 (+    33us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:46.938160 (+  1614us) tablet.cc:701] Row locks acquired
0709 13:06:46.938218 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:06:46.938438 (+   220us) write_op.cc:270] Start()
0709 13:06:46.938613 (+   175us) write_op.cc:276] Timestamp: P: 1783602406938352 usec, L: 0
0709 13:06:46.938652 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:06:47.030407 (+ 91755us) log.cc:844] Serialized 4417 byte log entry
0709 13:06:47.540148 (+509741us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:47.928067 (+387919us) op_driver.cc:464] REPLICATION: finished
0709 13:06:48.273461 (+345394us) write_op.cc:301] APPLY: starting
0709 13:06:48.283586 (+ 10125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:48.364267 (+ 80681us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:48.364317 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:48.441722 (+ 77405us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:48.442131 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:06:48.442209 (+    78us) write_op.cc:312] APPLY: finished
0709 13:06:48.442701 (+   492us) log.cc:844] Serialized 105 byte log entry
0709 13:06:48.509418 (+ 66717us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.509657 (+   239us) write_op.cc:454] Released schema lock
0709 13:06:48.509771 (+   114us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:48.511093 (+  1322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.511123 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":630221,"reported_tablets":52,"spinlock_wait_cycles":10456320,"child_traces":[["op",{"apply.queue_time_us":313624,"apply.run_cpu_time_us":19764,"apply.run_wall_time_us":254724,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":166295,"prepare.run_cpu_time_us":43121,"prepare.run_wall_time_us":633383,"raft.queue_time_us":270818,"raft.run_cpu_time_us":31281,"raft.run_wall_time_us":304310,"replication_time_us":899369,"spinlock_wait_cycles":34600704,"thread_start_us":488311,"threads_started":4,"wal-append.queue_time_us":267992}]]}
I20260709 13:06:48.756188 15511 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:48.757791 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:48.761409 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:48.696435 20772 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.765413 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:48.762344 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.762333 16175 raft_consensus.cc:2393] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:06:48.765419 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.766126 16176 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:48.761677 20705 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:48.766939 20850 consensus_queue.cc:1048] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:48.765867 16145 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:48.771075 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.777302 15585 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:48.743153 20841 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:48.785981 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:48.753676 20810 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.794193 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:48.781383 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.756896 20859 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:48.786497 15556 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.784085 20703 consensus_queue.cc:1048] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:48.788900 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:48.790117 15438 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:48.790552 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:48.804586 15442 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:48.791086 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:48.790771 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.805195 15510 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:48.805546 15434 raft_consensus.cc:3060] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.805703 15436 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:48.793392 15511 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:48.790747 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:48.794066 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.808094 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:48.810966 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:48.818007 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.768069 20777 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.834338 15439 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:48.826529 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.778450 20788 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:48.829574 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.781159 20775 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:48.844306 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:48.847302 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:48.848183 15509 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:48.851089 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:48.859428 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 51417.9us
I20260709 13:06:48.802428 20646 raft_consensus.cc:2804] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:48.838472 15440 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 18: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:48.835875 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 45219.6us
I20260709 13:06:48.799481 20452 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:48.862177 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.878741 20828 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:48.879405 20828 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:48.851943 20859 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:48.879845 15583 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:48.799957 20778 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.880703 20859 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.830435 20791 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:48.838498 20737 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:48.882324 20737 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:48.883294 20737 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:48.884460 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69308us
I20260709 13:06:48.839807 20705 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:48.895171 15434 raft_consensus.cc:2468] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:48.898291 15516 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:48.838086 20788 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.847909 20775 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.799250 20841 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.803907 20810 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:48.939487 15509 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:48.800436 20829 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.874799 20738 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.879845 20828 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:48.905756 20808 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:48.853497 20661 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:06:48.916337 20775 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.906535 20788 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:48.907335 20646 raft_consensus.cc:697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:48.901016 20705 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:48.976831 20830 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:06:48.952075 20355 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:06:48.973600 20791 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:48.848083 20777 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:48.946640 20848 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:06:49.020136 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 158057us
I20260709 13:06:49.021389 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:48.864221 20618 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:49.045598 15555 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.062s (SENT)
I20260709 13:06:49.046485 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:48.993891 20705 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:48.989059 20808 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:48.956681 20706 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:06:49.066947 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 194571us
I20260709 13:06:48.973399 20738 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.105436 15437 raft_consensus.cc:2468] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:49.033409 20176 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:49.071961 20680 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:49.124763 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 256624us
W20260709 13:06:49.124270 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45676.3us
W20260709 13:06:49.141242 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.115157 20772 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.033107 20791 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:49.151432 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 264486us
I20260709 13:06:49.120522 20176 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:49.162102 15583 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:06:49.125192 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.600s (SENT)
I20260709 13:06:49.171962 15587 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:49.150483 20877 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:49.184180 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:49.192586 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 67418.3us
W20260709 13:06:49.193922 15555 leader_election.cc:336] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.140s (SENT)
W20260709 13:06:49.197791 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 176521us
I20260709 13:06:49.205153 15583 raft_consensus.cc:2410] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:06:49.141692 20355 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:06:49.175355 20452 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:49.243386 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52766.3us
W20260709 13:06:49.248672 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.249274 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 48725.4us
I20260709 13:06:49.250437 15442 raft_consensus.cc:2468] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
W20260709 13:06:49.253902 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.153s (SENT)
I20260709 13:06:49.254518 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:49.162989 20813 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.122720 20646 consensus_queue.cc:237] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:49.262111 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 135815us
I20260709 13:06:49.168733 19961 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:06:49.232342 20680 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.215814 20561 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:49.270313 20772 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:49.271641 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.272001 20894 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:06:49.272869 20882 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:49.273774 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:49.261304 20829 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.275528 20813 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:49.276568 20703 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.276813 20874 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:06:49.277154 20869 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 13:06:49.282757 15510 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:49.283664 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.290908 20892 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.293828 20848 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:49.232223 20877 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:49.295732 15556 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:49.307757 20176 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:49.349182 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53560.4us
I20260709 13:06:49.349169 20877 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.349648 20176 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.351652 20848 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:49.352047 20738 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:49.352878 20738 raft_consensus.cc:2804] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:49.353478 20738 raft_consensus.cc:697] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:49.356150 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.358629 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.332777 20546 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:49.304195 20680 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:49.362838 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1915fdd81d344a749443e48f07a1fef8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:49.364068 20878 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:49.364532 20680 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:49.301362 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47458.7us
I20260709 13:06:49.169744 20808 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.212353 20679 consensus_queue.cc:1059] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:06:49.308764 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.327126 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 55628us
W20260709 13:06:49.327452 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 53931.8us
I20260709 13:06:49.380043 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.283519 20810 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:49.256978 20399 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:06:49.338526 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54957.5us
I20260709 13:06:49.321460 20841 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:49.307379 20561 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:49.344527 20886 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 13:06:49.345782 20577 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 13:06:49.347404 20791 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:49.401945 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.347908 20859 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:49.402704 20859 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:49.397735 20892 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:49.371714 20777 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.354583 20738 consensus_queue.cc:237] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.403838 20561 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.403662 20892 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.404856 20880 raft_consensus.cc:3055] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:49.405313 20880 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:49.382926 20457 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:49.406654 20457 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:49.387013 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:49.389462 15555 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.248s (SENT)
I20260709 13:06:49.473666 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:49.401619 20577 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.403455 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.374989 20546 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:49.499825 15514 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:49.371138 20772 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:49.417907 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.456529 20881 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.457250 20544 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.460409 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80453.4us
I20260709 13:06:49.378829 20878 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:49.501391 20394 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:49.517220 20878 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.379750 20452 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:49.522164 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 118786us
I20260709 13:06:49.523721 20544 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.524725 20394 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:49.524906 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.525058 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.525916 20896 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:49.526011 20544 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.403880 20859 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.497900 20577 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:49.503029 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 113593us
I20260709 13:06:49.527384 20859 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:49.533174 15515 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:49.532950 20880 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.533715 15513 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:49.526315 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.535300 15509 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
W20260709 13:06:49.536892 20832 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.820s	user 0.010s	sys 0.005s
I20260709 13:06:49.537489 20832 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.538282 20399 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:49.539852 20892 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:49.539943 20881 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.540535 20829 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:49.541443 20705 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.542210 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:49.542353 20881 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.525691 20394 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.543044 20829 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:49.540866 20586 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.858s	user 0.010s	sys 0.004s
W20260709 13:06:49.370270 19961 consensus_queue.cc:1175] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d225833a2cbf4a5995fdbbb1292d1918" responder_term: 15 status { last_received { term: 15 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 15 index: 8 } }
I20260709 13:06:49.543464 20829 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.543859 20586 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.544021 20829 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.545090 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.545954 15517 raft_consensus.cc:2410] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:06:49.546201 20586 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:49.546932 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.544024 20882 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.332937 20703 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.456712 20899 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.451143 20791 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:06:49.513257 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 126391us
I20260709 13:06:49.558565 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.446662 20646 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.511416 20841 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:49.498945 20546 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.554188 20880 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:49.554420 20876 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.418s	user 0.000s	sys 0.002s
I20260709 13:06:49.585448 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.573087 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.563087 20706 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:06:49.563885 20705 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:49.606118 20788 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.005s
W20260709 13:06:49.606918 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.606643 20788 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.607139 20900 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.607889 20900 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.583815 20894 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.610900 20900 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:49.611887 20788 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:49.593876 20176 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:49.595865 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:49.638245 20775 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:06:49.601094 20457 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.573704 20882 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:06:49.603175 20692 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:49.593250 16175 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:06:49.614506 20897 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:06:49.615244 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:49.618227 20828 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.001s
I20260709 13:06:49.618893 20878 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:49.620676 20889 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:06:49.571151 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.563619 20903 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:49.596679 20829 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.643173 20832 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:49.653272 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:49.574132 20646 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.662819 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:49.664336 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 93292.1us
I20260709 13:06:49.647529 20692 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:49.672055 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.657258 20457 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:49.655133 20618 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.676800 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.680294 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.682047 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.666611 20859 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:49.684537 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.651937 20775 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.674960 20772 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.658903 20828 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.684033 20577 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:49.690845 20692 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.691903 20841 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:49.697644 20778 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.698601 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:49.736722 16177 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 14: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:49.699363 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:49.734372 15555 leader_election.cc:336] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.927s (SENT)
I20260709 13:06:49.700274 20461 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:49.674383 20899 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:49.703112 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:49.692961 20829 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.706116 20779 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:49.764541 20779 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:49.764645 20775 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:49.765643 20779 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.766767 20779 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.772984 20899 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:49.773581 20899 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:49.774344 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 71309us
I20260709 13:06:49.775220 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:49.778469 16146 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:49.676281 20894 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:49.714107 15436 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:49.707309 20538 consensus_queue.cc:1059] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:06:49.729935 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.700174 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:49.783979 15583 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:06:49.738042 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:49.729207 20848 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.741554 20646 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:49.736253 20897 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:49.733569 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:06:49.799587 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65201us
I20260709 13:06:49.800109 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:49.726375 20903 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:49.753903 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:49.783080 20461 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:06:49.802258 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 48495.8us
I20260709 13:06:49.754096 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.803848 15434 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.804237 20680 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:49.804674 20680 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:49.805032 20680 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.717978 20577 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:49.806087 20577 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:49.807653 20841 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.761054 20703 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.683248 20618 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:49.780753 15437 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:49.855746 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.787333 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:49.794085 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.857288 15436 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.794922 20538 raft_consensus.cc:2804] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:49.795692 20784 raft_consensus.cc:3055] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:49.796391 20904 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:49.814278 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.862453 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.816704 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3315) took 1097 ms. Trace:
I20260709 13:06:49.862990 15435 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:49.863262 15514 rpcz_store.cc:276] 0709 13:06:48.719345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.719506 (+   161us) service_pool.cc:224] Handling call
0709 13:06:48.719819 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.508799 (+788980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.816292 (+307493us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54002035d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:49.816606 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793265536}
W20260709 13:06:49.860231 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 51410us
I20260709 13:06:49.866876 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:49.868646 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.869673 15435 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:06:49.825977 15434 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:49.870921 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.830644 20705 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:49.832398 20176 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:49.836441 20692 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:49.837047 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.840762 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.856686 15440 raft_consensus.cc:2393] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 14: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:49.880185 15510 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:49.810379 20848 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:49.888269 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.858629 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.871126 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.891816 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.829435 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3314) took 1125 ms. Trace:
I20260709 13:06:49.912673 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.898553 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:49.774847 20899 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.872208 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.916704 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:49.917024 15511 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.876094 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:49.881832 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.883289 15512 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:49.791997 20775 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:06:49.919673 15441 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:49.897339 15438 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:49.897786 15509 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:49.921555 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.922959 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.924508 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.921348 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.924602 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.865420 20784 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:49.892812 15518 rpcz_store.cc:276] 0709 13:06:48.707779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.707905 (+   126us) service_pool.cc:224] Handling call
0709 13:06:48.708249 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.708484 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:48.754855 (+ 46371us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.828693 (+1073838us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b1800059560. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd61716 00007fcf7bd72287
0709 13:06:49.828862 (+   169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:49.828955 (+    93us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:49.829034 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.829159 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.829344 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2415,"prepare.queue_time_us":60260,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":52175,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":14258,"spinlock_wait_cycles":3050752,"thread_start_us":450782,"threads_started":2,"wal-append.queue_time_us":515579}
I20260709 13:06:49.928364 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.929167 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.929193 15512 raft_consensus.cc:2368] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17.
I20260709 13:06:49.882062 20176 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:49.934505 15514 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:49.932742 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.934713 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:49.935690 16180 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:49.877889 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.940245 15439 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:06:49.926322 15509 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:49.882686 20538 raft_consensus.cc:697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:49.947513 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:49.889214 20808 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:49.949759 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.949885 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.962005 15511 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:49.963255 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.948675 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.950815 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.897971 20461 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:49.916837 20620 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:06:49.953263 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:49.953410 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.964560 16179 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:49.964663 15510 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:49.965173 16179 raft_consensus.cc:2410] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:49.953158 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:49.955848 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.881873 20904 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:49.956854 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:49.896999 20880 consensus_queue.cc:1059] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:49.928480 20738 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:49.991410 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:49.954010 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:49.992239 15435 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:49.958629 15442 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:49.933406 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.993265 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.964969 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.954325 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:49.966655 20461 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.994313 15436 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:49.972822 20808 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:49.970906 15511 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:06:49.989146 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:50.004129 15511 pending_rounds.cc:85] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 5
I20260709 13:06:49.979612 16174 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:50.004475 15440 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
W20260709 13:06:49.980192 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.979949 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:49.995923 15509 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:49.994355 15518 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:06:50.007802 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.000905 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:50.009869 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.010900 15518 raft_consensus.cc:2368] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17.
I20260709 13:06:49.959976 20899 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:50.015466 15434 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:50.020200 15511 pending_rounds.cc:107] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:06:50.020587 15511 raft_consensus.cc:2889] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.023576 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.024190 15515 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:49.988498 20904 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.025903 15441 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:50.033460 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.034801 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.011948 20461 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:50.038379 15514 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:50.029809 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.039443 15518 raft_consensus.cc:2368] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12.
I20260709 13:06:50.040318 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.041083 15518 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:50.047179 15590 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 18.
I20260709 13:06:50.045426 15510 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:06:50.031823 20788 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:50.025723 20738 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:50.048084 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.047446 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.049039 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.050237 15441 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:50.051213 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:50.059898 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.061594 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.062659 15518 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:50.037334 20828 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:50.065070 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:50.067078 15517 raft_consensus.cc:2368] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17.
I20260709 13:06:50.075173 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.066262 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.080626 15515 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:50.084458 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.084748 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.056568 20772 consensus_queue.cc:1059] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:06:50.087029 20738 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.092410 20680 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:50.093698 15513 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:50.049253 20538 consensus_queue.cc:237] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:50.096690 20923 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:50.082156 20832 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:50.097723 20832 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.098114 20832 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.098197 20741 raft_consensus.cc:3055] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:50.098654 20741 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:50.099562 20741 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.100672 20741 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:50.101457 20902 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.497s	user 0.005s	sys 0.000s
W20260709 13:06:50.102938 20915 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:06:50.064124 20788 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:50.104413 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3143) took 1386 ms. Trace:
I20260709 13:06:50.107049 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.109282 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:50.110265 15515 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:50.084961 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.104852 15592 rpcz_store.cc:276] 0709 13:06:48.718147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.720162 (+  2015us) service_pool.cc:224] Handling call
0709 13:06:48.746351 (+ 26189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.778882 (+ 32531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.778915 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.841312 (+ 62397us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b2c00033248. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a660372 00007fcf7bd92a01 00007fcf7bd5743a 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:06:48.866211 (+ 24899us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.257097 (+390886us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:49.272814 (+ 15717us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.296971 (+ 24157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.297091 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.498339 (+201248us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b180034a920. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a522 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:50.085994 (+587655us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:50.104066 (+ 18072us) raft_consensus.cc:1685] finished
0709 13:06:50.104089 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.104329 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55824,"prepare.queue_time_us":40014,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":63261,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":42369,"spinlock_wait_cycles":60061184,"thread_start_us":319400,"threads_started":1,"wal-append.queue_time_us":675518}
I20260709 13:06:50.081449 20452 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:06:50.111720 20810 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:50.128007 20810 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:50.129101 20810 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.129576 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.130347 15516 raft_consensus.cc:2376] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11. Re-sending same reply.
I20260709 13:06:50.130511 20810 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:50.131354 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.112485 20788 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.134177 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 594) took 1346 ms. Trace:
I20260709 13:06:50.120672 20904 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:50.135905 20661 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:50.136384 20661 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:50.136832 20661 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.136629 20577 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.137295 16176 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:50.137351 20904 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:50.139312 16182 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:06:50.140611 20890 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.537s	user 0.004s	sys 0.000s
I20260709 13:06:50.141695 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:50.144181 20546 raft_consensus.cc:3055] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:50.144461 20808 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:50.116688 20918 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:06:50.145895 20848 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:50.146397 20484 raft_consensus.cc:3055] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:50.146932 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.147921 15515 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:50.148267 20917 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:50.149026 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.037379 20784 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:50.126479 15438 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:50.144698 20546 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:50.146036 20905 log.cc:927] Time spent T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.527s	user 0.004s	sys 0.000s
I20260709 13:06:50.146445 20848 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.147063 20484 raft_consensus.cc:740] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:50.150039 20680 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:50.036505 20176 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.067660 20762 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:50.123106 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.134583 15443 rpcz_store.cc:276] 0709 13:06:48.788141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.788357 (+   216us) service_pool.cc:224] Handling call
0709 13:06:48.828975 (+ 40618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.985058 (+156083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.985094 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.992344 (+  7250us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.246737 (+254393us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:49.303855 (+ 57118us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.307349 (+  3494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.613667 (+306318us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:50.097450 (+483783us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18000618a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c382a6 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419
0709 13:06:50.133814 (+ 36364us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400069854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:50.133867 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.133937 (+    70us) raft_consensus.cc:1685] finished
0709 13:06:50.133954 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.134110 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32696,"prepare.queue_time_us":60302,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":25655,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":16084,"spinlock_wait_cycles":516993664,"thread_start_us":171606,"threads_started":1,"wal-append.queue_time_us":340961}
I20260709 13:06:50.154320 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.215018 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:50.215787 15511 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:50.157114 15515 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:50.158794 15442 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:50.116742 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.158147 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.177995 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.220302 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.220752 15510 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:50.221056 15516 raft_consensus.cc:2368] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17.
I20260709 13:06:50.146303 20904 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:06:50.193600 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.117602 20618 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:50.196048 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.191817 15555 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.523s (SENT)
W20260709 13:06:50.238060 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46289.5us
I20260709 13:06:50.238973 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.207532 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:50.211601 16176 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:50.192934 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:50.240631 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47789us
I20260709 13:06:50.244268 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:50.246297 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:50.220005 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.248427 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.249953 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.250723 15515 raft_consensus.cc:2376] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18. Re-sending same reply.
I20260709 13:06:50.223891 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:50.227926 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.253248 15518 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.221884 15517 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:50.231230 15513 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:50.226928 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:50.226986 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.254791 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.255102 15516 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:50.256984 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.257999 15515 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:06:50.259478 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.262217 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:50.266279 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:50.267239 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59843.3us
W20260709 13:06:50.271514 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.272764 16177 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:50.275769 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:50.276131 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.277186 15510 raft_consensus.cc:2393] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:50.277257 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.200033 20591 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.279018 15511 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:50.204082 20848 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:50.282109 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.284235 16173 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:50.284148 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.295015 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:50.221406 20841 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:50.307775 15515 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:50.279068 20911 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:50.280893 20877 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:50.318153 15516 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:06:50.309108 15515 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:50.336102 15515 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:50.200073 20705 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:06:50.200986 20461 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:50.279991 20762 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:50.275492 20764 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:50.317378 20916 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:06:50.283738 20680 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:50.278196 20903 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:06:50.286283 20862 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:50.285485 20859 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:50.339188 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:50.358165 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:50.358810 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:50.339471 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:50.359687 15440 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 18: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:50.340220 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:50.359834 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:50.338901 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:50.360558 15436 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:50.338301 15515 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.361763 15515 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.352046 15514 raft_consensus.cc:2410] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:50.286422 20808 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:50.364511 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 101262us
I20260709 13:06:50.338361 20877 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.372483 16182 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:50.372761 15518 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:50.365656 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:50.378077 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:50.379757 15590 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:50.383814 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:50.387301 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:50.390110 15586 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:50.367079 20457 consensus_meta.cc:287] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.004s
I20260709 13:06:50.325377 20841 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.299652 20591 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:50.334831 20878 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:50.410686 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.392071 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:50.419590 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:50.422941 15583 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:06:50.374230 20616 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.364080 20859 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.367904 20788 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:50.426092 15590 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:50.426690 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:50.435016 15436 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:50.382131 20877 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:50.433043 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.418900 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 97930.3us
I20260709 13:06:50.436203 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.439603 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.438099 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:50.446936 15592 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 10. Current term is 12. Ops: []
I20260709 13:06:50.380798 20862 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:50.443930 15515 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
W20260709 13:06:50.453753 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 88228.5us
I20260709 13:06:50.461287 15515 pending_rounds.cc:85] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 8
I20260709 13:06:50.461716 15515 pending_rounds.cc:107] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:06:50.462018 15515 raft_consensus.cc:2889] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.394881 20931 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:50.485783 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.489049 15590 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.488092 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.491168 15586 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.492875 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.493631 15585 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:50.434590 20457 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:50.487392 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 47917.3us
I20260709 13:06:50.337328 20546 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.441558 20901 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.502776 20779 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.511597 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.513257 15588 raft_consensus.cc:1240] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:50.514060 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.424362 20894 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:06:50.515777 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.509431 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.519924 15589 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:50.522320 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.513047 20546 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.432322 20859 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.464756 15592 raft_consensus.cc:1217] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Deduplicated request from leader. Original: 13.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:06:50.526049 15592 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:50.441761 20788 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.440016 20616 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.503677 20577 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:50.501940 20618 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:50.445235 20706 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:06:50.534446 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:50.557792 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:50.528692 20928 log.cc:927] Time spent T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:06:50.441320 20936 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:06:50.529419 20808 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:50.558760 15592 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.552510 15590 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 8.
W20260709 13:06:50.548532 20927 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:06:50.573068 15592 raft_consensus.cc:2410] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:50.573849 15584 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:50.515580 20680 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:50.447201 20762 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.561748 15588 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.532570 20829 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.588706 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.514981 20457 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:50.575443 20577 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:50.525045 20779 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.568549 20882 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.618551 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 352352us
I20260709 13:06:50.621070 15585 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:06:50.532522 20901 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.622476 15589 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:06:50.624054 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:50.625691 15592 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:50.627997 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.629246 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.629663 15585 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:50.639977 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:50.640080 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 111680us
I20260709 13:06:50.642388 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:50.644819 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:50.646396 15589 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:50.642305 15585 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:50.645386 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.645493 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.656253 15590 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:50.619606 20461 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:50.655604 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:50.663223 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.664914 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:50.661396 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.685447 20703 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.686405 20703 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:50.687933 20461 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:50.689250 20461 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:50.651260 20577 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:50.647917 20931 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:50.694891 15555 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.593272 20862 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:50.673161 20738 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:50.710807 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:50.626823 20882 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:50.514029 20772 consensus_queue.cc:1175] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" responder_term: 11 status { last_received { term: 10 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:50.726683 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.654307 20943 consensus_queue.cc:1059] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:06:50.742944 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 78130us
I20260709 13:06:50.718544 20841 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:50.717927 20936 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.745515 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.755915 15588 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:50.758490 15589 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:06:50.759420 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:50.761782 20929 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:06:50.732118 20931 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:50.766250 15588 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.776944 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:50.799464 15468 heartbeater.cc:646] Failed to heartbeat to 127.13.245.126:46019 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.245.126:46019 timed out after 15.000s (SENT)
I20260709 13:06:50.725939 20680 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:50.699306 20808 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:50.790292 20941 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:50.741814 20738 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:50.788908 20930 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:06:50.801463 20788 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:50.915527 20953 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.801644 20935 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:50.930466 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:50.801421 20457 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:50.806846 20937 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:50.959707 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 182848us
I20260709 13:06:50.964092 15586 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:50.964504 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:50.906332 20931 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:50.976922 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.979127 15586 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
W20260709 13:06:50.979379 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.947721 20616 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:50.985726 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 325686us
I20260709 13:06:50.983012 20779 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:50.993515 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:51.000120 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.801616 20577 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:51.002792 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.012s	sys 0.025s
W20260709 13:06:51.004283 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.006677 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.013s	sys 0.025s
I20260709 13:06:51.007097 15588 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
W20260709 13:06:51.007135 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 545043us
I20260709 13:06:50.991294 20952 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:51.006222 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:51.017529 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:51.017877 15441 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:06:51.018281 16176 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:50.992695 20901 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:51.029381 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:51.034626 20546 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.502s	user 0.014s	sys 0.004s
I20260709 13:06:51.038407 20703 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:51.040299 20741 consensus_meta.cc:287] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.939s	user 0.015s	sys 0.006s
W20260709 13:06:51.022190 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.050488 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:51.052580 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:51.053465 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.040117 20960 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:06:51.061900 20661 consensus_meta.cc:287] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.925s	user 0.016s	sys 0.007s
I20260709 13:06:51.062505 20661 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:51.073850 20899 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.036s	user 0.020s	sys 0.004s
I20260709 13:06:51.074729 15583 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:51.075132 15512 raft_consensus.cc:2410] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:51.076699 20947 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:51.056130 20692 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.159s	user 0.015s	sys 0.014s
I20260709 13:06:51.057725 15588 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:51.055397 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:51.080132 20661 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:51.085669 20931 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.092913 15437 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
W20260709 13:06:51.093526 20848 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.784s	user 0.021s	sys 0.000s
I20260709 13:06:51.053838 20882 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.054100 20964 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:51.094038 20848 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:51.094851 15584 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.512s	user 0.016s	sys 0.002s
I20260709 13:06:51.095942 16174 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:51.095234 15584 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:51.101047 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:51.102434 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.102708 20956 consensus_queue.cc:1059] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:51.102226 20968 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:06:51.103116 15588 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:06:51.103629 20956 consensus_queue.cc:1243] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer 6ff41728dec842afad5b53c20446a5a0 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:51.105799 15514 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:51.105788 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:51.107887 15518 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:51.105168 20899 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:06:51.108724 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.113618 15515 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:51.113840 15514 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:51.113866 15588 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:51.115528 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.116880 15588 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:06:51.098328 20810 consensus_meta.cc:287] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.967s	user 0.011s	sys 0.006s
I20260709 13:06:51.088232 20894 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.119091 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:51.121042 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:51.099028 20706 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.114996 15514 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.123512 15518 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:51.123679 15514 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:51.123904 15515 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:51.126210 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:51.095963 20958 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.107985 20903 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:06:51.127511 20764 consensus_meta.cc:287] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.774s	user 0.016s	sys 0.006s
I20260709 13:06:51.131415 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:51.104900 20964 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:51.133809 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:51.137065 15514 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:06:51.137588 15589 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:51.130975 20775 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:51.140432 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.143957 15514 pending_rounds.cc:85] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 9
I20260709 13:06:51.145103 15589 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:06:51.147199 15514 pending_rounds.cc:107] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:06:51.147346 15589 pending_rounds.cc:85] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 8
I20260709 13:06:51.147655 15514 raft_consensus.cc:2889] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.147984 15589 pending_rounds.cc:107] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:06:51.148396 15589 raft_consensus.cc:2889] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.145478 15588 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:51.125639 20706 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.141546 20968 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:51.175608 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:51.179749 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:51.181135 15584 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:51.183099 20958 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.183988 20958 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:51.165854 20591 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.188062 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:51.193671 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:51.194258 20881 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:51.194739 20881 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:51.195619 20881 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.199388 20945 raft_consensus.cc:3055] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:51.199877 20945 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:51.200846 20945 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.202718 20946 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:51.203145 20946 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:51.169807 20832 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.071s	user 0.007s	sys 0.008s
W20260709 13:06:51.159526 20877 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.011s
I20260709 13:06:51.206035 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:51.164064 20705 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:51.172472 20848 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:51.172650 20764 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.214605 20591 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:51.251441 20591 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:51.253281 15407 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 1.598s (SENT) [suppressed 28 similar messages]
I20260709 13:06:51.253767 20591 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.210599 20968 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.184598 20943 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:51.240890 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:51.264405 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:51.246848 20859 consensus_meta.cc:287] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.691s	user 0.017s	sys 0.005s
I20260709 13:06:51.224897 20945 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:51.269909 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:51.256171 20958 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:51.215323 20877 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.272300 20974 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:51.273077 20974 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:51.213414 20832 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.274531 15435 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:51.274178 20974 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.255254 20903 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:51.276765 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:51.263707 20577 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.263566 20894 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:51.263523 20956 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:51.282449 15587 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:51.256690 20705 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:51.306699 20877 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.170328 20964 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.298388 20947 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:51.304354 20943 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:51.271338 20859 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.246592 20946 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:51.319512 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 66269us
I20260709 13:06:51.358421 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:51.298012 20577 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.374164 15441 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:51.321458 20899 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:51.300863 20894 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.298916 20903 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.372310 20832 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.375844 20947 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:51.400547 20943 raft_consensus.cc:697] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:51.413738 20946 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:51.386063 20958 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:51.469903 20958 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:51.472262 20980 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:51.472853 20943 consensus_queue.cc:237] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.399892 20956 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:51.450585 16182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 780) took 1262 ms. Trace:
I20260709 13:06:51.475317 16182 rpcz_store.cc:276] 0709 13:06:50.188350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.189276 (+   926us) service_pool.cc:224] Handling call
0709 13:06:50.189723 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.376069 (+186346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.440300 (+1064231us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54004bbed4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:51.450504 (+ 10204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419560192}
I20260709 13:06:51.457481 20784 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:51.511519 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.468789 20977 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:06:51.420909 20968 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.518126 20968 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.521507 20968 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.496870 20956 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.528712 20956 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:51.533018 20978 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:06:51.499491 20577 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.501541 20894 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.505295 20859 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.371762 20705 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.535501 20705 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:51.537640 20947 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.510047 20903 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:51.627744 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 266488us
I20260709 13:06:51.657815 20591 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:51.669180 20591 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.690613 20591 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.695937 20591 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.716693 20591 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:51.738372 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 461652us
W20260709 13:06:51.739318 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 94241.2us
I20260709 13:06:51.742694 20591 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.743012 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:51.744302 16173 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:51.744447 20947 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:51.744720 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.745693 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.746142 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.751073 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3166) took 1086 ms. Trace:
I20260709 13:06:51.751621 15585 rpcz_store.cc:276] 0709 13:06:50.665014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.665177 (+   163us) service_pool.cc:224] Handling call
0709 13:06:50.665521 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.724177 (+ 58656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.724224 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.724281 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:50.724320 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.750711 (+1026391us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b54003da754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:51.750778 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.750991 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134312320}
I20260709 13:06:51.745000 20947 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.764798 20591 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.768247 20784 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.779798 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.781116 20832 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.781842 20832 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.782477 20990 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.782692 20993 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.783072 20990 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.783180 20993 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.784374 20832 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.785271 20990 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.785393 20993 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.785579 20832 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.785969 20990 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.786041 20993 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:51.786770 20993 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.786548 20832 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:51.788280 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.790467 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.804136 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:51.804025 15440 raft_consensus.cc:1275] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:51.806453 15436 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:51.803951 20992 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.807344 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:51.808158 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:51.786579 20990 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.815353 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:51.816634 15442 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:51.816264 20992 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.816725 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:51.808776 20945 consensus_meta.cc:287] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.000s
I20260709 13:06:51.788293 20591 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.818308 15441 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:06:51.824682 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:51.819455 20990 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.820374 20879 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:51.825762 20879 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.820935 20993 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.788929 20784 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:51.828346 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.838963 20945 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:51.830606 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:51.839802 20945 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:51.841390 20784 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.841970 20945 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:06:51.842598 20176 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:51.844198 15442 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:51.846681 20990 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.847401 20990 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.848964 20992 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.849759 15434 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:51.849015 20591 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.851044 20947 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.851338 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:51.825222 20946 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:51.856451 20779 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.857005 20779 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.859941 15510 raft_consensus.cc:1275] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:51.860239 15518 raft_consensus.cc:3055] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:51.860656 15518 raft_consensus.cc:740] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:51.860805 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:51.861490 15511 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:51.861392 15518 consensus_queue.cc:260] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.862459 15518 raft_consensus.cc:3060] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:51.862475 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:51.864589 15516 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:51.865374 15512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2385) took 1876 ms (client timeout 1600 ms). Trace:
I20260709 13:06:51.865844 15509 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
W20260709 13:06:51.865778 15512 rpcz_store.cc:269] 0709 13:06:49.989436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.991031 (+  1595us) service_pool.cc:224] Handling call
0709 13:06:51.865168 (+1874137us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001e46d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:51.865308 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2489374464}
I20260709 13:06:51.866560 15509 pending_rounds.cc:85] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 8
I20260709 13:06:51.866906 15509 pending_rounds.cc:107] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:06:51.867223 15509 raft_consensus.cc:2889] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.853345 20991 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.870795 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.872576 15512 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:51.875451 20991 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.876143 20484 consensus_queue.cc:260] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.877179 20484 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:51.883728 20974 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:51.884069 20894 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:51.884492 20974 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.884800 20894 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.887054 20974 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.887722 20943 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.888131 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3160) took 1298 ms. Trace:
I20260709 13:06:51.888549 15592 rpcz_store.cc:276] 0709 13:06:50.590196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.590392 (+   196us) service_pool.cc:224] Handling call
0709 13:06:50.622127 (+ 31735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.628862 (+  6735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.887889 (+1259027us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54001f4850. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:51.888049 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72058752}
I20260709 13:06:51.887137 20894 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.889969 20894 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.888223 20943 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.890513 20894 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:51.891130 15583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2222) took 1455 ms (client timeout 1893 ms). Trace:
I20260709 13:06:51.874845 20946 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.892089 20943 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.892691 20894 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.893985 20946 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:51.898705 15583 rpcz_store.cc:269] 0709 13:06:50.435597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.435786 (+   189us) service_pool.cc:224] Handling call
0709 13:06:51.890906 (+1455120us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b5400114c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:51.891056 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457056512}
I20260709 13:06:51.899813 20945 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.900389 20945 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.902029 20881 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:51.904210 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:51.905063 15516 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:06:51.907248 15518 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:06:51.908099 15518 pending_rounds.cc:85] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 11
I20260709 13:06:51.908557 15518 pending_rounds.cc:107] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:06:51.908886 15518 raft_consensus.cc:2889] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.884199 20903 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:51.915031 20484 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.916862 20832 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.919440 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 608) took 1568 ms. Trace:
I20260709 13:06:51.919836 20990 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.919866 15443 rpcz_store.cc:276] 0709 13:06:50.350976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.359232 (+  8256us) service_pool.cc:224] Handling call
0709 13:06:50.381040 (+ 21808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.524125 (+143085us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:06:50.563292 (+ 39167us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.796041 (+1232749us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b1800049720. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a 00007fcf7bd61a2a
0709 13:06:51.834595 (+ 38554us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.835309 (+   714us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.836799 (+  1490us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:51.837700 (+   901us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.917182 (+ 79482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.917244 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.919179 (+  1935us) raft_consensus.cc:1685] finished
0709 13:06:51.919208 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.919375 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11494,"prepare.queue_time_us":39047,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":3472,"raft.queue_time_us":45676,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":15452,"spinlock_wait_cycles":8418048,"thread_start_us":249647,"threads_started":3,"wal-append.queue_time_us":1251248}
I20260709 13:06:51.915609 20484 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.922300 20879 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.923221 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3167) took 1214 ms. Trace:
I20260709 13:06:51.924082 15591 rpcz_store.cc:276] 0709 13:06:50.708443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.708741 (+   298us) service_pool.cc:224] Handling call
0709 13:06:50.709196 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.709472 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:06:50.759832 (+ 50360us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.004055 (+244223us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.861892 (+857837us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b18002816e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c382a6 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1
0709 13:06:51.863680 (+  1788us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b18002816e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:51.868216 (+  4536us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18002816e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:06:51.922670 (+ 54454us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b18002816e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78be4c0a 00007fcf82324219 00007fcf78c6ca40 00007fcf78c674e4 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd61716 00007fcf7bd72287 00007fcf7bd72208
0709 13:06:51.922828 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.922885 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:51.922946 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.923028 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.923161 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":901149,"prepare.queue_time_us":254083,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":98,"raft.queue_time_us":920246,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":10714,"spinlock_wait_cycles":82812544,"thread_start_us":282026,"threads_started":2,"wal-append.queue_time_us":261276}
I20260709 13:06:51.918164 20945 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.933125 20484 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.934253 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 2236) took 1360 ms. Trace:
I20260709 13:06:51.935807 15590 rpcz_store.cc:276] 0709 13:06:50.573685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.573865 (+   180us) service_pool.cc:224] Handling call
0709 13:06:50.574231 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.656631 (+ 82400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.933965 (+1277334us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54001f3e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:51.934183 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178423552}
I20260709 13:06:51.939672 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 605) took 1600 ms. Trace:
I20260709 13:06:51.917071 20903 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.940140 15435 rpcz_store.cc:276] 0709 13:06:50.339091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.339215 (+   124us) service_pool.cc:224] Handling call
0709 13:06:51.939373 (+1600158us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54002d0854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:51.939590 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103561472}
I20260709 13:06:51.911329 20646 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
W20260709 13:06:51.953043 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 215099us
I20260709 13:06:51.956233 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.956624 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:51.957124 15584 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 15: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:51.957130 15583 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:51.957428 15590 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:51.958618 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:51.959228 15592 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:51.960100 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.961490 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.954272 20966 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:06:51.964890 15555 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.870s (SENT)
I20260709 13:06:51.965354 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:51.967296 15437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2232) took 2090 ms (client timeout 1817 ms). Trace:
W20260709 13:06:51.967710 15437 rpcz_store.cc:269] 0709 13:06:49.877389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.891436 (+ 14047us) service_pool.cc:224] Handling call
0709 13:06:51.967112 (+2075676us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400224cd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:51.967228 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737857920}
I20260709 13:06:51.959456 20661 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.972054 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.972612 20878 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.973073 20878 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.973392 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.973969 15585 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:51.974805 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:51.976289 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.972307 20738 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.975226 20878 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:51.975359 15585 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:51.980216 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.980868 15591 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:06:51.981521 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.976118 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.983824 20903 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:51.966987 20452 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:06:51.984931 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.970844 20966 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:51.986187 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.987505 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.988055 20966 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:51.976495 20661 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:51.989957 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.990671 20661 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:51.991488 15590 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:51.988463 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:51.995900 15591 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:52.003209 15592 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:06:52.000361 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52916 (request call id 784) took 1037 ms. Trace:
I20260709 13:06:52.005177 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.005028 16177 rpcz_store.cc:276] 0709 13:06:50.962705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.962925 (+   220us) service_pool.cc:224] Handling call
0709 13:06:50.963397 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.973969 (+ 10572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.974021 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.974099 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:50.974133 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.000115 (+1025982us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540077f6d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:52.000174 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.000304 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23608704}
I20260709 13:06:52.006903 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:52.007690 15515 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:52.000026 20991 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.007915 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.009641 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.010663 15585 raft_consensus.cc:2410] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:06:52.011446 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:52.012657 16177 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
W20260709 13:06:52.020641 20926 log.cc:927] Time spent T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 1.670s	user 0.002s	sys 0.012s
I20260709 13:06:52.020725 15585 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:52.022586 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2383) took 2061 ms. Trace:
I20260709 13:06:52.023005 15509 rpcz_store.cc:276] 0709 13:06:49.960869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.020497 (+ 59628us) service_pool.cc:224] Handling call
0709 13:06:51.865347 (+1844850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.868008 (+  2661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.022400 (+154392us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54001e46d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:52.022527 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4241741568}
W20260709 13:06:52.019426 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53926.3us
I20260709 13:06:52.026193 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:52.028108 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2231) took 1512 ms. Trace:
I20260709 13:06:52.028273 15586 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:52.028429 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:52.029743 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:52.030004 15591 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:52.028512 15587 rpcz_store.cc:276] 0709 13:06:50.515305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.515453 (+   148us) service_pool.cc:224] Handling call
0709 13:06:52.027928 (+1512475us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400055ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:52.028052 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718994688}
I20260709 13:06:52.027107 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.034828 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.032356 20620 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:52.036909 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:52.037494 15585 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:52.038666 15437 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:52.039956 20878 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:52.040520 20878 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:52.040848 20944 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:52.041456 20944 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.046057 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.024684 20991 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.048897 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.052392 15583 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:06:52.054563 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:52.056995 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:52.058087 16182 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:52.031150 21001 consensus_queue.cc:1048] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:06:52.049341 15585 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:52.049927 15435 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:06:52.061511 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:52.063038 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50444.4us
W20260709 13:06:52.067874 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.071038 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:52.046666 20932 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:06:52.080731 15443 raft_consensus.cc:1275] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:52.080862 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:52.082180 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.082356 16173 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:06:52.082276 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:52.086601 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.034016 20937 raft_consensus.cc:2764] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:06:52.041415 20878 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.061566 20620 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:06:52.092048 20944 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:52.061960 20991 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.106621 20991 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.107271 20955 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.108170 20955 consensus_queue.cc:1048] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:06:52.108533 21000 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:06:52.109654 20955 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:52.110337 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.110724 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3176) took 1139 ms. Trace:
I20260709 13:06:52.110985 15587 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:52.111075 15589 rpcz_store.cc:276] 0709 13:06:50.971672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.149343 (+177671us) service_pool.cc:224] Handling call
0709 13:06:51.149711 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.940182 (+790471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.940214 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.940722 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.950893 (+ 10171us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:51.950937 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.951020 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.110524 (+159504us) raft_consensus.cc:1685] finished
0709 13:06:52.110543 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.110666 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":790030,"raft.queue_time_us":791287,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":9849,"thread_start_us":9720,"threads_started":1,"wal-append.queue_time_us":73005}
I20260709 13:06:52.112959 20940 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:52.116199 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.116828 15592 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:06:52.091517 15555 leader_election.cc:400] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17.
I20260709 13:06:52.123409 15518 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:52.125713 15512 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:06:52.125788 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 58875.8us
I20260709 13:06:52.126885 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.127141 15556 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:52.129618 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 65528us
I20260709 13:06:52.131093 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.137046 15590 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:52.137955 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:52.140151 21002 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.140497 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.140727 21002 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:52.141275 21002 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.143438 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:52.145797 15440 raft_consensus.cc:1240] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:52.146175 15436 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:06:52.147147 15440 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:52.147436 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:52.148217 15436 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:52.150668 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:52.151381 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.152385 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:52.153841 15438 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:52.154970 15515 raft_consensus.cc:1240] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:52.155648 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.156165 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.157131 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.158684 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.159662 15511 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:52.157155 15512 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:52.148219 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:52.163556 15440 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:52.164536 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.166625 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.167969 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.168306 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.168809 15515 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:52.168905 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.169670 15440 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:52.170485 15511 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:52.171993 15440 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:52.165393 15436 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:06:52.177454 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.178905 15518 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:52.130507 20461 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:52.183864 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.184566 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:52.137356 20954 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:52.178521 15441 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:52.186895 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.140173 20738 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.184293 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.190289 15513 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
W20260709 13:06:52.190945 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.194135 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.194593 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:52.195870 15513 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:52.196062 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.197036 15518 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:52.198011 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.195161 15511 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:06:52.207647 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:52.209209 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:52.209997 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.210732 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.211330 15514 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:52.214768 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:52.218284 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.187345 20538 consensus_queue.cc:1048] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:06:52.165649 20829 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.229151 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.229875 15514 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:52.171245 20966 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:06:52.235702 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 69431.5us
I20260709 13:06:52.233042 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.176367 20620 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:52.233320 16177 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:52.239923 15511 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:52.237237 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.239966 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.240923 15515 raft_consensus.cc:2410] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:06:52.241986 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 89853.5us
I20260709 13:06:52.243255 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.244976 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.246454 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.247396 15585 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:06:52.186172 20461 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.235081 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.252367 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.257517 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.258260 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:52.257400 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.255651 15515 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:52.255421 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.265362 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.266634 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.268292 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.234891 20808 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:52.281442 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.284123 15436 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:52.285370 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.285758 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:52.230176 20932 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.239943 20620 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.286391 15440 raft_consensus.cc:2376] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18. Re-sending same reply.
I20260709 13:06:52.234251 20955 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:52.249812 20764 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:52.293529 15436 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:06:52.329312 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44032.6us
I20260709 13:06:52.293241 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.255157 20461 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:52.331156 15585 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
W20260709 13:06:52.319695 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.330262 15406 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.334224 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.264016 20974 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:52.334041 20955 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.337142 20974 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:52.338286 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.338163 20974 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.270620 20954 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:52.269928 20937 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.248383 20958 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:06:52.248786 20829 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:52.344844 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.288569 20808 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.287672 20705 raft_consensus.cc:2764] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:06:52.334930 20620 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:52.350131 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 97654.3us
I20260709 13:06:52.293803 20944 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:06:52.363770 21011 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.293964 20879 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:06:52.365034 21010 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:52.360638 20955 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.331825 20764 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:52.365938 20808 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.367156 20958 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:52.368552 20706 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.369974 20954 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:52.360491 20937 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.334367 20994 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:52.373023 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3170) took 1644 ms. Trace:
I20260709 13:06:52.373137 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.386473 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.364297 20996 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:52.395748 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:52.398715 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.388602 20901 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:52.399893 15586 rpcz_store.cc:276] 0709 13:06:50.728340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.981316 (+252976us) service_pool.cc:224] Handling call
0709 13:06:52.028085 (+1046769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.029055 (+   970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.372811 (+343756us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400055ad0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:52.372958 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2375406464}
I20260709 13:06:52.401645 15588 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:52.393560 20764 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:52.403990 20996 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.405794 20706 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:52.401216 20994 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.400607 21010 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:52.406448 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.397104 20958 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:52.411181 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:52.409906 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 143364us
I20260709 13:06:52.415688 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:52.422001 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.423436 20616 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:52.423990 20616 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.424350 20616 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:52.410048 20832 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:06:52.440454 21009 log.cc:927] Time spent T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:06:52.441922 21008 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:06:52.446094 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.459348 15588 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:06:52.444931 20829 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:52.415928 20994 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:52.486084 20958 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.488047 20958 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:52.462765 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:52.447934 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.445684 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.505056 20881 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:52.505761 20881 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.409147 20937 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:52.414844 20706 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.414283 20996 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:52.416110 20990 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:06:52.617651 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.620409 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.621268 15588 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:52.541833 20954 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:52.531106 20901 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:52.544751 20706 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.620203 20432 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.757740 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.758490 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:52.759083 15592 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
W20260709 13:06:52.759794 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 260844us
I20260709 13:06:52.762107 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:52.763586 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 341661us
I20260709 13:06:52.764706 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.569924 21002 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.773342 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:52.774802 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.777459 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.778973 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:52.780692 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.781527 20944 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:52.782047 20944 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:52.782495 20944 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.782588 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:52.781615 20945 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:52.784166 20945 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:52.784524 20945 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:52.784878 20945 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.717926 20952 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:52.709664 20432 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.794448 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.764500 20881 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:52.796203 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 389813us
I20260709 13:06:52.798086 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.802268 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:52.777305 20859 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.777635 20947 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.806160 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:52.812391 15584 raft_consensus.cc:2376] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13. Re-sending same reply.
I20260709 13:06:52.807816 15592 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:52.814069 15584 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:52.801661 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.788360 20932 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:52.786634 20899 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:52.789110 20779 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.817466 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:52.821658 15588 raft_consensus.cc:2376] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16. Re-sending same reply.
I20260709 13:06:52.821856 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:52.772717 20829 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:06:52.819847 16177 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:52.775561 20616 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.774276 20461 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.824566 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.804678 20954 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:52.826965 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.829795 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.811810 20937 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:52.794035 20620 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.817071 20932 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.836050 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.842854 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.844244 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.718716 21010 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.799019 20901 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:52.849287 20901 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.855358 21019 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:52.855926 21019 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.856263 21019 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:52.858421 20903 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.825837 21012 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:06:52.860728 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.861671 21026 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:52.798698 20952 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.862727 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:52.863771 21026 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:52.864126 21026 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:52.864565 21026 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:52.864840 20952 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.865424 20903 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:52.831610 20947 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:52.866588 20947 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.866990 20947 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:52.869982 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.873406 20903 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:52.875985 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:52.876569 21002 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:52.878188 20903 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.827241 20990 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:06:52.880023 21019 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.881132 20990 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:52.881567 20990 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:52.881983 20990 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:52.881748 20903 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:52.882261 20432 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:52.882707 21019 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.879145 21026 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.883437 20764 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.884533 20903 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:52.885689 21026 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.883343 21019 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.895741 20620 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:52.896349 20932 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:52.898255 21007 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.591s	user 0.007s	sys 0.003s
I20260709 13:06:52.899217 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:52.899775 20937 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:52.903306 21028 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:52.903832 21028 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:52.833935 20859 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:52.904255 21028 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:52.832031 20899 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.839005 20779 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:06:52.885758 20764 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:52.913335 20764 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:52.913792 20764 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:52.914677 20764 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.893087 20616 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.893054 20461 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:52.924574 15441 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:52.925024 15441 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:52.926810 15592 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:06:52.925778 15441 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.928011 20878 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:52.928534 20878 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.933043 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:52.933863 15592 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
W20260709 13:06:52.934087 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 123054us
I20260709 13:06:52.931059 20994 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:52.958287 15592 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:06:52.959239 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 139376us
W20260709 13:06:52.960369 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.961349 20899 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:52.943367 20901 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:52.964531 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:52.984207 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 131488us
I20260709 13:06:52.984387 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.985306 15406 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:52.986238 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:52.988173 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.989090 15514 raft_consensus.cc:2410] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:06:52.994393 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.995980 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.997057 15510 raft_consensus.cc:2393] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 7: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:52.997782 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.998617 15517 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
W20260709 13:06:53.004580 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47589.9us
I20260709 13:06:52.949671 21033 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:06:53.002846 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:53.009830 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:53.010514 15516 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.011404 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:53.011897 15513 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:52.981813 20958 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:52.951382 20944 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:52.967163 20452 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:06:53.014124 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:52.963775 21016 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:06:52.988435 20620 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:53.028208 20944 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:53.029017 20661 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:53.029706 20661 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.031589 21032 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.032130 21032 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:53.037221 20808 consensus_meta.cc:287] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.003s
I20260709 13:06:53.037746 20808 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.040530 20994 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.043962 20996 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.048292 21038 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:53.049131 21038 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:53.049468 21038 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.049817 21038 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.054572 20764 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.004549 21012 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:53.057752 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.058457 21021 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:06:53.058326 21011 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.008503 20901 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:06:53.063417 21026 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.017912 20945 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:53.020517 20958 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.021057 15510 raft_consensus.cc:2376] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16. Re-sending same reply.
W20260709 13:06:53.085180 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.094480 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:53.095295 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 109090us
I20260709 13:06:53.098089 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:53.105298 15406 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:53.099296 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 93807.1us
I20260709 13:06:53.070500 20878 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:53.110522 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:53.111176 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:53.115742 15516 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:53.087167 20996 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:53.121376 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:53.127257 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:53.118098 20966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.005s	sys 0.022s
I20260709 13:06:53.137416 20996 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:53.137621 20661 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:53.114823 20779 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:53.139496 20932 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.132959 20938 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:53.130645 20994 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:53.120096 21016 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:53.105635 21026 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.140836 20945 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:06:53.134290 20808 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.143935 21034 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:53.149344 20966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.006s	sys 0.022s
I20260709 13:06:53.156805 20996 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.172345 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 2254) took 1207 ms. Trace:
W20260709 13:06:53.172686 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 102362us
I20260709 13:06:53.108661 21011 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.173007 15591 rpcz_store.cc:276] 0709 13:06:51.965242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.997030 (+ 31788us) service_pool.cc:224] Handling call
0709 13:06:52.029656 (+ 32626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.030375 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.171995 (+1141620us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b5400055ad0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:53.172251 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73868544}
I20260709 13:06:53.126425 21039 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:53.165987 21016 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.178603 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.185148 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:53.186101 15518 raft_consensus.cc:2410] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:06:53.187646 21041 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:06:53.175243 20938 raft_consensus.cc:697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:53.190130 20938 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.191960 20661 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:53.194353 21044 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.194918 21044 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.204952 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.179208 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:53.180176 15592 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:53.158413 21040 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:53.182372 15516 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:53.182489 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:53.171670 21034 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.175410 20996 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:53.254606 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 75462.8us
I20260709 13:06:53.174052 20966 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:53.249519 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 107562us
I20260709 13:06:53.262041 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:53.263753 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:53.264393 15510 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.265398 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:53.266734 15584 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:53.266616 15516 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.203243 21016 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.183629 20994 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:53.207051 20945 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.270161 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:53.277060 15516 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:53.180840 20706 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.280407 21051 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:53.282753 21051 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.283121 21051 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:53.261492 21034 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:53.284026 21026 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.280323 15510 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:53.286610 21044 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:53.274297 21047 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:53.288067 20958 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.284081 20706 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.287354 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:53.289158 15510 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:53.263518 21028 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.277535 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:53.290795 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:53.268953 21046 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:06:53.291821 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:53.294528 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:53.295462 20879 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:53.296041 20879 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.279165 20945 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.296396 20879 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.296700 20706 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:53.310319 15584 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:53.311990 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.280344 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:53.313694 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:53.313687 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.317854 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:53.318755 16182 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.320077 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.321030 15591 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.313841 15510 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:06:53.322466 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.326939 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:53.363880 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:53.327898 15589 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:06:53.364815 15516 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.365592 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.366704 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.367590 15589 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.369628 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.272626 20779 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:53.297034 21049 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.291311 21028 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.403575 15516 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:53.406399 15516 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:53.409397 15516 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:53.297739 20706 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.309259 20616 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:53.433370 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:53.434144 15590 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:53.401335 21044 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:06:53.297894 21050 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:53.261185 21040 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:53.428414 20947 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.561s	user 0.013s	sys 0.001s
I20260709 13:06:53.401041 20779 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:53.458709 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:53.473987 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 898) took 1365 ms. Trace:
I20260709 13:06:53.478526 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 3382) took 1206 ms. Trace:
I20260709 13:06:53.430651 21039 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:53.431046 20706 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.367265 21026 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:06:53.456506 20966 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.474752 15587 rpcz_store.cc:276] 0709 13:06:52.108708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.472745 (+1364037us) service_pool.cc:224] Handling call
0709 13:06:53.473193 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.473462 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.473507 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.473581 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:53.473622 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.473699 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.473883 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:53.498235 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:53.503886 20932 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.479097 15511 rpcz_store.cc:276] 0709 13:06:52.271853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.275639 (+  3786us) service_pool.cc:224] Handling call
0709 13:06:53.458483 (+1182844us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:06:53.478441 (+ 19958us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12753792}
W20260709 13:06:53.515754 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.476694 20779 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:53.525496 15591 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:53.428675 21049 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.485893 21039 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.479691 20947 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.556620 15437 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:06:53.459132 20994 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.520332 21012 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:53.569352 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:53.572124 15440 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:53.571031 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:53.573925 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:53.537328 20859 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:53.536516 21039 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.543331 20935 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:53.585873 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:53.586560 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2247) took 1440 ms. Trace:
I20260709 13:06:53.590260 15512 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:53.586668 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:53.583387 15439 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:53.594837 15589 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:06:53.611129 15443 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:53.608085 15438 rpcz_store.cc:276] 0709 13:06:52.145668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.148629 (+  2961us) service_pool.cc:224] Handling call
0709 13:06:52.153666 (+  5037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.154288 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.586358 (+1432070us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b54002b1e50. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:53.586498 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10563968}
I20260709 13:06:53.626372 16182 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
W20260709 13:06:53.580004 20990 consensus_meta.cc:287] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.691s	user 0.015s	sys 0.005s
I20260709 13:06:53.655037 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:53.655625 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:53.656201 15589 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.597101 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:53.563460 20938 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:53.561456 21052 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:53.579999 20432 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.566462 21011 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:53.559820 20937 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:53.707118 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:53.716305 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:53.582516 20958 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.582922 21060 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:53.625972 20484 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.630074 21023 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.629633 21028 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:53.718622 20452 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:53.589749 20859 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.814841 15443 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:53.907249 15589 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:06:53.856568 21040 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:53.816681 20484 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.759269 20432 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.915899 21026 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.916703 21026 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.917907 20432 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:53.919915 21058 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:53.919787 20452 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.921625 15591 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 5.
I20260709 13:06:53.923789 20452 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:53.915369 20484 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:53.925258 20484 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.925812 20484 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.928153 20484 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.928813 20484 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:53.731724 20808 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:53.816015 20945 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:53.927045 20706 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.766494 21011 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:53.921432 21058 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:53.974603 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 377438us
I20260709 13:06:53.725103 21047 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:53.888957 20932 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:53.583452 21012 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:53.733129 20938 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.997130 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:53.946904 20484 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:53.684074 20990 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.011277 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.014649 15434 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:53.773149 20958 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.773581 20937 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.989519 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:53.755321 20935 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.022269 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:54.000902 20764 consensus_meta.cc:287] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.911s	user 0.012s	sys 0.004s
I20260709 13:06:53.733734 21052 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:53.931912 21028 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.040066 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:53.969780 20808 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:53.781101 21060 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.000849 21058 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:54.030485 21038 consensus_meta.cc:287] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.980s	user 0.016s	sys 0.008s
I20260709 13:06:54.032722 20616 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:54.035600 21026 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:53.817576 21023 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.055786 15583 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:54.016059 20932 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.068277 15443 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:54.054591 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:54.080000 20789 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:54.080518 20789 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:54.080971 20789 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:54.081310 21052 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.081561 21028 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.083007 21060 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.083722 21072 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:54.085489 21072 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:54.085886 21072 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:54.088801 20937 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.077772 20947 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.090404 20706 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.061221 20952 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:06:54.091307 21012 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.093488 20990 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.094323 21058 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.098377 21054 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:06:54.098728 20808 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.058599 21057 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:54.006397 21047 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.068869 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:54.064113 20432 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.074981 15482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.008s	sys 0.013s
W20260709 13:06:54.122169 15482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.008s	sys 0.013s
W20260709 13:06:54.122663 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 850711us
I20260709 13:06:54.071224 21038 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.093685 21063 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:06:54.139920 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 71178.5us
I20260709 13:06:54.140655 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:54.100404 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 45914us
I20260709 13:06:54.100994 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2440) took 1105 ms. Trace:
I20260709 13:06:54.143956 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:54.100454 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 1098) took 2034 ms. Trace:
I20260709 13:06:53.991284 21011 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.110024 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:54.112692 15441 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:54.071483 15407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.007s	sys 0.014s
I20260709 13:06:54.146775 15509 rpcz_store.cc:276] 0709 13:06:52.066547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.069733 (+  3186us) service_pool.cc:224] Handling call
0709 13:06:52.070194 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.081604 (+ 11410us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:52.081639 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.091409 (+  9770us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.539575 (+1448166us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b180035faa0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:53.880697 (+341122us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:53.880758 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.880855 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.100117 (+219262us) raft_consensus.cc:1685] finished
0709 13:06:54.100142 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.100380 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10859,"raft.queue_time_us":11056,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7538,"spinlock_wait_cycles":19617152,"thread_start_us":340793,"threads_started":1,"wal-append.queue_time_us":1891708}
I20260709 13:06:54.168095 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:54.154042 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.154119 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:54.167101 15407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.007s	sys 0.014s
I20260709 13:06:54.169888 15589 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 15: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:54.120169 20879 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.009s
I20260709 13:06:54.174958 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:54.182327 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:54.111946 20935 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.243132 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:54.244668 15589 raft_consensus.cc:2393] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 19: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:54.233801 15509 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:54.237459 21011 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.249312 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:54.237850 21016 consensus_meta.cc:287] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.958s	user 0.013s	sys 0.001s
W20260709 13:06:54.239698 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 65410us
W20260709 13:06:54.276345 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 100254us
I20260709 13:06:54.277570 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:54.278162 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:54.161441 20706 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:54.144539 15513 rpcz_store.cc:276] 0709 13:06:52.995189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.073042 (+ 77853us) service_pool.cc:224] Handling call
0709 13:06:53.092954 (+ 19912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.264295 (+171341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.264326 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.264880 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.514295 (+249415us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:53.533489 (+ 19194us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.533738 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.533819 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.100707 (+566888us) raft_consensus.cc:1685] finished
0709 13:06:54.100740 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.100919 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8762,"prepare.queue_time_us":19538,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":62238,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":8516,"thread_start_us":419874,"threads_started":2,"wal-append.queue_time_us":315574}
I20260709 13:06:54.283879 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:54.192481 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:54.114264 20808 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.268265 21010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.420s	user 0.013s	sys 0.040s
I20260709 13:06:54.102102 21073 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.197s
I20260709 13:06:54.231446 20899 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:54.292599 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:54.290733 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:54.108752 21049 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:54.290337 20931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.390s	user 0.018s	sys 0.051s
I20260709 13:06:54.138427 20616 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:54.165650 21057 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:54.090099 21072 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.183456 21060 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:06:54.138659 20432 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:54.292688 21010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.013s	sys 0.041s
I20260709 13:06:54.266810 20879 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.294508 21077 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.320011 21039 consensus_meta.cc:287] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.695s	user 0.014s	sys 0.000s
W20260709 13:06:54.317070 20931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.412s	user 0.018s	sys 0.052s
I20260709 13:06:54.290676 20945 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:06:54.285866 21016 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.368014 21034 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.083s	user 0.011s	sys 0.002s
I20260709 13:06:54.383665 21057 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.375917 21072 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.380753 21034 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.372321 21077 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.376073 21039 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.405270 21055 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.969s	user 0.000s	sys 0.008s
W20260709 13:06:54.390079 21051 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.106s	user 0.013s	sys 0.005s
W20260709 13:06:54.407367 21053 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.971s	user 0.003s	sys 0.004s
I20260709 13:06:54.406472 21051 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.469242 15408 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.005s	sys 0.015s
W20260709 13:06:54.470402 15408 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.006s	sys 0.015s
I20260709 13:06:54.183220 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.480413 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.480419 15436 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:54.489845 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.492010 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.493456 15509 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:54.496810 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:54.498999 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.508816 15513 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 19: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:54.297901 15589 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:06:54.506968 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55304 (request call id 2267) took 1330 ms. Trace:
I20260709 13:06:54.500814 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3217) took 1176 ms. Trace:
W20260709 13:06:54.513365 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 226376us
I20260709 13:06:54.510587 15588 rpcz_store.cc:276] 0709 13:06:53.176489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.176910 (+   421us) service_pool.cc:224] Handling call
0709 13:06:53.187987 (+ 11077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.208702 (+ 20715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.208753 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.251996 (+ 43243us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.394571 (+142575us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:53.394647 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.394766 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.404573 (+1009807us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:54.506142 (+101569us) raft_consensus.cc:1685] finished
0709 13:06:54.506192 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.506672 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20229,"raft.queue_time_us":20396,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":44272,"spinlock_wait_cycles":6095232,"thread_start_us":142038,"threads_started":1,"wal-append.queue_time_us":183964}
I20260709 13:06:54.511816 15584 rpcz_store.cc:276] 0709 13:06:53.324019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.395449 (+ 71430us) service_pool.cc:224] Handling call
0709 13:06:53.395988 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.403003 (+  7015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.403079 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.427630 (+ 24551us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.539092 (+111462us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:53.539169 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.539912 (+   743us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.499881 (+959969us) raft_consensus.cc:1685] finished
0709 13:06:54.499941 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.500375 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6189,"raft.queue_time_us":6430,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":5347,"thread_start_us":47921,"threads_started":1,"wal-append.queue_time_us":441613}
I20260709 13:06:54.518787 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.523729 15513 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:54.527043 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:54.295269 20808 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.528476 16174 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:54.172758 20484 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:54.527025 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:54.567087 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2449) took 1302 ms. Trace:
I20260709 13:06:54.578123 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.591179 21038 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.592350 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.593768 15435 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:54.311009 20899 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:54.595520 20832 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.717s	user 0.023s	sys 0.056s
W20260709 13:06:54.596051 20832 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.736s	user 0.023s	sys 0.056s
I20260709 13:06:54.596356 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:54.597317 21051 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.598028 20903 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:54.599841 21046 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:54.601085 21046 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.601379 20616 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.602438 16176 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:54.580173 21033 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:54.604429 21033 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.610200 21039 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.597385 16182 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:54.613221 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.613785 21034 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.618534 15513 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:54.593513 21072 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:54.620965 20879 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.622006 21028 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:54.623574 21016 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.623245 21028 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.624662 21049 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:54.624287 21033 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.625564 21049 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.626362 21028 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.627244 20994 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.599848 20938 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.628252 20994 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.629755 15435 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:06:54.630246 20484 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.631297 21072 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.634320 21072 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.631399 20994 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.662545 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.666138 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:54.669102 15441 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.004s
I20260709 13:06:54.669561 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51310 (request call id 905) took 1028 ms. Trace:
I20260709 13:06:54.670436 21046 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.672123 21104 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:54.685954 21046 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:54.687506 21046 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.686244 21105 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:54.688393 20932 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.688978 21105 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.674434 15438 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:54.675055 15591 rpcz_store.cc:276] 0709 13:06:53.641239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.706524 (+ 65285us) service_pool.cc:224] Handling call
0709 13:06:54.669088 (+962564us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000c1554. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:54.669320 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364629376}
I20260709 13:06:54.573091 15510 rpcz_store.cc:276] 0709 13:06:53.264760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.888708 (+623948us) service_pool.cc:224] Handling call
0709 13:06:53.889165 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.889592 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.889636 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.890403 (+   767us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.141583 (+251180us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:54.504422 (+362839us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.566139 (+ 61717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.566337 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.566433 (+    96us) raft_consensus.cc:1685] finished
0709 13:06:54.566453 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.566772 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":259238,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":15796,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"thread_start_us":438818,"threads_started":3,"wal-append.queue_time_us":266238}
I20260709 13:06:54.697594 21047 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.698204 20932 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.703171 21022 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 1.873s	user 0.009s	sys 0.005s
W20260709 13:06:54.705792 21020 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.814s	user 0.007s	sys 0.006s
I20260709 13:06:54.707938 20932 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.709983 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.716179 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52916 (request call id 793) took 1958 ms. Trace:
I20260709 13:06:54.716780 16177 rpcz_store.cc:276] 0709 13:06:52.758036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.758223 (+   187us) service_pool.cc:224] Handling call
0709 13:06:54.715682 (+1957459us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b5400540bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:54.715931 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139508480}
I20260709 13:06:54.720350 21023 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.721608 15515 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:54.723109 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.726495 15437 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:54.731355 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 1118) took 1167 ms. Trace:
I20260709 13:06:54.735896 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:54.736827 15583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 3198) took 2564 ms (client timeout 1647 ms). Trace:
W20260709 13:06:54.713330 21087 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.341s	user 0.005s	sys 0.005s
I20260709 13:06:54.711037 20932 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.751600 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:54.737399 15583 rpcz_store.cc:269] 0709 13:06:52.172618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.475853 (+1303235us) service_pool.cc:224] Handling call
0709 13:06:54.736387 (+1260534us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54001dddd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:54.736570 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279741824}
I20260709 13:06:54.751751 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:54.760150 21104 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.740763 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2268) took 1193 ms. Trace:
I20260709 13:06:54.732694 15515 rpcz_store.cc:276] 0709 13:06:53.564709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.722532 (+1157823us) service_pool.cc:224] Handling call
0709 13:06:54.723045 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.723379 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.723408 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.723473 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:54.723506 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.731141 (+  7635us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.731266 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.768429 15443 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:54.737251 15510 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:54.737282 21079 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.704103 15441 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:06:54.795454 15441 pending_rounds.cc:85] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 11
I20260709 13:06:54.791841 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:54.778223 15434 rpcz_store.cc:276] 0709 13:06:53.547527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.547728 (+   201us) service_pool.cc:224] Handling call
0709 13:06:53.548051 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.020588 (+472537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.740141 (+719553us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54003a6e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:54.740519 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072431360}
I20260709 13:06:54.766018 20808 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.798774 20899 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.764218 21032 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.795853 15441 pending_rounds.cc:107] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:06:54.810148 15441 raft_consensus.cc:2889] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.810559 20958 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.811558 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 624) took 2014 ms. Trace:
W20260709 13:06:54.811933 20829 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:06:54.812563 20738 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:54.813541 20738 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.813905 15556 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:54.814134 20901 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:54.814564 21002 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.815438 21002 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.815855 20954 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:54.816037 21016 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.816630 20954 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:54.817869 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 540288us
I20260709 13:06:54.818032 20738 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.818173 21002 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.797883 15438 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:54.763154 20432 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.797904 15434 raft_consensus.cc:1240] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:54.819227 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:54.814957 20901 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.819887 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.820271 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:54.820672 15438 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:54.821837 20901 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.822024 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.822886 15434 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:54.823890 15443 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:54.838581 15443 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:06:54.839610 21046 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:54.841148 15585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 3203) took 2443 ms (client timeout 2102 ms). Trace:
W20260709 13:06:54.841612 15585 rpcz_store.cc:269] 0709 13:06:52.398080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.398296 (+   216us) service_pool.cc:224] Handling call
0709 13:06:54.840773 (+2442477us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54001dd3d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:54.840923 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4814857984}
I20260709 13:06:54.844791 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2275) took 1275 ms. Trace:
I20260709 13:06:54.845264 15436 rpcz_store.cc:276] 0709 13:06:53.569210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.570176 (+   966us) service_pool.cc:224] Handling call
0709 13:06:53.570729 (+   553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.482242 (+911513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.844456 (+362214us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b5400302ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:54.844727 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2090195200}
I20260709 13:06:54.825253 20946 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:54.827481 20958 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.828213 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:54.812039 15441 rpcz_store.cc:276] 0709 13:06:52.797180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.797374 (+   194us) service_pool.cc:224] Handling call
0709 13:06:52.816666 (+ 19292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.924469 (+107803us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b54001da720. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd591c0 00007fcf7bd5a231 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c
0709 13:06:54.112063 (+1187594us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b580060cbd0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd4dfe7 00007fcf7bd4f7de 00007fcf7bd59b49 00007fcf7bd5a416 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4
0709 13:06:54.811069 (+699006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.811453 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232620160}
I20260709 13:06:54.831532 21105 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.821849 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.819235 20954 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.847409 21049 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.847556 20901 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:54.835476 20779 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.297s	user 0.012s	sys 0.014s
I20260709 13:06:54.853134 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:54.861531 15556 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:54.854206 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:54.854409 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.871395 16174 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:54.852802 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.866434 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:54.866360 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2614) took 1206 ms. Trace:
I20260709 13:06:54.858460 21104 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.866420 21002 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.877730 21010 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:54.878036 21002 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.878499 21010 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.880882 21002 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.881109 21010 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.881589 21002 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.882340 15513 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:54.883719 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.883827 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:54.884503 15513 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:54.886214 15509 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:06:54.886360 21069 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.886859 21069 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:54.873088 20958 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.887269 21069 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.890383 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2447) took 1625 ms. Trace:
I20260709 13:06:54.890820 15517 rpcz_store.cc:276] 0709 13:06:53.264353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.629305 (+364952us) service_pool.cc:224] Handling call
0709 13:06:53.632050 (+  2745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.054601 (+422551us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:54.054639 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.055163 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.176692 (+121529us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:54.176741 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.889765 (+713024us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400213c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:54.889831 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.889905 (+    74us) raft_consensus.cc:1685] finished
0709 13:06:54.889917 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.890183 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2221,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6140,"spinlock_wait_cycles":970756480,"thread_start_us":55232,"threads_started":1,"wal-append.queue_time_us":312469}
I20260709 13:06:54.872371 15439 rpcz_store.cc:276] 0709 13:06:53.659900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.668707 (+  8807us) service_pool.cc:224] Handling call
0709 13:06:53.768574 (+ 99867us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:54.014297 (+245723us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:54.477138 (+462841us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.589833 (+112695us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:54.591023 (+  1190us) log.cc:844] Serialized 52 byte log entry
0709 13:06:54.591225 (+   202us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:54.591744 (+   519us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.592037 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.592236 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.863224 (+270988us) raft_consensus.cc:1685] finished
0709 13:06:54.863254 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.866163 (+  2909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24904,"prepare.queue_time_us":66407,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":123,"raft.queue_time_us":180601,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":334,"thread_start_us":755123,"threads_started":3,"wal-append.queue_time_us":342598}
I20260709 13:06:54.876492 21016 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:54.893337 15517 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:54.893258 21016 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.898131 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:54.900214 15585 raft_consensus.cc:1240] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:06:54.900700 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:54.887236 20779 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.901902 15514 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:54.901477 20946 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.902344 15514 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2443) took 1900 ms (client timeout 1937 ms). Trace:
W20260709 13:06:54.902732 15514 rpcz_store.cc:269] 0709 13:06:53.001558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.900132 (+1898574us) service_pool.cc:224] Handling call
0709 13:06:54.902281 (+  2149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.905192 20706 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:54.905596 20706 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:54.905809 21010 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:54.907184 20738 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:54.907683 20738 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:54.910244 15515 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.899459 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:54.913547 21079 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.913897 21002 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.914019 15518 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:06:54.906912 20706 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.922744 15512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2436) took 1914 ms (client timeout 1607 ms). Trace:
W20260709 13:06:54.923292 15512 rpcz_store.cc:269] 0709 13:06:52.994013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.994140 (+   127us) service_pool.cc:224] Handling call
0709 13:06:54.908160 (+1914020us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54003f61d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:54.908384 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351874432}
I20260709 13:06:54.924903 15586 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:54.925657 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:54.622153 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:54.927080 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:54.924015 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:54.928642 15518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3387) took 1741 ms. Trace:
I20260709 13:06:54.929108 15518 rpcz_store.cc:276] 0709 13:06:53.187389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.188446 (+  1057us) service_pool.cc:224] Handling call
0709 13:06:54.913497 (+1725051us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.917873 (+  4376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.928465 (+ 10592us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54003f61d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:06:54.928586 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3955134848}
I20260709 13:06:54.929729 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:54.930369 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.931317 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.923138 20859 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:54.933185 15337 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 113) took 14682 ms (client timeout 15000 ms). Trace:
I20260709 13:06:54.913903 20738 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.923746 21016 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.917791 20958 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:06:54.936214 21002 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:54.935714 20789 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.014s
I20260709 13:06:54.937422 20789 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.938771 21002 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.923247 15585 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:54.919793 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:54.899060 21069 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:54.915061 21049 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:54.941730 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.947165 15513 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:06:54.947499 21048 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.933691 15337 rpcz_store.cc:269] 0709 13:06:40.250897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.252193 (+  1296us) service_pool.cc:224] Handling call
0709 13:06:54.932870 (+14680677us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:48.883152 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:48.883849 (+   697us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:48.883888 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:06:48.883907 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:49.137113 (+253206us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:49.148851 (+ 11738us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:49.153284 (+  4433us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:06:49.339604 (+186320us) tablet.cc:701] Row locks acquired
0709 13:06:49.339633 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:06:49.339860 (+   227us) write_op.cc:270] Start()
0709 13:06:49.340060 (+   200us) write_op.cc:276] Timestamp: P: 1783602409339780 usec, L: 0
0709 13:06:49.340093 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:06:49.341090 (+   997us) log.cc:844] Serialized 3601 byte log entry
0709 13:06:49.603775 (+262685us) op_driver.cc:464] REPLICATION: finished
0709 13:06:49.859676 (+255901us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf78c4d0ac 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7f78def0
0709 13:06:50.034889 (+175213us) write_op.cc:301] APPLY: starting
0709 13:06:50.034983 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:50.132919 (+ 97936us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:50.132941 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:50.658075 (+525134us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:50.723402 (+ 65327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:06:50.729463 (+  6061us) write_op.cc:312] APPLY: finished
0709 13:06:50.910965 (+181502us) log.cc:844] Serialized 89 byte log entry
0709 13:06:51.017108 (+106143us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.038583 (+ 21475us) write_op.cc:454] Released schema lock
0709 13:06:51.038669 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.039276 (+   607us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.039328 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":540807,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":430822,"apply.run_cpu_time_us":31313,"apply.run_wall_time_us":1004323,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":187479,"prepare.run_cpu_time_us":8373,"prepare.run_wall_time_us":458359,"replication_time_us":263477,"spinlock_wait_cycles":85402368,"thread_start_us":541932,"threads_started":3,"wal-append.queue_time_us":95246,"wal-append.run_cpu_time_us":1455,"wal-append.run_wall_time_us":1001454}]]}
I20260709 13:06:54.919900 21105 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:54.948302 21048 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:54.953693 21079 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:54.919199 20901 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:54.955000 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 55748us
I20260709 13:06:54.945520 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:54.940387 20779 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:54.958014 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:54.958822 21048 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.960774 21105 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.962381 15583 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:54.976022 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 114991us
I20260709 13:06:54.951139 21077 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.976804 16175 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:54.954746 20859 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:54.980377 20946 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:54.986289 20996 consensus_meta.cc:287] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.716s	user 0.017s	sys 0.006s
I20260709 13:06:54.956977 21049 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.008867 21049 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.013895 20789 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:54.973629 21105 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:55.018604 20901 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:55.021289 20779 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.022109 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.022015 20779 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.024315 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:54.989809 20859 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:55.026687 20859 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.993113 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.034174 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.035077 15435 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:06:55.037076 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:54.989068 21046 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.040925 21046 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.041271 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.042006 15440 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:55.043973 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.044469 20452 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:55.044750 15440 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:55.045526 21048 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.045590 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.046281 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.046311 21048 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.047482 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.048108 15583 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:55.047914 20452 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.049130 21048 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:55.050285 20452 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:55.050226 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.051288 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.051954 15587 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.052728 16145 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:55.053630 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 141695us
I20260709 13:06:55.053790 15440 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:54.994796 20706 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:54.978688 15556 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:54.997675 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:54.998665 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:55.000648 20952 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:55.001817 21070 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:55.064153 20996 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.077558 20974 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:55.078009 20974 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.078388 20974 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.078703 15442 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:55.078653 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80305.9us
I20260709 13:06:55.079202 20996 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:55.079990 20996 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:55.024539 20779 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:55.080792 15589 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 15 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:06:55.081259 21111 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
I20260709 13:06:55.081876 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2267) took 1537 ms. Trace:
I20260709 13:06:55.081946 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.082327 15442 rpcz_store.cc:276] 0709 13:06:53.544141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.546587 (+  2446us) service_pool.cc:224] Handling call
0709 13:06:53.547002 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.079299 (+1532297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.081595 (+  2296us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54003a5f54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:55.081807 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3521698688}
I20260709 13:06:55.085625 20616 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:55.086560 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:55.086889 20616 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:55.064764 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.087301 20616 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:55.088654 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.063947 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.052680 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:55.056946 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.057368 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:55.056354 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.056000 21075 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:55.079967 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.080724 20996 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.993867 21069 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:55.082751 15589 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:06:55.088425 20616 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.090049 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.072213 21042 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:55.055523 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:55.075884 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 118055us
W20260709 13:06:55.003675 15407 connection.cc:256] RPC call timeout handler was delayed by -1.3918638269999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 13:06:55.092206 16174 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:55.092335 15592 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.094547 15587 raft_consensus.cc:2410] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:55.093838 15515 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:55.043466 21046 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:55.101130 20996 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.113121 20616 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:55.097833 20994 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:55.116096 20994 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.116554 20994 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:55.091881 20738 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.096072 21075 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.126806 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2450) took 1861 ms. Trace:
I20260709 13:06:55.129127 21042 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.096992 21079 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.141891 15583 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
W20260709 13:06:55.147094 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 91625us
I20260709 13:06:55.148751 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.152099 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.141609 21075 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:55.164731 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 224426us
I20260709 13:06:55.139070 15516 rpcz_store.cc:276] 0709 13:06:53.264942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.115030 (+850088us) service_pool.cc:224] Handling call
0709 13:06:54.115417 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.115815 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.115842 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.120441 (+  4599us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.937337 (+816896us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b180024f820. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:54.999729 (+ 62392us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:55.077013 (+ 77284us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.079764 (+  2751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.079875 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.126339 (+ 46464us) raft_consensus.cc:1685] finished
0709 13:06:55.126449 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.126613 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74427,"prepare.queue_time_us":90841,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":2051,"raft.queue_time_us":14470,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":34655,"spinlock_wait_cycles":14430976,"thread_start_us":53056,"threads_started":1,"wal-append.queue_time_us":971177}
I20260709 13:06:55.161597 21069 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:06:55.184748 15341 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 11 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 12 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:55.189328 15341 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 10 to 11, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 11 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:55.192227 15406 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:55.193392 21026 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:55.196952 21049 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.157688 20938 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:55.205782 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.226248 15592 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 9.
I20260709 13:06:55.203698 20938 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.236289 15556 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:55.253959 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.251317 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:55.243353 20938 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.252493 15341 catalog_manager.cc:5697] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.247620 20779 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:55.266681 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:55.268386 21010 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:55.212028 21026 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.275658 15510 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:06:55.277909 15435 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:06:55.276048 15510 pending_rounds.cc:85] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 8
I20260709 13:06:55.280369 15510 pending_rounds.cc:107] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:06:55.280668 15510 raft_consensus.cc:2889] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.284960 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.266400 21105 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.276700 20779 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:55.280476 21104 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:55.288112 20484 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:55.299614 15341 catalog_manager.cc:5697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.300930 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.291163 21046 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:06:55.304097 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48202.6us
I20260709 13:06:55.306990 15435 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:55.264716 21060 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
W20260709 13:06:55.305029 21117 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
I20260709 13:06:55.306398 15341 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 12 to 15, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.323918 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:55.325529 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.326305 15435 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
W20260709 13:06:55.330466 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 127989us
I20260709 13:06:55.318620 21042 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:55.329304 21049 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:55.316931 21104 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.316515 20829 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:06:55.333449 20808 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:55.329859 20484 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.360332 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.362008 15440 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:06:55.359709 15341 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 12 to 13, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 13 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:06:55.366178 21116 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:06:55.378443 15440 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:55.375985 15341 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 13 to 15, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.400879 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:55.390343 21112 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 13:06:55.390089 21105 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:55.384219 20994 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.419265 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:55.411391 20808 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:55.411798 21042 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:55.436599 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:55.391394 20779 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.435514 20808 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.450093 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:55.450726 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:55.451363 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:55.457618 21104 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:55.451642 21079 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:55.458316 21079 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:55.458819 21079 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.460398 21026 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:55.460786 20484 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:55.494033 15518 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:55.466403 20829 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:55.481050 15341 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 12 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:06:55.498752 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:55.499630 15516 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:55.503731 21028 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:55.504694 21028 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.507148 21048 raft_consensus.cc:3055] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:55.507751 21048 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:55.510311 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:55.512488 21028 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:55.513567 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.516470 15585 raft_consensus.cc:1240] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:55.533711 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.518893 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.519759 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.519906 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.520898 20808 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:55.520960 15588 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:55.521720 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.522001 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2445) took 2258 ms. Trace:
I20260709 13:06:55.522518 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.523239 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.524613 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:55.526968 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.527809 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.532231 20706 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:55.549346 15439 raft_consensus.cc:2410] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:06:55.448705 21042 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.553666 16174 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:55.557075 15341 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.562566 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.559361 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.563845 15591 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:55.566210 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.481678 20974 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:55.573510 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 47307.1us
I20260709 13:06:55.576717 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.541004 15511 rpcz_store.cc:276] 0709 13:06:53.263905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.521956 (+258051us) service_pool.cc:224] Handling call
0709 13:06:53.522518 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.523033 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.523073 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.523684 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.962892 (+1439208us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b18004296a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:55.140362 (+177470us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:55.166619 (+ 26257us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.193107 (+ 26488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.193825 (+   718us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.483422 (+289597us) raft_consensus.cc:1685] finished
0709 13:06:55.490699 (+  7277us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.521781 (+ 31082us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13860,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":62,"raft.queue_time_us":198,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":8896,"spinlock_wait_cycles":18409216,"thread_start_us":103400,"threads_started":1,"wal-append.queue_time_us":1638406}
I20260709 13:06:55.554050 21028 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:55.580814 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.579072 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.583093 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.584002 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.586160 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.508966 21048 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.587508 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.588495 15587 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:55.588557 15584 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:55.595988 21125 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:55.598388 21125 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:55.608596 21121 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 13:06:55.608932 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.610255 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.610509 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.611443 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.588451 20938 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.614084 20938 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:55.617585 20994 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:55.619805 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.610526 20661 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:06:55.600760 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.624362 20661 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:55.624897 20661 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:55.610337 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.626019 20661 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:55.626713 21123 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 13:06:55.626865 15434 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 17: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:55.627522 20661 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:55.627935 21122 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
I20260709 13:06:55.636166 21048 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.637924 15556 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:55.639000 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:55.639937 20966 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:55.640029 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:55.640429 20966 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:55.608345 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.647020 15516 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
W20260709 13:06:55.604357 20859 consensus_meta.cc:287] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.572s	user 0.014s	sys 0.001s
I20260709 13:06:55.598627 20878 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:06:55.602110 20996 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.663570 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:55.671774 15511 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.659736 15406 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:55.677943 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.678848 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.640861 20966 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:55.679476 15591 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:55.606726 21125 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:55.684396 15587 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:06:55.648699 21046 raft_consensus.cc:2764] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:06:55.629027 21042 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:55.699470 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.675266 20706 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:55.709085 15442 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:55.703022 15341 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.622604 21010 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:06:55.712700 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.714066 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.606235 21028 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.696549 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.721833 15341 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.726764 15441 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
W20260709 13:06:55.736568 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 96642.2us
I20260709 13:06:55.737490 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:55.738615 15439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:55.739456 15439 raft_consensus.cc:606] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:55.739792 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:55.736646 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.694617 20829 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:55.671962 20859 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:55.744710 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:55.709559 20706 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:55.676260 20994 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:06:55.752830 15341 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 13 to 16, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.743176 15584 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:55.761871 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:55.759827 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:55.756273 20706 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.786105 15341 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 10 to 14, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:06:55.787940 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 93042.1us
W20260709 13:06:55.798234 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 159307us
W20260709 13:06:55.799454 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106969us
I20260709 13:06:55.805523 15439 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 18: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:55.805878 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:55.806744 16174 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:55.809491 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:55.817572 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:55.817986 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.779445 20901 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.820711 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:55.800207 20484 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:55.841565 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:55.844897 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:55.853334 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 54241.9us
I20260709 13:06:55.854471 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:55.856516 15585 raft_consensus.cc:2393] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:06:55.859750 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 99858.1us
I20260709 13:06:55.837419 20974 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:55.835285 21141 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:06:55.885953 21139 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:55.886159 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:55.887136 15509 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:55.887678 20829 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.891822 21135 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:55.892436 21135 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:55.892844 21135 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:55.896586 20452 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.897094 20452 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:55.897464 20452 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.898854 21140 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:55.899356 21140 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:55.900431 21140 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.901991 21140 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:55.904500 20859 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:55.920328 15511 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:55.856227 20484 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:55.951866 16174 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
W20260709 13:06:55.908710 20738 consensus_meta.cc:287] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.766s	user 0.015s	sys 0.001s
I20260709 13:06:55.844384 21079 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:55.866820 20901 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:55.877175 21141 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:55.877000 20996 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:06:55.997546 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 143191us
W20260709 13:06:55.999432 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 133902us
W20260709 13:06:56.105031 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.113236 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 373509us
W20260709 13:06:56.101832 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 153632us
I20260709 13:06:56.117708 15438 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:56.122197 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.095917 20738 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:56.126405 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.126924 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.127251 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.129056 15442 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:56.130215 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 374592us
I20260709 13:06:56.133407 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.134747 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.138705 15441 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 19: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:56.147123 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.152743 15439 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:56.138901 21075 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.972s	user 0.011s	sys 0.005s
W20260709 13:06:56.155158 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.156250 21148 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:56.156169 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.122416 21028 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.094055 20901 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.161971 21141 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.135625 20738 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:56.157109 21148 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:56.171307 15438 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 9: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:56.174139 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.192584 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:56.194708 15435 raft_consensus.cc:606] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:56.194859 15440 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 19: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:56.195174 15435 raft_consensus.cc:614] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:56.204193 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:56.215095 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59114.2us
I20260709 13:06:56.111759 21010 consensus_queue.cc:1243] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:56.221985 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.196915 20738 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:56.135936 21149 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:06:56.155184 21075 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.202270 21148 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.231149 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:56.226352 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 55853.3us
W20260709 13:06:56.250449 21134 log.cc:927] Time spent T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
W20260709 13:06:56.251425 21132 log.cc:927] Time spent T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.293s	user 0.000s	sys 0.000s
I20260709 13:06:56.251745 21142 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:56.252563 21144 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:06:56.252900 21130 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:06:56.253248 21144 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:56.254724 21160 log.cc:927] Time spent T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:06:56.255903 16177 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:56.171661 20484 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.248380 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:56.233433 21028 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.258694 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.230959 20779 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.263338 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:56.266608 21125 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.003s
I20260709 13:06:56.264598 21141 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:56.289090 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:56.295496 15407 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:56.271696 16146 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 2.241s (SENT) [suppressed 10 similar messages]
I20260709 13:06:56.269856 21079 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.326102 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:56.326946 15440 raft_consensus.cc:606] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:56.297005 21136 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:06:56.335602 20779 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:56.347363 21154 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.349917 21154 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.349227 20779 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:56.352191 20779 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.291659 20661 consensus_queue.cc:1059] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 13:06:56.356371 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 61023.5us
I20260709 13:06:56.357144 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:56.357843 15435 raft_consensus.cc:606] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:56.358201 15435 raft_consensus.cc:614] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:56.359417 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.300251 21028 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.274466 21145 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:56.295203 21135 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.363022 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:56.308836 21048 consensus_meta.cc:287] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.007s
I20260709 13:06:56.307685 21125 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.344574 20901 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:56.360306 21158 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.279392 20948 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:56.368166 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:56.369324 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:56.369997 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:56.372897 20966 consensus_meta.cc:287] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.651s	user 0.018s	sys 0.002s
I20260709 13:06:56.287957 21149 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:06:56.293159 21075 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:56.356731 20661 consensus_queue.cc:1243] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:56.360854 21028 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.395373 21158 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.397922 21028 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:56.377672 21135 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:56.377889 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:56.398741 21158 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.378366 21048 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:56.401897 21048 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.402737 21125 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.404721 21048 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.404837 15443 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:56.405390 21048 raft_consensus.cc:2764] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:56.406802 21149 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:56.410146 15512 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:56.411404 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.412825 20878 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:56.413337 20878 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:56.413457 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.414265 15516 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:56.414399 20878 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.415233 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.415999 15513 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 15: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:56.418267 21156 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:06:56.407377 21149 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:56.420430 21137 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:06:56.421010 20994 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:06:56.422112 21143 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 13:06:56.412932 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.423808 15509 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
W20260709 13:06:56.425869 21155 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.216s	user 0.000s	sys 0.002s
I20260709 13:06:56.378715 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:56.428969 21144 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:56.395254 20948 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:56.394037 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:56.430855 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.434834 15440 raft_consensus.cc:2393] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:56.431761 21133 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.600s	user 0.002s	sys 0.000s
I20260709 13:06:56.431905 20948 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.433555 15434 raft_consensus.cc:606] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:56.421200 21149 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.443472 15434 raft_consensus.cc:614] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:56.429298 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:56.448508 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:56.450560 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 103891us
I20260709 13:06:56.449816 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.452859 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.433897 20878 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.448238 21046 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:56.472033 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:56.445477 21154 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.456584 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:56.474449 15516 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:56.474257 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:56.475067 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.475814 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:56.482829 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.394918 20966 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:56.484242 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.480572 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:56.484134 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:56.487288 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:56.490237 21145 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:56.493132 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.477810 21144 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:56.495682 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 247388us
I20260709 13:06:56.482766 21149 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:56.509176 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 60437us
I20260709 13:06:56.488271 21152 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:56.495823 16177 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
W20260709 13:06:56.490345 20706 consensus_meta.cc:287] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.010s
I20260709 13:06:56.486306 21046 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:56.516542 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.522713 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.512054 21152 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:56.554159 21152 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:56.524217 20901 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.519270 20706 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.568746 20966 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:56.569989 20706 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.571808 15586 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:56.572374 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44737.1us
I20260709 13:06:56.574244 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.509049 21144 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.575801 20829 consensus_queue.cc:1059] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:56.576128 21029 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:56.576965 21029 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:56.577189 20829 raft_consensus.cc:3055] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:56.577651 20829 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:56.577713 21144 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:56.578078 20994 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:56.529340 20738 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.578680 20829 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.544296 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.580668 20738 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:56.580856 15510 raft_consensus.cc:2410] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:56.545871 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.581283 20738 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.546491 21048 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.581549 21148 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:56.543104 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.528249 15513 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:06:56.548069 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.547102 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:56.515475 20452 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.010s
I20260709 13:06:56.548908 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.546741 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:56.546591 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.578622 20994 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:56.546641 21026 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.548859 21010 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:56.579852 15407 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.519917 21042 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:56.590662 15512 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:56.581883 20738 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:56.593109 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46480.5us
I20260709 13:06:56.594436 15509 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:56.597034 20994 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.603916 15516 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:56.582388 21048 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.607389 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.607863 20994 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:56.608153 21048 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:56.608400 15515 raft_consensus.cc:2368] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13.
I20260709 13:06:56.608775 21048 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.609535 15518 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:56.609295 21048 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:56.568814 21079 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:56.614339 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.614338 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.591147 21010 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:56.622524 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 135308us
I20260709 13:06:56.601697 20996 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:56.626931 15439 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:56.597713 21042 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.630008 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:56.632647 21042 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.589972 21166 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:06:56.636354 21166 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:56.636783 21166 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:56.637310 20738 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:56.611496 21048 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:06:56.637735 21166 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.609318 20706 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:56.644994 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.618449 21079 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:56.590492 20452 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.592796 21026 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.639382 21166 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.653599 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.647053 15406 leader_election.cc:400] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13.
I20260709 13:06:56.663236 15406 leader_election.cc:403] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:06:56.657681 15513 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:56.645769 15555 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.607s (SENT)
I20260709 13:06:56.635288 21148 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:56.664645 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:56.650730 21159 raft_consensus.cc:993] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:06:56.665617 15510 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:56.635314 20829 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:56.629864 20996 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.672434 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.677230 20452 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.678133 15585 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:56.680920 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:56.682129 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.681274 15407 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.684976 15510 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:56.648624 21028 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:56.661831 21145 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:56.650317 21010 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.693276 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:56.693900 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:56.694144 21010 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:56.694717 16176 raft_consensus.cc:2393] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:06:56.696049 21145 consensus_queue.cc:1175] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" responder_term: 16 status { last_received { term: 15 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:56.698100 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.699110 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.699462 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.699904 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.699956 21079 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.700783 15518 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:56.701360 21079 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:56.700093 15512 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
W20260709 13:06:56.705626 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61371.5us
I20260709 13:06:56.706905 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.700047 21069 consensus_queue.cc:1059] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:06:56.714865 20706 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:56.721035 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.683179 20996 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:56.649279 20779 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.711280 21153 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:56.727921 21146 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:56.652374 21152 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.731848 21026 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:56.741904 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.740586 21146 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:56.751461 15437 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:56.767242 21026 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.740228 21158 raft_consensus.cc:1081] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:06:56.728670 20452 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:56.755509 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:56.755944 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.769851 15443 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:56.759310 15585 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:56.767977 21026 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.772362 21168 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:56.773138 21026 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:56.773809 21069 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:56.760761 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:56.774238 21069 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:06:56.774628 15439 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:56.761894 15434 raft_consensus.cc:1217] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Deduplicated request from leader. Original: 17.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:06:56.775692 15434 raft_consensus.cc:1240] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:06:56.775336 21069 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.730428 21159 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:56.671748 21046 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.776494 21069 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:56.778036 21152 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:56.780313 15441 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:56.768329 21146 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.787688 15512 raft_consensus.cc:2368] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20.
I20260709 13:06:56.788039 21146 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:56.764518 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57928.5us
I20260709 13:06:56.796447 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:56.807817 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:56.808283 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 162579us
I20260709 13:06:56.808169 15556 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:56.809402 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:56.808703 15510 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:56.813041 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:56.813866 20878 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:56.814440 20878 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.814867 20878 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:56.816063 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.816584 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.816816 15509 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:56.817617 21042 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:56.817437 21181 consensus_queue.cc:1059] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:56.818037 21042 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:56.818466 21181 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:56.818763 21148 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:56.818859 21181 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:56.829461 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.818476 21042 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.830508 15517 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:56.831457 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.832618 21180 raft_consensus.cc:3055] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:56.833081 21180 raft_consensus.cc:740] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:56.819372 21181 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.836128 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.837054 15510 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:56.837714 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:56.849725 15512 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:56.824177 20452 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:56.819411 21148 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:56.825307 20484 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:56.854401 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 133426us
W20260709 13:06:56.856459 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.860065 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 43588.1us
I20260709 13:06:56.864131 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.869493 21151 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:56.870255 21151 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.872836 21151 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.876713 21148 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:06:56.863397 21180 consensus_queue.cc:260] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.867969 20452 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:56.882830 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.883037 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:56.884469 21048 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:56.885242 21048 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:56.887655 20829 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:56.889034 21026 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:56.889509 21026 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:56.890354 16145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.890419 21026 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.863958 20706 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13.
I20260709 13:06:56.897110 20779 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:56.880645 20452 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.902236 21048 consensus_queue.cc:1059] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:56.879417 21180 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:56.906291 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 96163.7us
I20260709 13:06:56.881206 20996 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:56.913389 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49420.5us
I20260709 13:06:56.915791 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.923115 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:06:56.929316 21184 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 13:06:56.933264 21042 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:56.934886 15511 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:56.936630 21146 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:56.941159 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:56.932193 21026 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:56.925316 21046 raft_consensus.cc:3055] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:56.945202 20484 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:56.951947 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.960979 21181 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:56.965127 21042 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:56.965387 20878 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:56.968149 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.945858 20779 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.974895 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:56.977705 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.985423 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.990809 15441 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:06:56.995889 15556 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:06:57.005398 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 118320us
W20260709 13:06:57.008320 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.947219 21046 raft_consensus.cc:740] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:06:57.011190 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59713.5us
I20260709 13:06:57.012410 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.012041 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:57.014889 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.016211 16176 raft_consensus.cc:2393] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:57.019876 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.014393 21042 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:57.018131 20484 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:57.034307 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:57.035132 15513 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:57.040088 21190 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:57.030311 20829 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:57.044097 20829 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:57.043915 21046 consensus_queue.cc:260] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.045596 21046 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.045323 20829 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.053561 21146 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:57.056607 20878 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:57.058450 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.059304 15439 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.059846 20996 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:57.032589 21181 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:57.064899 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:57.033890 21042 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:57.068259 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:57.070295 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.071513 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:57.071588 15587 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:57.072947 15439 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:57.073071 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.076599 15556 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:57.069748 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:57.078142 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 66081.4us
I20260709 13:06:57.079144 15586 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:06:57.079571 15586 pending_rounds.cc:85] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 8
I20260709 13:06:57.079792 15586 pending_rounds.cc:107] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:06:57.080044 15586 raft_consensus.cc:2889] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.080312 15585 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:57.081779 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.083263 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:57.087090 15587 raft_consensus.cc:2410] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:06:57.086935 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:57.088035 15591 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:57.084280 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.093248 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:57.094166 16178 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:06:57.094624 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.095170 15584 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:06:57.095464 15592 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:57.097820 21146 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:57.097303 21042 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:57.101214 16177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:57.103773 16173 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:57.109576 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:57.095531 15584 pending_rounds.cc:85] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 11
I20260709 13:06:57.111024 15584 pending_rounds.cc:107] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:06:57.111327 15584 raft_consensus.cc:2889] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.118129 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:06:57.119180 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.937s (SENT)
I20260709 13:06:57.119719 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.119872 21026 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:57.119786 21180 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:57.120580 21157 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:57.120923 21180 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:57.121309 21180 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:57.122728 21180 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.122025 16178 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:57.128134 16173 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.110810 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.128873 15587 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:06:57.129411 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.088483 20878 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:57.137203 20878 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.138674 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:57.139287 15592 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:57.142570 21180 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:57.143893 15586 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:57.143971 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:57.145471 16176 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:06:57.151162 15592 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:06:57.161108 21181 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:57.162506 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:57.088905 20452 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:57.168880 20878 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:57.169081 16176 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 15: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:57.169476 20452 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:57.171972 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:57.164104 21190 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:57.171670 20452 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.175138 15513 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:57.184897 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:57.175134 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:57.185526 15591 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:06:57.187511 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:57.202389 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:57.203099 15584 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.203826 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.204643 15439 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:57.205657 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:57.207325 15589 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:57.217773 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.222333 15585 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:57.196246 15592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:06:57.187335 21151 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:57.225513 21157 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.227699 21148 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:57.235266 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.236107 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.236564 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.237337 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.238301 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.239816 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.275055 15587 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:06:57.275810 15434 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:57.240005 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.241267 20779 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:57.242851 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.244467 15585 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:57.278389 15436 raft_consensus.cc:2393] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 14: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:57.274255 15440 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:57.239295 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.236157 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.262400 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.264446 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:57.281466 15443 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:57.268477 15584 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:06:57.281883 15589 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:57.207110 21190 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:57.278438 15442 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:57.284736 15435 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:06:57.277287 20779 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:57.294847 15407 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.303643 20484 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:57.310688 15437 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:57.278477 21151 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:57.313657 21151 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.283753 21190 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.316571 21190 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.323668 20779 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:57.327276 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:57.333282 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.334760 21152 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:57.335227 21152 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.335623 21152 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.342298 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.344357 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:57.345158 16176 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.345669 16176 raft_consensus.cc:2393] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:06:57.348078 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.336757 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:06:57.357553 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.301151 21140 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:57.360612 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.362087 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.366762 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:06:57.362910 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 102772us
I20260709 13:06:57.367444 16173 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.368021 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.371977 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.359475 21010 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.350240 20829 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:06:57.356632 20779 consensus_queue.cc:1059] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:06:57.393703 20779 raft_consensus.cc:3055] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:57.394264 20779 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:57.284449 21148 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.397898 21148 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:57.398537 21125 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:57.388134 15518 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:57.364468 21028 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:57.280288 21157 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.397933 15436 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:57.397936 15592 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:57.427698 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:57.428208 15592 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:57.411300 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.370677 21153 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:57.441254 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.442716 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.420792 21148 consensus_queue.cc:1059] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:57.391402 21010 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:57.437920 15518 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:57.444310 20878 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:57.458847 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.444792 21028 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:57.444798 15435 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:57.463840 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.395450 20779 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:57.466674 20779 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.446856 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.447643 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.464815 15436 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:57.475119 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.475816 15436 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:57.473752 15592 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.477605 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:06:57.481922 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.483619 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.484282 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.501194 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:57.509385 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.457556 20996 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:06:57.490188 20706 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:57.472640 21158 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:06:57.484454 21079 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:57.498054 21153 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:06:57.509591 20878 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:57.513131 21026 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:57.565327 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.563297 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 53937.7us
I20260709 13:06:57.574467 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.543452 21159 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:06:57.559230 21026 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:57.563993 21048 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:57.598512 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.599300 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.600167 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.603036 15591 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:06:57.607758 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.616195 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.620463 15592 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:57.626209 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:57.626955 15585 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 9.
I20260709 13:06:57.624878 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:57.634497 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.636299 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:57.647893 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.518669 21028 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:57.603824 21026 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:57.655309 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 167690us
W20260709 13:06:57.654778 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 166468us
I20260709 13:06:57.621002 21194 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.664023 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:57.660987 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 218353us
I20260709 13:06:57.661806 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.628739 20829 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:57.657843 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.592037 20878 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:06:57.665437 15435 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:06:57.662053 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.632838 21046 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:57.666529 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.669600 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.685763 15589 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:57.685063 15436 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:57.670445 16173 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:06:57.686595 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.656644 21048 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:57.654476 21193 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:57.687472 15439 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:57.689242 15556 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:57.686415 15436 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:57.690333 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.659651 21181 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:57.662937 21206 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.627445 21152 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:57.704103 21046 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.665966 21010 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:57.684341 20706 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:06:57.671430 20484 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:57.712208 21010 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:57.713271 21010 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.713682 21010 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:57.713981 21079 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:57.715752 21079 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:57.721019 15437 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:06:57.722084 21212 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:06:57.722643 21010 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.725395 21010 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:57.656284 21180 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:06:57.740787 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 83249us
I20260709 13:06:57.742247 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.705206 15436 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.751341 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.753865 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:57.757660 21180 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:57.738047 21206 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:57.791635 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 125164us
I20260709 13:06:57.747220 21190 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.795849 15407 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.796629 21152 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:57.797322 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:57.797895 21152 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:57.798439 21152 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:57.798882 21206 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:57.760259 21215 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:57.799515 21157 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:57.799909 21215 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.800356 21215 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:57.801352 21159 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:57.796444 21125 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:57.759840 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:57.790011 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 125134us
I20260709 13:06:57.798324 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:57.759469 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69259.5us
I20260709 13:06:57.814139 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:57.817289 15518 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:57.790397 21140 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:57.791965 21210 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:57.782724 21202 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:06:57.757041 21181 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:57.823184 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 63415us
I20260709 13:06:57.808236 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:57.824215 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.825178 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:57.826252 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.826983 21180 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:57.827951 21190 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:57.831833 21157 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:57.832365 21157 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:57.832574 15407 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.833763 21135 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:57.835940 21151 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:57.836479 21151 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:06:57.837108 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1915fdd81d344a749443e48f07a1fef8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:57.837468 21151 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.840981 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.841645 15439 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:57.843418 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:57.832770 21157 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.845778 15441 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:06:57.849223 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.844311 15440 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:06:57.844226 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:57.864063 15438 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:57.865674 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.866442 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:57.876027 15439 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:06:57.876350 15591 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:57.878098 21042 raft_consensus.cc:3055] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:57.878736 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:57.884349 20878 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:57.890488 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.908332 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:57.909201 16178 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:06:57.897872 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52190.8us
I20260709 13:06:57.915494 15555 leader_election.cc:400] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20.
I20260709 13:06:57.852795 21181 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:57.918416 21181 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:57.919382 15555 leader_election.cc:403] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:06:57.916472 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.917610 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.864931 20452 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:57.922694 21135 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:57.918936 15556 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:57.886511 21209 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:57.921662 21048 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:57.900246 21042 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:57.934854 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68003.9us
I20260709 13:06:57.867682 21214 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:57.938961 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:57.911283 21180 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:57.918923 21181 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:57.913677 21190 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:57.937534 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 103595us
I20260709 13:06:57.946748 21194 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:57.925369 20452 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.807227 21152 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:57.920346 21206 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:57.948066 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.945127 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:57.936899 21209 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.957813 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:57.961866 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.941210 20948 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:57.942200 21211 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20.
I20260709 13:06:57.963302 21209 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.954814 21046 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:57.957664 20452 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:57.977648 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:57.960479 21206 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.989646 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:57.963475 21075 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.992856 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:57.975567 21046 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:57.967163 21147 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:57.968616 21214 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.970562 21148 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:57.965896 21219 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:57.996308 20948 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.017561 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:57.993870 21206 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:58.004091 21046 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:58.031029 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 88113.2us
I20260709 13:06:58.019672 21166 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:58.038939 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 61372.9us
I20260709 13:06:58.042013 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:58.042996 21147 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:06:58.049252 21217 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:57.998472 20706 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:58.027850 21190 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:58.054458 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:58.035312 21148 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:58.027025 20948 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:58.025506 21214 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.056557 21226 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:58.059587 21190 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:58.002135 21042 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.022895 21135 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.071803 15442 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:06:58.074144 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:58.106775 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:58.108084 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 90589.3us
I20260709 13:06:58.115043 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:58.116288 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:06:58.121409 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47403.4us
I20260709 13:06:58.124069 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:58.140486 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.145771 15436 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:58.114898 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:58.091743 21226 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.151090 21224 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:58.151558 20996 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:58.151114 21226 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:58.153292 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 234411us
I20260709 13:06:58.155833 21231 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:58.151610 21224 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:58.091699 21042 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:58.091408 21190 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:58.075425 21069 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:58.084699 21079 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:58.166397 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:58.147114 21223 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:58.097044 21214 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:58.148960 21158 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.182937 15439 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:06:58.110711 21193 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:58.169867 21224 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:58.091317 21215 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.197180 21215 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.198120 21215 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:58.198756 21215 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:58.200217 21215 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:58.214066 15586 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:06:58.187000 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.080591 21147 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:06:58.117787 21157 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.216195 20484 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:58.217458 21157 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:58.105087 21026 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.220824 21026 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.221441 21026 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:58.223419 15583 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:58.222023 21026 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:58.227599 20484 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:58.228693 20484 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:58.229017 20484 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:58.229271 21026 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:58.229876 20484 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.231163 20484 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:58.232831 15511 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:06:58.236335 15583 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:06:58.238041 21219 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:58.241009 15513 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:58.242729 15513 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:58.180512 21152 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.263218 15513 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:58.184897 21233 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:58.193759 21194 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.088805 21148 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.332839 21193 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:58.341681 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 225476us
W20260709 13:06:58.337729 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 66112.3us
I20260709 13:06:58.347625 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:58.347908 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.264014 20948 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.350011 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.351526 15517 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:58.352919 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.245826 21158 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.359730 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.360210 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:58.367877 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.373665 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:58.274895 21152 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.330987 21209 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:58.355016 21242 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.375602 15517 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:58.453014 21238 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:06:58.453843 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.455428 21228 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.352378 21193 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.362054 20452 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:58.477535 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.518056 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.475909 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:58.470268 21240 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:06:58.524829 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.525791 15509 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:06:58.513427 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:06:58.480293 21239 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:06:58.518900 15514 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:06:58.522964 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:58.531490 15510 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:58.543133 15591 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:58.544518 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.518443 21208 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:58.549556 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.579906 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:58.561601 21209 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:58.519186 21228 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:58.564435 21227 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:58.567080 21048 consensus_meta.cc:287] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.003s
I20260709 13:06:58.569437 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:58.574252 20452 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:58.507022 21206 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.582309 15436 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:58.599170 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:58.599865 15509 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:58.596201 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:58.602824 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.607652 21048 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:58.598011 21227 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.608811 15513 raft_consensus.cc:2410] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:06:58.610386 21227 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:58.611929 21206 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:58.511045 21242 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.616654 15516 raft_consensus.cc:2410] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:06:58.616640 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:58.622803 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:58.625305 15592 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:06:58.625664 15556 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:58.628216 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:58.628948 15443 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:06:58.629946 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:06:58.596750 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.676s (SENT)
I20260709 13:06:58.629868 15517 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:06:58.630820 15436 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:58.630873 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:58.575470 21237 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.226s	user 0.004s	sys 0.000s
I20260709 13:06:58.623699 15590 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 11.
I20260709 13:06:58.630095 15556 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:58.585011 20484 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.576448 21193 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.640321 15436 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:06:58.582850 15510 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
W20260709 13:06:58.603235 21181 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.643s	user 0.004s	sys 0.005s
I20260709 13:06:58.642169 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:58.651950 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:58.652763 15439 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:58.648823 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 123422us
I20260709 13:06:58.654233 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:06:58.642854 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46150.3us
I20260709 13:06:58.654948 15584 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:58.637794 21180 consensus_meta.cc:287] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.683s	user 0.013s	sys 0.001s
I20260709 13:06:58.656164 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:58.656948 15592 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:58.656531 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:06:58.658064 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:58.658836 15514 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:58.647092 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:58.648317 15509 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
W20260709 13:06:58.676378 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.660717 15510 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:58.592728 21208 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.642231 21209 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:58.651765 21010 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:58.638020 21216 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:58.639593 21166 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.651656 21231 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:58.720237 15509 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:58.720152 16176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:58.720695 15510 raft_consensus.cc:1240] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:58.726454 15439 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:58.727097 16178 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:06:58.727747 15440 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:58.654102 21181 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.732234 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:58.729053 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:58.735855 15592 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:58.641270 21226 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.746001 15584 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:06:58.679567 21227 raft_consensus.cc:2764] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:58.773939 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:58.748935 21209 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:58.777006 15585 raft_consensus.cc:2393] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:58.777086 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:58.652143 20484 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:58.778898 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 46792.3us
I20260709 13:06:58.713554 21180 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:58.749132 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:58.744138 21216 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.801036 15512 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:58.787750 21079 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:58.746914 21250 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.718437 21252 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:58.729827 21010 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:58.795356 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:58.736254 21158 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:58.789053 21046 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.006s
I20260709 13:06:58.801514 15510 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:06:58.804600 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 55580.6us
I20260709 13:06:58.807907 15511 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:58.812145 21222 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:06:58.817826 21249 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:06:58.815162 21218 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:58.821152 21250 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.822232 21181 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.824235 20484 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.825649 20996 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.804381 21216 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:58.872507 20996 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.853621 21159 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:58.874971 21159 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:58.806087 21152 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.828186 21228 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:58.828840 21226 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.831887 21148 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:58.877352 21159 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:58.877713 21148 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:58.878944 21232 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:58.878717 21148 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:58.880926 21125 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:58.789237 21248 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.883394 21248 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.836504 15518 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
W20260709 13:06:58.890012 21190 consensus_meta.cc:287] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.006s
I20260709 13:06:58.886457 21248 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.890527 21190 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.865278 21135 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:06:58.891126 21216 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.892136 21135 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:58.892676 21135 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:58.893164 21250 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:58.858505 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 63224.6us
I20260709 13:06:58.893734 21135 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.859719 21252 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:58.895257 21252 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.864005 21180 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:58.898701 21069 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.001s
I20260709 13:06:58.898870 21180 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.899168 21069 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:58.861892 21194 consensus_meta.cc:287] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.003s
I20260709 13:06:58.867861 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:58.793351 21215 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:06:58.855695 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.833941 21209 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.879375 21232 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:58.894132 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:58.814702 21244 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.252s	user 0.000s	sys 0.003s
I20260709 13:06:58.944485 15591 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:58.980644 16176 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:58.981380 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 87336.3us
W20260709 13:06:58.982252 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.982632 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:58.982942 21152 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.983496 21152 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.983775 21250 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:58.983857 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:58.984392 21250 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.984697 15591 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:58.984779 21250 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:58.984951 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:58.985579 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:58.985759 21152 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.926115 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.986332 21152 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:58.925233 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.987799 15509 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:58.933180 16173 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:06:58.916724 15518 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:58.861621 15514 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:06:58.924365 15510 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:58.986820 21152 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.990650 15515 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
W20260709 13:06:58.941114 21253 log.cc:927] Time spent T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.388s	user 0.000s	sys 0.002s
W20260709 13:06:58.860379 21224 consensus_meta.cc:287] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 13:06:58.991897 21224 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.992594 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3272) took 1091 ms. Trace:
I20260709 13:06:58.986686 15513 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:06:58.993310 15437 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 11.
I20260709 13:06:58.994061 21224 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:58.994612 21194 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.993131 15587 rpcz_store.cc:276] 0709 13:06:57.901783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.901943 (+   160us) service_pool.cc:224] Handling call
0709 13:06:57.902360 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.902767 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.902796 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.903318 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.246339 (+343021us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b1800472180. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:06:58.359776 (+113437us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:58.402651 (+ 42875us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.403705 (+  1054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.403822 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.456186 (+ 52364us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b48001c0158. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf80c80aa1 00007fcf80c77b37 00007fcf80c779ca 00007fcf80d6f26f 00007fcf80d6ef37 00007fcf80d8355c 00007fcf80d83508 00007fcf80d83488 00007fcf80d83443 00007fcf80d826ec 00007fcf7fcaca96
0709 13:06:58.940138 (+483952us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:58.992392 (+ 52254us) raft_consensus.cc:1685] finished
0709 13:06:58.992414 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.992537 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16101,"prepare.run_cpu_time_us":7229,"prepare.run_wall_time_us":59958,"raft.queue_time_us":20042,"raft.run_cpu_time_us":2283,"raft.run_wall_time_us":56261,"spinlock_wait_cycles":157439488,"thread_start_us":113191,"threads_started":1,"wal-append.queue_time_us":613940}
I20260709 13:06:58.972035 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.903082 21208 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.997983 15511 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:06:58.908747 21242 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:58.944389 21251 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 13:06:58.862337 21046 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:58.901726 21254 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:06:58.983275 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:58.923977 21190 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:58.943158 21247 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.478s	user 0.003s	sys 0.000s
I20260709 13:06:58.837936 21079 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:58.914235 21241 log.cc:927] Time spent T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.343s	user 0.000s	sys 0.002s
I20260709 13:06:59.006584 21190 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:59.007401 15588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3275) took 1072 ms. Trace:
I20260709 13:06:59.008291 15588 rpcz_store.cc:276] 0709 13:06:57.934784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.935024 (+   240us) service_pool.cc:224] Handling call
0709 13:06:57.952121 (+ 17097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.037762 (+ 85641us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:58.056208 (+ 18446us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.366410 (+310202us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.366991 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.367148 (+   157us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:58.399241 (+ 32093us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.399586 (+   345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.399662 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.913457 (+513795us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:06:59.007019 (+ 93562us) raft_consensus.cc:1685] finished
0709 13:06:59.007042 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.007332 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17024,"prepare.queue_time_us":148685,"prepare.run_cpu_time_us":352,"prepare.run_wall_time_us":3223,"raft.queue_time_us":51830,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":40937,"spinlock_wait_cycles":33658752,"thread_start_us":359423,"threads_started":3,"wal-append.queue_time_us":473428}
I20260709 13:06:58.998346 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:59.012141 15587 raft_consensus.cc:2410] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:06:58.975744 15555 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.855s (SENT)
I20260709 13:06:59.012953 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:58.899290 21180 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.015115 15441 raft_consensus.cc:1240] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:59.016081 16176 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:59.000145 15337 catalog_manager.cc:5697] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.860849 21010 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:58.972424 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:59.020817 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:59.021538 15512 raft_consensus.cc:2410] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:06:59.021828 15441 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:06:59.022619 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:59.020208 15337 catalog_manager.cc:5697] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 11 to 14, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 14 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:59.023043 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47416.5us
I20260709 13:06:59.024914 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.024947 15337 catalog_manager.cc:5697] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.954245 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:58.740511 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:58.933391 21159 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.032949 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:59.035175 15511 raft_consensus.cc:3055] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:59.036098 15511 raft_consensus.cc:740] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:59.038861 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:59.039847 15439 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 12: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:58.912678 21220 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:06:58.920543 20996 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.945241 15590 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:59.041321 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:59.004024 15585 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:58.971585 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:58.996476 21232 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:58.992545 21152 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:59.067741 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:59.068691 15514 raft_consensus.cc:2410] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:06:58.957304 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:58.796692 21166 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:59.071184 21166 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:59.072172 16178 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:06:58.995404 15556 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:59.073890 21245 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:59.074009 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:59.074712 21245 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:06:59.076557 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 81227.9us
I20260709 13:06:58.895287 21135 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:59.077216 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:59.020663 21046 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:58.959391 15584 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:59.056878 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:59.051200 15337 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 14 to 18, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 18 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.057621 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:59.091322 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:58.986598 15591 raft_consensus.cc:2410] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:06:59.059763 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:59.060602 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:59.092902 15509 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:59.063881 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:59.064821 15516 raft_consensus.cc:2410] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:59.091992 15337 catalog_manager.cc:5697] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 14 to 16, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 16 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:59.094996 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:59.029399 21235 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:59.077963 15518 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:59.026361 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.079834 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:06:59.096972 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:59.099534 15512 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:06:59.066802 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:59.074916 15510 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:59.096335 15337 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.099309 15590 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:06:59.102244 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:59.036975 15511 consensus_queue.cc:260] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.106689 15511 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:59.104031 21140 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:59.108386 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:59.108989 21140 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.109213 15435 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:59.098006 21219 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:06:59.111639 21158 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 13:06:59.113446 21190 consensus_queue.cc:1175] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d225833a2cbf4a5995fdbbb1292d1918" responder_term: 10 status { last_received { term: 8 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:59.113729 20996 consensus_queue.cc:1059] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:59.114939 20996 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:59.115332 20996 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:59.116642 20996 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:59.118611 20996 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:59.120128 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 93876.4us
I20260709 13:06:59.122428 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:06:59.123129 15443 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:59.123685 21225 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:59.120141 21219 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:59.124147 21225 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.124351 21219 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:59.124576 21225 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.125352 21219 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.126674 21219 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:59.128099 21211 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:59.128966 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.130162 21211 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:59.131992 21245 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.132367 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.133445 21231 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:59.077361 21224 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:59.090301 21242 consensus_queue.cc:1059] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:06:59.140354 21153 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:59.098489 21250 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.141530 21152 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:59.142143 21152 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:59.143187 21152 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.037925 21159 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.109395 21140 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:59.103713 15337 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.105562 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:06:59.151456 15592 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:06:59.149809 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.094570 21215 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:59.158463 15509 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
W20260709 13:06:59.162700 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 66384.9us
I20260709 13:06:59.146603 21232 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:59.107409 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 386171us
I20260709 13:06:59.163899 15337 catalog_manager.cc:5697] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.185070 15435 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:06:59.183321 15337 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 9 to 10, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 10 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:59.189572 15510 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:06:59.098244 21248 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:06:59.105500 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:59.170645 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:06:59.203575 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 98123.8us
I20260709 13:06:59.171931 20706 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:59.087647 21208 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:06:59.143433 21250 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:06:59.147775 21194 consensus_queue.cc:1175] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" responder_term: 19 status { last_received { term: 19 index: 12 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:59.201947 15591 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:06:59.204221 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:59.162693 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57254.2us
I20260709 13:06:58.893325 21216 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:59.272672 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:59.191437 15337 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 6 to 7, term changed from 5 to 6, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to <none>, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 6 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:06:59.207614 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:59.273331 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:59.208649 21209 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:59.173820 21152 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:59.193295 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:59.208652 21046 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:59.213423 21159 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:59.171350 21235 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:06:59.173672 21211 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.221208 16146 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.245453 20706 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.203755 20484 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:06:59.192847 21042 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.275364 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 86066.3us
W20260709 13:06:59.275487 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 71372.9us
I20260709 13:06:59.293308 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:59.283331 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 62257.7us
I20260709 13:06:59.180500 21215 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:59.274785 21209 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:06:59.279301 15337 catalog_manager.cc:5697] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.301399 16178 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:06:59.283869 15511 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:59.278432 21250 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:59.278642 21214 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:59.282902 21206 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:59.302448 15337 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.278430 21046 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.310899 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:06:59.322105 15341 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 210) took 24091 ms (client timeout 15000 ms). Trace:
I20260709 13:06:59.316164 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:06:59.319471 15337 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.287600 20706 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:59.322929 15439 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
I20260709 13:06:59.314575 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:06:59.287631 21270 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:59.358505 16176 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:59.377405 16178 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:06:59.379053 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:06:59.386124 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.305915 21208 consensus_queue.cc:1243] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:59.307696 21209 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:59.390276 21270 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.342383 21231 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.119s
I20260709 13:06:59.441582 21270 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:59.372474 21180 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:06:59.427063 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.363225 21226 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:06:59.445544 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:06:59.348299 21250 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:06:59.343420 21223 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:06:59.341840 21227 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:06:59.448964 21250 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.433864 21148 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:59.397537 21248 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:06:59.341511 21046 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:59.370458 21225 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:59.459044 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:59.448012 21180 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:06:59.322166 21224 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:59.318288 21260 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.342988 21220 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:59.293869 21042 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.474517 16173 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
W20260709 13:06:59.474769 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 269767us
W20260709 13:06:59.322629 15341 rpcz_store.cc:269] 0709 13:06:35.217568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.218061 (+   493us) service_pool.cc:224] Handling call
0709 13:06:35.612922 (+394861us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5400002490. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c33640 00007fcf81b0ab76 00007fcf81c14c3e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:06:59.308563 (+23695641us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:56.440897 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:56.442239 (+  1342us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:56.442294 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:06:56.442313 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:56.626594 (+184281us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:56.639647 (+ 13053us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:56.639690 (+    43us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:06:56.641182 (+  1492us) tablet.cc:701] Row locks acquired
0709 13:06:56.641235 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:06:56.641451 (+   216us) write_op.cc:270] Start()
0709 13:06:56.641658 (+   207us) write_op.cc:276] Timestamp: P: 1783602416641367 usec, L: 0
0709 13:06:56.641700 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:06:56.646239 (+  4539us) log.cc:844] Serialized 5194 byte log entry
0709 13:06:57.055809 (+409570us) op_driver.cc:464] REPLICATION: finished
0709 13:06:57.420678 (+364869us) write_op.cc:301] APPLY: starting
0709 13:06:57.420806 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:57.790933 (+370127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:57.791126 (+   193us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:57.858859 (+ 67733us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:57.859447 (+   588us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:06:57.859522 (+    75us) write_op.cc:312] APPLY: finished
0709 13:06:57.926814 (+ 67292us) log.cc:844] Serialized 121 byte log entry
0709 13:06:57.927056 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:57.927249 (+   193us) write_op.cc:454] Released schema lock
0709 13:06:57.927328 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:57.927856 (+   528us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:57.927891 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":277303,"reported_tablets":52,"spinlock_wait_cycles":4448000,"child_traces":[["op",{"apply.queue_time_us":364501,"apply.run_cpu_time_us":25211,"apply.run_wall_time_us":507183,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":537189,"prepare.run_cpu_time_us":13496,"prepare.run_wall_time_us":245978,"raft.queue_time_us":124652,"raft.run_cpu_time_us":96597,"raft.run_wall_time_us":215519,"replication_time_us":413896,"thread_start_us":506614,"threads_started":4,"wal-append.queue_time_us":83374,"wal-append.run_cpu_time_us":28274,"wal-append.run_wall_time_us":2198434}]]}
I20260709 13:06:59.475220 21151 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:06:59.524900 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 210435us
I20260709 13:06:59.524631 15592 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:06:59.529057 20484 raft_consensus.cc:3055] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:59.529593 20484 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:59.530625 20484 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.532179 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:06:59.538045 21282 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:06:59.549727 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 277138us
I20260709 13:06:59.544365 21214 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.506299 21220 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:06:59.522360 21206 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:06:59.526464 21151 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:06:59.543368 21148 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:06:59.634895 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.639206 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:59.512492 21260 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:59.639933 15437 raft_consensus.cc:606] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.650995 15437 raft_consensus.cc:614] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:59.653738 21272 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:06:59.655717 21278 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:06:59.664300 21231 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:59.664938 21231 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.666250 21042 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:59.668671 20878 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:59.668946 21216 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:59.669368 20878 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.669569 21216 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:59.561363 21220 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:59.671753 21146 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.553928 21214 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:59.667244 21231 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:06:59.680678 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 359672us
I20260709 13:06:59.558849 21125 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:59.619251 20484 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:59.552538 21282 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.693813 15555 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:06:59.694020 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.694610 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.675889 21277 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:06:59.702939 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:59.672430 21146 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:06:59.713507 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 186497us
I20260709 13:06:59.525262 21215 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.686352 21214 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:59.691560 21219 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.004s
I20260709 13:06:59.744328 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:59.770537 15437 raft_consensus.cc:606] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.714470 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:06:59.747614 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 53825.2us
I20260709 13:06:59.772011 15437 raft_consensus.cc:614] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:59.649609 21148 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:06:59.745327 21140 consensus_meta.cc:287] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
W20260709 13:06:59.715656 20996 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.007s
I20260709 13:06:59.747206 21153 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:06:59.732426 21151 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.782570 21151 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:59.782161 21140 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.784870 21140 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:06:59.787041 21216 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:59.746938 21223 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:59.746529 20878 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:06:59.743906 21194 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:06:59.731815 21283 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:06:59.805442 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:06:59.777626 21280 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:06:59.807220 15437 raft_consensus.cc:606] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:06:59.811002 15437 raft_consensus.cc:614] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:59.715034 21190 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:59.715849 21231 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
W20260709 13:06:59.829334 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 267791us
I20260709 13:06:59.836197 15406 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:59.769493 21206 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.847218 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:59.849550 15482 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:06:59.828487 21151 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.827195 21225 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:06:59.857012 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:06:59.826579 21190 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:06:59.855324 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:06:59.692226 21125 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:06:59.864404 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:06:59.865134 21190 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:59.880434 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:06:59.881255 16174 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.846324 21194 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.865758 21151 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:06:59.919445 21295 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 13:06:59.974403 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 260023us
W20260709 13:06:59.948558 21276 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
I20260709 13:06:59.882579 21285 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.171s
I20260709 13:06:59.860109 21219 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:00.087929 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.088800 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:00.110459 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 405109us
I20260709 13:06:59.859557 21226 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.115419 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82533161d7894b3db9b0230e076936b2"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:00.117528 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.118884 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.119784 15436 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:00.178965 15441 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:06:59.850492 21180 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.128995 15435 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:00.186133 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:00.187147 15435 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.925637 21046 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.127252 16174 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:00.148114 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:00.143790 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 276275us
W20260709 13:07:00.197571 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.156023 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.198026 15438 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:00.161305 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.162328 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.178979 15443 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:00.199265 15587 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:00.169703 15512 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.170956 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:00.097880 21279 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:00.193238 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:00.201232 15586 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.202649 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:00.136302 21042 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:00.128136 21227 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:00.137341 20452 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:00.228893 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:00.167446 21270 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.725s	user 0.023s	sys 0.008s
I20260709 13:07:00.150772 21287 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:00.165817 21290 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.234321 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.235863 15443 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:00.177255 21260 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.244331 15435 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:00.193213 21250 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.204034 21248 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.203706 21146 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:00.260159 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 89857.1us
W20260709 13:07:00.240665 21208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.013s	sys 0.021s
W20260709 13:07:00.262893 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 60345.7us
I20260709 13:07:00.268918 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.221114 21219 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:00.228053 21299 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:00.234062 21282 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.257519 21159 raft_consensus.cc:2764] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:00.226657 21283 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.057s
I20260709 13:07:00.255888 21287 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.258836 21290 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:00.340943 21209 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.899s	user 0.012s	sys 0.006s
I20260709 13:07:00.237968 21270 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.353519 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:00.328739 21276 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:07:00.368155 21140 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:00.369845 21140 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:00.370748 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 654) took 1355 ms. Trace:
I20260709 13:07:00.361503 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:07:00.371179 21232 consensus_meta.cc:287] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.174s	user 0.017s	sys 0.000s
I20260709 13:07:00.235052 21227 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:00.356710 21273 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.794s	user 0.000s	sys 0.004s
I20260709 13:07:00.372272 15513 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:07:00.373423 21152 consensus_meta.cc:287] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.088s	user 0.013s	sys 0.000s
I20260709 13:07:00.370795 21140 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:00.374828 21214 consensus_meta.cc:287] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.001s
W20260709 13:07:00.375360 21220 consensus_meta.cc:287] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.000s
I20260709 13:07:00.233620 21042 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.267093 21223 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.369053 21209 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.366394 21216 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.378340 21042 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:00.323906 21219 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.379637 21209 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:00.380366 21225 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:00.380628 15591 raft_consensus.cc:2410] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:07:00.380982 21225 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:07:00.375589 21135 consensus_meta.cc:287] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.259s	user 0.017s	sys 0.000s
I20260709 13:07:00.241292 20452 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.413164 15442 raft_consensus.cc:2410] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:00.413590 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:00.376088 21220 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:00.276377 21208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.013s	sys 0.022s
I20260709 13:07:00.417026 16182 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:00.417578 21220 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.375159 21140 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:00.384141 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:00.419014 15509 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:00.384907 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:00.388083 15512 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:00.257925 21269 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.420843 21269 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.423174 21269 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.377538 21304 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.371260 15440 rpcz_store.cc:276] 0709 13:06:59.015519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.015689 (+   170us) service_pool.cc:224] Handling call
0709 13:06:59.016016 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.017758 (+  1742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.017804 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.020344 (+  2540us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.288999 (+268655us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:59.349258 (+ 60259us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.540525 (+191267us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b18002eaf80. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd61716 00007fcf7bd72287 00007fcf7bd72208
0709 13:06:59.740243 (+199718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.740355 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.370382 (+630027us) raft_consensus.cc:1685] finished
0709 13:07:00.370488 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.370680 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13775,"prepare.queue_time_us":57545,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":188473,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":3627,"spinlock_wait_cycles":70078848,"thread_start_us":464695,"threads_started":2,"wal-append.queue_time_us":488284}
I20260709 13:07:00.268193 21250 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.401867 21292 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:00.368391 20706 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 1.009s	user 0.018s	sys 0.000s
I20260709 13:07:00.411381 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:00.399019 15586 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:00.434569 16175 raft_consensus.cc:2393] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 6: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:00.434432 15436 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
W20260709 13:07:00.359253 20484 consensus_meta.cc:287] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.005s
I20260709 13:07:00.435045 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.424602 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.357785 21046 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:00.356601 21010 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.327s	user 0.012s	sys 0.008s
W20260709 13:07:00.429314 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44646.7us
I20260709 13:07:00.402755 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:00.430655 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.359958 21079 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.378396 21148 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:00.274035 21248 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:00.481989 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 58140.7us
I20260709 13:07:00.482285 15511 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:00.375474 21290 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.375288 21214 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.373582 21227 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:00.381809 21125 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.378402 21216 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.481228 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:00.522658 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.436615 21308 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.441391 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.523748 15591 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:00.487886 15406 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:00.441720 15437 raft_consensus.cc:606] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:00.488911 21219 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.521876 15556 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:00.530304 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:00.530779 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:00.532053 15512 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 20: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:00.495924 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.503819 21046 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.438526 21292 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.438360 20706 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.480341 21010 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.506810 20452 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:00.507835 21270 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.435324 21284 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.508961 21250 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.423863 21304 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.511963 21151 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.346634 21299 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.514932 21248 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.517585 21148 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:00.523067 15443 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:00.471357 21232 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.523870 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:00.503327 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:00.664772 15589 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:00.524554 15437 raft_consensus.cc:614] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:00.489574 21298 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.491743 21079 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:00.582559 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:00.652727 21219 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:00.594166 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 72141.8us
I20260709 13:07:00.595861 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:00.596434 21230 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:00.597813 21285 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:00.600590 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.604354 21042 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:00.594528 21180 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:00.503826 21194 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.495047 21225 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.583503 21209 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:00.580961 21308 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.605860 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:00.693670 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 87874.2us
I20260709 13:07:00.612128 21216 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:00.612349 21286 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:00.618898 21297 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.472s	user 0.001s	sys 0.000s
I20260709 13:07:00.623884 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:00.624830 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.592345 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:00.621503 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5b97fcd3d908482fadc6fa54e513304d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ccb2e30f44f40c2b22339e1d4c74a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:00.629208 15592 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 6.
I20260709 13:07:00.649827 21292 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.504575 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.583319 21215 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.684971 21219 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.735920 21215 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.738404 21219 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.619343 21226 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.739979 21226 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:00.669193 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 145411us
I20260709 13:07:00.593264 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:00.741753 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:00.742827 21226 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.677634 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.743794 20452 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:00.744462 20452 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:00.744980 20452 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:00.750409 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.750820 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:00.751576 21190 consensus_meta.cc:287] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.002s
I20260709 13:07:00.751634 21317 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.752600 21317 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.752435 21190 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.753376 21317 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.756048 21290 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.756821 21290 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.757814 21308 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:00.759335 21294 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.623s	user 0.001s	sys 0.001s
I20260709 13:07:00.673341 21232 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:00.761291 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.683871 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:00.688247 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.764235 15591 raft_consensus.cc:2410] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:07:00.764258 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 80510.6us
I20260709 13:07:00.765683 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:00.681867 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:00.697752 21180 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.766798 15585 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.662343 21250 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:00.670725 21270 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:00.704586 15326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 101577us
I20260709 13:07:00.764269 21289 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:00.768460 21289 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.768575 21180 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.768882 21289 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.657524 21046 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.711252 16176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52910 (request call id 559) took 1263 ms. Trace:
I20260709 13:07:00.671470 20706 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.720022 21287 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.700093 21286 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:00.771993 21046 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.767952 21250 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.772693 21046 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:00.773198 21046 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.773377 21286 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.774423 21250 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.775153 21158 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:00.777053 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:00.777324 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 82365.1us
I20260709 13:07:00.660924 21284 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.625772 21125 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:00.673727 21298 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.731058 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:00.731386 21159 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.706986 21135 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.687454 21230 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.732846 21208 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:07:00.734575 15442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2321) took 1685 ms (client timeout 1532 ms). Trace:
I20260709 13:07:00.734711 21299 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.673190 21148 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.760967 16177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52910 (request call id 560) took 1232 ms. Trace:
I20260709 13:07:00.769241 15515 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.696926 21209 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.728348 21010 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:00.679944 15435 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:00.771714 16176 rpcz_store.cc:276] 0709 13:06:59.447364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.447527 (+   163us) service_pool.cc:224] Handling call
0709 13:06:59.447936 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:59.512264 (+ 64328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.512309 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:59.526433 (+ 14124us) log.cc:844] Serialized 52 byte log entry
0709 13:06:59.746700 (+220267us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:59.746747 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.746826 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.617947 (+871121us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:00.710892 (+ 92945us) raft_consensus.cc:1685] finished
0709 13:07:00.710921 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.711163 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47345,"raft.queue_time_us":59809,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":14931,"spinlock_wait_cycles":92037376,"thread_start_us":183643,"threads_started":1,"wal-append.queue_time_us":299031}
I20260709 13:07:00.780340 15443 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:07:00.739076 21215 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.789029 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:00.863255 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 74457.8us
I20260709 13:07:00.775297 21046 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.763353 21232 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.784824 21158 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:00.791810 21285 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:00.795954 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:00.775324 21286 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:00.848510 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51914.9us
W20260709 13:07:00.852018 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.850479 15442 rpcz_store.cc:269] 0709 13:06:59.022275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.022388 (+   113us) service_pool.cc:224] Handling call
0709 13:07:00.707330 (+1684942us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002d1254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:00.707531 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3195801344}
I20260709 13:07:00.859467 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:00.863482 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:00.858494 16177 rpcz_store.cc:276] 0709 13:06:59.528135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.528302 (+   167us) service_pool.cc:224] Handling call
0709 13:06:59.528689 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.529120 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.529162 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.529761 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.739936 (+210175us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:59.739999 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.740106 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.702667 (+962561us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:00.760641 (+ 57974us) raft_consensus.cc:1685] finished
0709 13:07:00.760671 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.760896 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13694,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":5261,"spinlock_wait_cycles":58952576,"thread_start_us":209620,"threads_started":1,"wal-append.queue_time_us":335537}
I20260709 13:07:00.869469 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.796428 21125 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:00.901991 15512 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:00.865280 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:00.850783 21303 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:00.885331 15514 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:00.900938 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:00.905472 21313 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:00.901973 15518 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:00.905764 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:00.910987 15517 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 15: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:00.912714 15441 raft_consensus.cc:2393] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:00.914316 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:00.854156 21245 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:00.860379 21190 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.868903 21180 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.862847 21209 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:00.864403 21290 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:00.928445 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:00.877449 21140 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:00.950716 15583 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 15: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:00.857511 21208 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.924289 15516 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:00.880746 21304 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.936820 15515 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:07:00.860594 21159 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:00.860941 21135 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:00.981743 15512 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:00.981895 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:00.957952 21208 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:00.958490 21140 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:00.965809 21290 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:00.882284 21230 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.039988 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:00.937008 21245 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:01.044607 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 127784us
I20260709 13:07:00.941550 21180 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.049343 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:01.026219 21140 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:01.056489 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 191298us
I20260709 13:07:01.057680 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:01.063117 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.055498 21208 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.066131 21159 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.070590 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.095760 15512 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:01.062516 21290 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:01.075719 21285 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:01.076592 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3508) took 1205 ms. Trace:
I20260709 13:07:01.083411 15435 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
W20260709 13:07:01.061764 21334 log.cc:927] Time spent T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:01.075165 21214 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:01.061534 21152 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.101066 15585 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:07:01.109470 15510 rpcz_store.cc:276] 0709 13:06:59.870956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.871129 (+   173us) service_pool.cc:224] Handling call
0709 13:07:00.088142 (+217013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.201736 (+113594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.201774 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.201816 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:00.201848 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.076337 (+874489us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400295754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:01.076388 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.076524 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260708096}
I20260709 13:07:01.060158 21219 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.059999 21158 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:00.992519 21125 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.129092 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:01.142138 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.126776 21219 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.150458 21219 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.153122 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:01.153685 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3497) took 2120 ms. Trace:
I20260709 13:07:01.154177 15438 raft_consensus.cc:2410] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:01.154047 15513 rpcz_store.cc:276] 0709 13:06:59.032879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.033111 (+   232us) service_pool.cc:224] Handling call
0709 13:06:59.033465 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.372638 (+1339173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.153361 (+780723us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400202bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:01.153582 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3078071680}
I20260709 13:07:01.156855 21245 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.161855 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:01.162899 15441 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.164700 15406 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:01.166006 15406 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:01.166925 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:01.169003 21337 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:01.169585 21337 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:01.170423 20706 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:01.170871 20706 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.171234 20706 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.169713 21279 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:01.172266 21279 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:01.173283 21279 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.135784 21214 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:01.176270 21214 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:01.176679 21214 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:01.170038 21337 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:01.143877 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.178553 15435 raft_consensus.cc:2410] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:01.179719 21298 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.179718 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:01.181540 21327 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
I20260709 13:07:01.181712 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:01.182930 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.187153 21304 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.187793 21304 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.183491 15435 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:07:01.169664 15440 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:07:01.194803 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:01.187371 15441 raft_consensus.cc:2410] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:07:01.155288 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:01.197500 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.199455 15510 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:01.121963 21158 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.211830 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.220391 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.111754 21208 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.220695 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:01.189888 21304 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.127261 21152 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.207320 21235 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.235406 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.202083 21148 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.118871 21285 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.210470 21158 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:01.207613 21245 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:01.252630 21245 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.244901 21235 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.245219 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.245795 15441 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:01.256618 15583 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:01.248422 15435 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.259488 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2727) took 1024 ms. Trace:
I20260709 13:07:01.260022 15435 rpcz_store.cc:276] 0709 13:07:00.235621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.229150 (+993529us) service_pool.cc:224] Handling call
0709 13:07:01.248153 (+ 19003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.259162 (+ 11009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.259412 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:01.238291 21270 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:01.304967 15589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 3289) took 2347 ms (client timeout 2213 ms). Trace:
W20260709 13:07:01.309558 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.311359 15556 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:01.305632 15589 rpcz_store.cc:269] 0709 13:06:58.957193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.984719 (+ 27526us) service_pool.cc:224] Handling call
0709 13:07:01.304743 (+2320024us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54001dced4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:01.304886 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3861522176}
I20260709 13:07:01.328176 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44656 (request call id 87) took 1430 ms. Trace:
I20260709 13:07:01.255445 21245 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:01.328866 15437 rpcz_store.cc:276] 0709 13:06:59.872863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.115249 (+242386us) service_pool.cc:224] Handling call
0709 13:07:01.303354 (+1188105us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54003a6e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd51853 00007fcf80d1f60a 00007fcf7a2a57d4 00007fcf7a2a5762 00007fcf7a2a5691 00007fcf7a2a560c 00007fcf7a2a48c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:01.303495 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605430528}
I20260709 13:07:01.329114 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 658) took 1106 ms. Trace:
I20260709 13:07:01.336653 15434 rpcz_store.cc:276] 0709 13:07:00.223159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.223728 (+   569us) service_pool.cc:224] Handling call
0709 13:07:00.259846 (+ 36118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.385266 (+125420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.385304 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.385353 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:00.385386 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.328707 (+943321us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400059954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:01.328810 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.329028 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287954176}
I20260709 13:07:01.328285 15435 raft_consensus.cc:1240] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:01.344241 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 136690us
I20260709 13:07:01.301862 21135 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:01.345597 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:01.349155 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:01.262480 21219 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:07:01.353279 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.260895 21317 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:01.341616 21289 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.007s
I20260709 13:07:01.353694 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:01.354274 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.354934 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:01.356571 15510 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:01.334508 21300 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:01.336509 21270 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:01.351893 21180 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.358402 21135 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:01.374079 16175 raft_consensus.cc:2368] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7.
I20260709 13:07:01.383517 21285 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.366976 21300 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:01.390460 15438 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 6.
W20260709 13:07:01.367980 21225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.024s	sys 0.044s
I20260709 13:07:01.357707 21140 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.375937 21135 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.372484 21235 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.365063 21289 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:01.405208 21225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.025s	sys 0.045s
I20260709 13:07:01.408794 21317 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.393999 21300 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.381963 21209 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.423398 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:01.418619 21135 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:01.447260 21286 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
I20260709 13:07:01.424695 15438 raft_consensus.cc:606] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:01.444646 21140 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.441398 21152 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:01.449702 21290 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:01.477691 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 3514) took 1078 ms. Trace:
I20260709 13:07:01.511343 15511 rpcz_store.cc:276] 0709 13:07:00.399070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.402382 (+  3312us) service_pool.cc:224] Handling call
0709 13:07:01.467205 (+1064823us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b54002e2a54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:01.477599 (+ 10394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90034432}
I20260709 13:07:01.417701 21270 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.508023 15438 raft_consensus.cc:614] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:01.535962 15436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2331) took 1238 ms (client timeout 1623 ms). Trace:
W20260709 13:07:01.536334 15407 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.67:37005 timed out after 2.213s (SENT) [suppressed 16 similar messages]
W20260709 13:07:01.536396 15436 rpcz_store.cc:269] 0709 13:07:00.297689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.361131 (+ 63442us) service_pool.cc:224] Handling call
0709 13:07:01.535760 (+1174629us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b540033f9d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:01.535896 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9229056}
I20260709 13:07:01.537603 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.538115 15436 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:07:01.545173 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.531939 21349 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:01.549796 21349 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.552320 21349 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:01.553712 15513 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:01.554219 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.554896 15517 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:01.548425 15511 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:01.549109 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:01.556417 15515 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:01.556922 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.556402 15436 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.557794 15511 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:01.565272 21135 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.559823 15511 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:01.566323 15436 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7.
I20260709 13:07:01.567579 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.521003 21214 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.533407 21152 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.571867 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.572749 15515 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:07:01.574574 15517 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:01.575347 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.568281 15436 raft_consensus.cc:2376] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 7. Re-sending same reply.
I20260709 13:07:01.576421 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.577327 15512 raft_consensus.cc:2393] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:01.540270 21219 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.581030 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.579020 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.584195 15513 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:01.584262 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:01.584717 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:01.585152 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.585788 15513 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:07:01.547047 21180 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.586587 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.585419 15514 raft_consensus.cc:2368] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19.
I20260709 13:07:01.589795 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.590531 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.571624 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.590040 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:01.584379 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.591607 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.592614 15511 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:01.597290 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.598489 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:01.599207 15436 raft_consensus.cc:1240] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.599710 15513 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:01.600270 21231 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:07:01.602173 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.602631 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:01.602864 15518 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:01.603470 21225 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:01.604419 21225 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:01.604765 21225 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:07:01.604897 20452 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.859s	user 0.015s	sys 0.000s
I20260709 13:07:01.605255 21284 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.605434 20452 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.605674 21225 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.607048 21225 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.597301 21232 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:01.608289 21232 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.609642 20706 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.610858 21232 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.578780 21152 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.589262 21219 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.600153 21286 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:07:01.620141 21148 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.600450 21180 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.620784 21148 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.622402 21180 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.625806 15512 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:01.601894 21235 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:01.634310 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:01.631469 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:01.632658 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.633468 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.636322 15589 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:01.636758 15588 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:01.637445 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.647912 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.648787 15590 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 14: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:01.650081 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:01.653213 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 56540.3us
I20260709 13:07:01.654228 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:01.655246 15591 raft_consensus.cc:2368] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
W20260709 13:07:01.655376 15482 connection.cc:256] RPC call timeout handler was delayed by -1.112298317000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260709 13:07:01.655318 15583 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:01.657976 15436 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:07:01.626163 21289 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.660913 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.638320 21209 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.664116 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.666358 15591 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:07:01.668432 15589 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:01.668684 15436 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:01.646795 21135 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.672814 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.679703 15516 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
W20260709 13:07:01.680619 21350 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:07:01.685209 15442 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:01.686020 21158 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.688930 15438 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 13:07:01.690101 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2334) took 1339 ms. Trace:
I20260709 13:07:01.690478 15434 rpcz_store.cc:276] 0709 13:07:00.350671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.338230 (+987559us) service_pool.cc:224] Handling call
0709 13:07:01.349630 (+ 11400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:01.350079 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.350126 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:01.369193 (+ 19067us) log.cc:844] Serialized 52 byte log entry
0709 13:07:01.525128 (+155935us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:01.525158 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.525217 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.689835 (+164618us) raft_consensus.cc:1685] finished
0709 13:07:01.689859 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.690038 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5378,"raft.queue_time_us":388,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5878,"thread_start_us":132922,"threads_started":1,"wal-append.queue_time_us":219384}
I20260709 13:07:01.694262 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:07:01.695915 21337 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.519s	user 0.014s	sys 0.000s
I20260709 13:07:01.696491 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:01.696328 21337 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.698336 15437 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:01.699054 20452 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.662647 21232 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.699914 21219 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.699957 21232 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.703049 21232 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:01.709892 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 173567us
W20260709 13:07:01.672348 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46027.9us
I20260709 13:07:01.711967 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.711302 21219 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:01.712961 15591 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:01.714140 15591 raft_consensus.cc:2410] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:01.711752 15555 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:01.715975 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.720975 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:01.722940 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.710453 21180 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:01.726552 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:01.730368 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:07:01.734262 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.734197 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:01.734352 21069 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.735996 21069 raft_consensus.cc:697] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:01.736471 21349 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:01.736931 21069 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.726399 21286 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:01.736459 21235 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:01.738061 21286 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:01.737080 21349 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.738616 21286 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.735148 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:01.741375 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:01.742656 15589 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:01.739328 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:01.731395 21340 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.726527 21290 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:01.745131 21166 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.717242 21219 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.758046 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.781980 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:01.727025 21180 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.787772 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.754407 21310 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:01.748795 21354 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:01.759418 21290 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:01.793926 15584 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.566s	user 0.031s	sys 0.064s
W20260709 13:07:01.800657 15584 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.031s	sys 0.064s
I20260709 13:07:01.804441 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.780205 21358 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.786623 21158 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.786983 20452 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:01.812939 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:01.746059 21300 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.811918 21232 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.806643 21304 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.805555 21290 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:01.821905 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3519) took 1277 ms. Trace:
I20260709 13:07:01.828935 21219 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.807298 21354 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.822456 15509 rpcz_store.cc:276] 0709 13:07:00.544388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.588511 (+ 44123us) service_pool.cc:224] Handling call
0709 13:07:00.588939 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.589219 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:00.908043 (+318824us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.908693 (+   650us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.178301 (+269608us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b18003e82a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:07:01.761087 (+582786us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b18003e82a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78be4c0a 00007fcf82324219 00007fcf7b90dd70 00007fcf7b901293 00007fcf7b8f6cea 00007fcf7b8f723a 00007fcf7bd61a2a 00007fcf7bd710bf 00007fcf7bd71038
0709 13:07:01.821572 (+ 60485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:01.821626 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:01.821665 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.821716 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.821820 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6749,"prepare.queue_time_us":288016,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":103,"raft.queue_time_us":58560,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":25594880,"thread_start_us":370622,"threads_started":2}
W20260709 13:07:01.853348 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.818579 20452 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.873770 20452 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.874357 16174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 597) took 1468 ms. Trace:
I20260709 13:07:01.875653 21354 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:01.806900 21310 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.879071 21310 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.880436 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2715) took 1764 ms. Trace:
I20260709 13:07:01.880846 15439 rpcz_store.cc:276] 0709 13:07:00.115672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.115808 (+   136us) service_pool.cc:224] Handling call
0709 13:07:00.167341 (+ 51533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.376137 (+208796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.376185 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.376750 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.663275 (+286525us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:00.663327 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.879916 (+1216589us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002247d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:01.879990 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.880062 (+    72us) raft_consensus.cc:1685] finished
0709 13:07:01.880094 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.880372 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1246,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":478825216,"thread_start_us":286132,"threads_started":1,"wal-append.queue_time_us":407436}
I20260709 13:07:01.884267 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:01.887233 21245 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:01.892086 21245 raft_consensus.cc:697] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:01.893107 21245 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.888049 21235 consensus_queue.cc:1059] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:01.896458 21235 raft_consensus.cc:3055] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:01.896817 21235 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:01.897749 21235 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:01.888844 21209 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:01.890105 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.824875 21304 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:01.864120 21232 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:01.891089 21148 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:01.891347 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:01.901711 21148 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:01.875150 16174 rpcz_store.cc:276] 0709 13:07:00.405921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.406123 (+   202us) service_pool.cc:224] Handling call
0709 13:07:00.406553 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.651736 (+245183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.651770 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.651811 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:00.651844 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.874010 (+1222166us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400510254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:01.874089 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.874278 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563314560}
I20260709 13:07:01.901633 21232 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:01.920854 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:01.917708 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2734) took 1389 ms. Trace:
I20260709 13:07:01.922032 15437 rpcz_store.cc:276] 0709 13:07:00.527878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.356096 (+828218us) service_pool.cc:224] Handling call
0709 13:07:01.356379 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.698699 (+342320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.917353 (+218654us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b540026be54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:01.917625 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786024192}
I20260709 13:07:01.919646 21235 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.941115 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:01.942267 15583 raft_consensus.cc:2368] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14.
I20260709 13:07:01.891104 21362 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:01.921169 21364 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.920688 21148 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:01.923957 21289 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:01.929061 21349 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.957365 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:01.958204 15591 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:01.946310 21180 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.964994 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:01.966327 15589 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:01.989135 21152 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:01.990959 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2325) took 1763 ms. Trace:
I20260709 13:07:01.991528 15441 rpcz_store.cc:276] 0709 13:07:00.227314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.207435 (+980121us) service_pool.cc:224] Handling call
0709 13:07:01.207875 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.256714 (+ 48839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.990601 (+733887us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b54002d0854. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:01.990872 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86374272}
W20260709 13:07:01.993317 15440 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2329) took 1717 ms (client timeout 2125 ms). Trace:
W20260709 13:07:01.993885 15440 rpcz_store.cc:269] 0709 13:07:00.275702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.424312 (+148610us) service_pool.cc:224] Handling call
0709 13:07:01.993078 (+1568766us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54003a6954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:01.993235 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687341824}
I20260709 13:07:02.001575 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.002379 15583 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:02.003518 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:02.003947 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.004592 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.005252 15588 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:02.007929 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.017727 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.020320 21304 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:01.959120 21289 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.022184 21148 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.024483 15435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46600 (request call id 2328) took 1765 ms. Trace:
I20260709 13:07:02.025038 15435 rpcz_store.cc:276] 0709 13:07:00.259316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.262353 (+1003037us) service_pool.cc:224] Handling call
0709 13:07:01.328022 (+ 65669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.348752 (+ 20730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.024077 (+675325us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54002c36a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd5aa02 00007fcf7bd56dd6 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2
0709 13:07:02.024380 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39011072}
I20260709 13:07:02.029657 21286 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.032367 21208 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:02.035897 15443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 2733) took 1508 ms (client timeout 1525 ms). Trace:
W20260709 13:07:02.036556 15443 rpcz_store.cc:269] 0709 13:07:00.527610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.673595 (+145985us) service_pool.cc:224] Handling call
0709 13:07:02.017456 (+1343861us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b54002d1254. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:02.035791 (+ 18335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83723136}
I20260709 13:07:02.038542 15585 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:02.042138 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.031145 20706 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.068111 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.069923 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.072405 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.073277 16182 raft_consensus.cc:2410] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:07:02.073681 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:02.080799 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.081707 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.084590 15591 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:02.066797 21152 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:02.097095 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:02.078802 21341 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.697s	user 0.004s	sys 0.000s
I20260709 13:07:01.960914 21232 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.091291 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:02.095721 21231 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:02.076519 20706 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:02.076984 21300 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:02.076588 21319 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.100692 15407 leader_election.cc:400] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14.
I20260709 13:07:02.105295 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.113662 15585 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:02.115260 15407 leader_election.cc:403] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.117545 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:02.119737 15590 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:02.121901 21369 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:07:02.122694 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:02.124655 21367 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:02.124794 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.125839 15590 raft_consensus.cc:1240] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:02.101110 21366 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:02.101481 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 215772us
I20260709 13:07:02.132264 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3305) took 1946 ms. Trace:
I20260709 13:07:02.133827 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.136855 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:02.137923 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 325350us
I20260709 13:07:02.139180 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:02.140954 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:02.134418 15587 rpcz_store.cc:276] 0709 13:07:00.186142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.200065 (+ 13923us) service_pool.cc:224] Handling call
0709 13:07:00.200385 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:00.238743 (+ 38358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.238777 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:00.239414 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 13:07:01.044591 (+805177us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b1800422860. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:07:01.273524 (+228933us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:01.339532 (+ 66008us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.339883 (+   351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.340009 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.003322 (+663313us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b1800422860. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:07:02.053540 (+ 50218us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:02.131901 (+ 78361us) raft_consensus.cc:1685] finished
0709 13:07:02.131936 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.132144 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57135,"prepare.queue_time_us":69602,"prepare.run_wall_time_us":52,"raft.queue_time_us":65521,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":36155,"spinlock_wait_cycles":88720640,"thread_start_us":228647,"threads_started":1,"wal-append.queue_time_us":1088097}
I20260709 13:07:02.143898 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.147147 21180 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:02.150329 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.152019 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.133270 20706 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.104964 21231 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.166374 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.169741 15587 raft_consensus.cc:2393] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:02.148844 21289 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:02.116755 21319 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.172680 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.175241 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.157927 20484 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.164206 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.182534 21231 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:02.170370 21351 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:02.183631 21351 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:02.156148 21304 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:02.184270 21351 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:02.184325 21304 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.184863 21304 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.185161 21319 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:02.176862 15585 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:07:02.152325 21372 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.183665 16178 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:02.194643 21304 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.197322 21304 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.199229 21351 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:02.217254 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.179692 20484 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.158916 21373 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:07:02.175835 21225 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:02.175376 21300 consensus_queue.cc:1059] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:07:02.144250 21366 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:02.228128 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 55761.7us
I20260709 13:07:02.240901 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.228652 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3302) took 2065 ms. Trace:
W20260709 13:07:02.255095 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.256898 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.257673 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:02.257966 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.268778 15442 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:02.270136 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:02.270350 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:02.242268 15584 rpcz_store.cc:276] 0709 13:07:00.163450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.163606 (+   156us) service_pool.cc:224] Handling call
0709 13:07:00.193603 (+ 29997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.193898 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:01.801055 (+1607157us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.124067 (+323012us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:02.168319 (+ 44252us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.228206 (+ 59887us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.228273 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:02.228324 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.228418 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.228586 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63268,"prepare.queue_time_us":160841,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":82,"raft.queue_time_us":156493,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":16669,"spinlock_wait_cycles":38948736,"thread_start_us":1939177,"threads_started":3,"wal-append.queue_time_us":159210}
W20260709 13:07:02.220256 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56164.1us
I20260709 13:07:02.219640 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.264185 15437 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:02.265049 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.274055 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:02.276207 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 56715us
I20260709 13:07:02.221174 20484 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.275525 15443 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:07:02.233085 21285 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:02.233402 21225 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:02.231385 21289 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.294950 21289 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.268484 21373 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:02.234076 21358 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:02.273170 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 128206us
I20260709 13:07:02.230995 21300 raft_consensus.cc:3055] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:02.274171 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:02.230655 21208 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:02.286535 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.273263 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.236150 21286 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:02.236898 21366 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.246181 21292 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:07:02.288967 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 159352us
I20260709 13:07:02.291141 21225 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:02.273558 15439 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:02.319011 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:02.297252 15482 leader_election.cc:400] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:07:02.320173 15482 leader_election.cc:403] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.320091 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:02.300454 21152 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.305702 15442 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:07:02.284335 21377 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:02.308928 15555 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.296903 21372 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:07:02.328572 15591 raft_consensus.cc:3055] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:02.335011 15591 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:02.335501 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:02.298010 21373 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:02.304298 21351 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.320154 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.270823 21375 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:07:02.314690 21354 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:02.325022 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.313822 21364 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:02.321856 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.358958 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.340656 16182 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:02.304565 21300 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:02.359395 15555 leader_election.cc:400] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19.
I20260709 13:07:02.359894 15555 leader_election.cc:403] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.336241 15591 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.352756 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.323084 21377 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.361284 16179 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:02.353345 21289 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.322499 21378 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:02.296809 21285 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.339533 21358 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.361452 15591 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.337670 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:02.364543 15586 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:02.367218 15482 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:02.368355 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.323276 21208 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:02.323429 21366 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 11. Current term is 12.
I20260709 13:07:02.336730 21286 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:02.372341 16174 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
W20260709 13:07:02.369493 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 78230.3us
I20260709 13:07:02.394804 15556 leader_election.cc:400] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 6 election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 6. Current term is 7.
I20260709 13:07:02.374172 21359 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:02.371980 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.340619 21281 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:02.342514 21373 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:02.373597 21245 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.389220 21298 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:02.391654 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54074.6us
I20260709 13:07:02.357795 21354 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.438272 21354 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.370395 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:02.341404 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.370069 21377 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.397447 15591 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:07:02.446928 15591 pending_rounds.cc:85] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 7
I20260709 13:07:02.447335 15591 pending_rounds.cc:107] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:02.447660 15591 raft_consensus.cc:2889] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.334573 21152 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.370383 21372 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.371958 21190 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:02.398192 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:02.467602 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 72199.5us
I20260709 13:07:02.469008 21366 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:02.469686 21366 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:02.470741 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.458359 21372 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.447831 21300 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.472056 21208 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.472731 21372 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.418624 21232 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.426890 21340 consensus_queue.cc:1059] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:07:02.474638 21340 raft_consensus.cc:3055] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:02.472076 15326 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5b97fcd3d908482fadc6fa54e513304d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ccb2e30f44f40c2b22339e1d4c74a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:02.462994 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.481137 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.401087 15437 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 13:07:02.323007 21292 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.377194 21358 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.475030 21340 raft_consensus.cc:740] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:02.424757 21269 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:02.424108 21359 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:02.419937 21290 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.004s
I20260709 13:07:02.397840 21159 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:02.461546 21364 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:02.475683 21300 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:02.375000 21378 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:02.430146 21360 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:07:02.418357 21380 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:07:02.465902 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.411589 21385 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:02.430259 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:02.435629 21286 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:02.491614 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:02.491402 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 123192us
I20260709 13:07:02.494777 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.511623 15515 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:02.511811 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.496191 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.512677 15517 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:02.497184 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.499624 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:02.499747 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.513677 15513 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.514099 15509 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:02.463068 21152 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:02.488440 21190 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:02.504213 15510 raft_consensus.cc:2393] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:02.506215 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.507570 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.390296 21225 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.490922 21358 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:02.513253 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 83141us
I20260709 13:07:02.518343 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.529668 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.518596 15509 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:02.519001 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.526351 15518 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:02.538807 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 138985us
I20260709 13:07:02.542363 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.542248 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.530579 16175 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:02.548561 21214 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:02.551879 21340 consensus_queue.cc:260] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.520186 20706 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14.
I20260709 13:07:02.556924 21317 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:02.557495 21317 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:02.558416 21317 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:02.536579 15326 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet 5b97fcd3d908482fadc6fa54e513304d with cas_config_opid_index 6 failed: Not found: failed to reset TS proxy: No leader found: Tablet 5b97fcd3d908482fadc6fa54e513304d consensus state has no leader
I20260709 13:07:02.561054 15515 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:02.564721 21378 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:02.566643 21359 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.524461 21298 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.516707 21349 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.572125 21190 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.579072 21231 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:07:02.581923 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 113338us
I20260709 13:07:02.504629 21290 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.583237 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.510272 21286 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:02.596680 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.597504 15510 raft_consensus.cc:3060] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.600396 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.600662 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.596151 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.595266 15517 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:02.587872 15441 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:02.592645 15513 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:02.594270 15443 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:02.602505 15435 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:02.559438 21317 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:02.603745 15512 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:07:02.499178 21269 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.608425 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.581696 21231 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:02.609601 15513 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:02.612304 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.614703 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.611464 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.615250 15443 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.615963 15443 raft_consensus.cc:2393] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:02.618572 15510 raft_consensus.cc:2468] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:02.620296 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:02.620889 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 78666.6us
I20260709 13:07:02.621747 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.621683 15555 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:02.621038 15514 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 10: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:02.624831 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.625504 15443 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:07:02.633127 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.633422 21180 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:02.634394 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.634441 20484 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.635809 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.597726 21214 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:02.629037 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.629972 21232 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:02.643780 21209 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.643951 21231 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:02.644626 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.645136 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.640000 15436 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:02.646682 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.599983 21359 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.650553 21359 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.651026 21359 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.651458 21371 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:02.630312 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.653513 21148 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:02.654341 15442 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:02.643471 21232 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:02.656915 21232 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:02.658562 21377 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.605397 21391 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:07:02.660909 21377 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.661712 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:02.662513 21354 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.645382 21079 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:02.663594 21079 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.663968 21079 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.664706 21354 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.667834 21225 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.670136 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:02.670909 15440 raft_consensus.cc:2368] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18.
I20260709 13:07:02.671687 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.672255 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.672890 15442 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:07:02.672981 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:02.645471 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.650812 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:02.675359 21391 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:02.675489 21337 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:02.675954 21391 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:02.676105 21373 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.676432 21337 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.677136 15587 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.677340 21391 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.678141 21289 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.678635 21289 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.683692 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.684545 15511 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.684703 21373 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:02.645402 21231 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:02.687480 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.688316 15436 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:02.695637 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:02.696699 15443 raft_consensus.cc:2376] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15. Re-sending same reply.
I20260709 13:07:02.701890 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.703035 15512 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:02.704797 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.705848 15441 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
W20260709 13:07:02.733371 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 82638us
W20260709 13:07:02.738098 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 72527.9us
W20260709 13:07:02.746646 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 103518us
I20260709 13:07:02.618175 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.780864 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.776723 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.781713 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.782519 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.613237 21392 raft_consensus.cc:2764] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:02.789799 15438 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:07:02.792323 15437 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:02.791013 15591 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:02.788322 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:02.788561 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.790306 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.790632 15435 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 17: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:02.780067 15518 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:02.793898 15586 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:02.794275 15509 raft_consensus.cc:1240] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
W20260709 13:07:02.785118 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50642.2us
W20260709 13:07:02.801733 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.804417 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:02.806344 15511 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:02.807602 15585 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:02.811074 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.813761 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.817796 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:02.823045 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.824093 15438 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:07:02.819057 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.828028 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:02.832731 15587 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:02.837347 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:02.816615 15555 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.769371 21358 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.832235 15556 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.677111 21337 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:02.842031 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:02.842536 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.843410 15511 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:02.842890 15438 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:07:02.833617 21366 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:02.825080 21396 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:02.841423 21208 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:02.847066 21354 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:02.859701 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.804756 21378 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:07:02.848583 21392 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:02.884253 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:02.884865 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68372.5us
I20260709 13:07:02.780385 21286 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:07:02.888072 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 55946.4us
I20260709 13:07:02.885214 15512 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:07:02.859579 21292 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:02.948526 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 68530.3us
W20260709 13:07:02.948596 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 89045.4us
I20260709 13:07:02.881354 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.951627 15556 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.786854 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:02.973699 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:02.991007 21395 raft_consensus.cc:2804] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:03.020310 21180 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.992519 21235 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:02.883713 21354 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:03.026469 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:02.889791 21219 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:02.995682 15509 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:03.092512 15441 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:03.004441 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:03.024636 21372 consensus_meta.cc:287] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.551s	user 0.014s	sys 0.002s
I20260709 13:07:02.878053 21289 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:03.038869 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:02.877679 21366 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:02.853649 21377 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 13:07:03.034500 21399 log.cc:927] Time spent T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:07:03.021215 21351 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:03.057427 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:03.074515 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.079042 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 230625us
I20260709 13:07:03.083887 15443 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:03.135190 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 253926us
W20260709 13:07:03.130879 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 126594us
W20260709 13:07:03.094961 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 143513us
I20260709 13:07:03.139761 15592 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:07:03.139600 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 102848us
I20260709 13:07:03.145939 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:03.146095 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:02.883023 21396 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:03.077481 20484 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:03.092099 21385 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.016s
I20260709 13:07:03.129931 21395 raft_consensus.cc:697] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:03.142482 21235 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:03.128374 21354 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:03.134099 21366 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:03.143334 21069 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:03.140399 21152 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:03.137470 21298 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:03.181674 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.133370 21219 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:03.167448 21393 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260709 13:07:03.175917 21351 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:03.149802 21289 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:03.181386 21304 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:03.193018 21400 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:07:03.193696 21358 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:03.176389 21385 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19.
I20260709 13:07:03.128880 21372 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.129132 21180 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:03.203783 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 63960.4us
I20260709 13:07:03.187786 21406 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:03.165575 15443 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:07:03.197543 21219 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:03.199687 21190 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:03.230091 21235 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.230412 21190 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:03.232597 21190 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:03.233299 21285 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:03.234380 21402 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:03.210464 21304 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.228196 21406 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:03.236486 21304 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.237035 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:03.237308 21406 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.238651 21406 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:03.210757 21349 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:07:03.244822 21377 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:03.208813 21392 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.245576 21377 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:03.245896 21392 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.208820 21337 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:03.229285 21395 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.225458 21407 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.254470 21407 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.232118 21351 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.261315 16145 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:03.232641 21396 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:03.270748 21310 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.285351 21310 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.285838 21310 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:03.286968 21079 consensus_meta.cc:287] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.623s	user 0.003s	sys 0.009s
I20260709 13:07:03.288923 21180 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:03.292160 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 114) took 6771 ms. Trace:
W20260709 13:07:03.287918 21359 consensus_meta.cc:287] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.636s	user 0.017s	sys 0.003s
I20260709 13:07:03.296458 21410 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:03.301558 21286 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.294459 15337 rpcz_store.cc:276] 0709 13:06:56.530056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.530294 (+   238us) service_pool.cc:224] Handling call
0709 13:07:03.292045 (+6761751us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:59.827624 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:00.052245 (+224621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:00.052291 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:07:00.052309 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:00.178847 (+126538us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:00.194322 (+ 15475us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:00.204070 (+  9748us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:00.362686 (+158616us) tablet.cc:701] Row locks acquired
0709 13:07:00.362703 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:07:00.362896 (+   193us) write_op.cc:270] Start()
0709 13:07:00.363029 (+   133us) write_op.cc:276] Timestamp: P: 1783602420362843 usec, L: 0
0709 13:07:00.363046 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:07:00.363888 (+   842us) log.cc:844] Serialized 5095 byte log entry
0709 13:07:01.064277 (+700389us) op_driver.cc:464] REPLICATION: finished
0709 13:07:01.360114 (+295837us) write_op.cc:301] APPLY: starting
0709 13:07:01.363306 (+  3192us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:01.444835 (+ 81529us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:01.445020 (+   185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:01.619027 (+174007us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:01.619338 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:07:01.619383 (+    45us) write_op.cc:312] APPLY: finished
0709 13:07:01.662781 (+ 43398us) log.cc:844] Serialized 121 byte log entry
0709 13:07:01.673351 (+ 10570us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.701823 (+ 28472us) write_op.cc:454] Released schema lock
0709 13:07:01.701889 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:01.702346 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.702382 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45800,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":283138,"apply.run_cpu_time_us":24204,"apply.run_wall_time_us":349950,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":422633,"prepare.run_cpu_time_us":40504,"prepare.run_wall_time_us":864118,"raft.queue_time_us":268754,"raft.run_cpu_time_us":30105,"raft.run_wall_time_us":206420,"replication_time_us":684439,"thread_start_us":848570,"threads_started":4,"wal-append.queue_time_us":356101,"wal-append.run_cpu_time_us":67805,"wal-append.run_wall_time_us":1971162}]]}
W20260709 13:07:03.308413 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 129908us
I20260709 13:07:03.319736 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:03.287472 21079 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.321143 21372 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:03.322896 21148 consensus_meta.cc:287] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.669s	user 0.012s	sys 0.000s
I20260709 13:07:03.323057 21079 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:03.324034 20452 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.324734 20452 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:03.356627 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 173091us
I20260709 13:07:03.302906 21392 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:03.386314 15589 raft_consensus.cc:2410] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:03.387849 21159 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:03.388319 21290 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:03.408269 21269 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:03.412921 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 3330) took 1412 ms. Trace:
I20260709 13:07:03.413421 15589 rpcz_store.cc:276] 0709 13:07:02.000577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.073349 (+ 72772us) service_pool.cc:224] Handling call
0709 13:07:03.412652 (+1339303us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000c0b54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:03.412820 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016195328}
W20260709 13:07:03.389755 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 70135.6us
W20260709 13:07:03.417011 21231 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.010s
I20260709 13:07:03.398484 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:03.417579 15587 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:03.418643 15406 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:03.419866 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:03.415266 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:03.424131 15587 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:03.417590 15588 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:03.434860 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:03.435998 15588 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.438540 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:07:03.453186 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 214555us
I20260709 13:07:03.455673 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:03.477586 15590 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:03.478569 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:03.479094 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 51816.5us
I20260709 13:07:03.479612 15513 raft_consensus.cc:2368] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18.
I20260709 13:07:03.480027 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:03.480448 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.480720 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:03.481596 15513 raft_consensus.cc:2368] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18.
I20260709 13:07:03.458843 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:03.483455 15592 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:03.462572 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:03.484273 15591 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.464638 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:03.488049 16178 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.490927 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:03.480657 15509 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
W20260709 13:07:03.498538 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 78804us
I20260709 13:07:03.499444 20484 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:03.324043 21359 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.396934 21281 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:03.527400 15585 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:03.499718 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:03.506333 15514 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:03.506527 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:03.529263 15513 raft_consensus.cc:2410] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:07:03.502305 21159 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:03.452860 21415 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:03.509563 21404 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.310s	user 0.002s	sys 0.008s
I20260709 13:07:03.544273 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:03.544844 20706 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.545488 20706 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:03.476606 21290 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:03.547751 21289 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.548034 21290 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:03.548221 21289 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.548648 21289 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.549121 21290 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.518695 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:03.519518 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:03.520327 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 347588us
I20260709 13:07:03.551999 15511 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:03.520479 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:03.558002 15515 raft_consensus.cc:2368] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13.
I20260709 13:07:03.495364 15589 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:03.561506 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:03.562996 15591 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:03.563216 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:03.564059 15443 raft_consensus.cc:3060] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.568994 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:03.419255 21375 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.524125 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:03.453758 21337 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:07:03.530867 20484 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.585979 20484 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.586489 20484 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:03.531275 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.536248 21159 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:03.537881 21225 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.005s
I20260709 13:07:03.572485 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:03.592444 15438 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.574591 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:03.577116 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:03.594228 15512 raft_consensus.cc:3060] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:03.578514 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 54501.6us
I20260709 13:07:03.595810 15439 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:03.530143 15406 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:03.597162 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 67182.5us
I20260709 13:07:03.521947 21410 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:07:03.608819 15326 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet 5b97fcd3d908482fadc6fa54e513304d with cas_config_opid_index 6 failed: Not found: failed to reset TS proxy: No leader found: Tablet 5b97fcd3d908482fadc6fa54e513304d consensus state has no leader
I20260709 13:07:03.602164 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:03.604683 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:03.612149 15586 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:03.591135 15443 raft_consensus.cc:2468] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:03.607352 15590 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:07:03.593606 21300 consensus_meta.cc:287] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.084s	user 0.011s	sys 0.005s
I20260709 13:07:03.620090 15438 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:03.617466 15588 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:03.627786 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:03.628711 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:03.578452 21415 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:03.629626 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:03.637810 15518 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.569434 21180 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:03.594620 21146 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.583803 21407 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:03.830564 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:03.980937 15436 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:03.774366 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:03.786208 21304 consensus_meta.cc:287] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:07:03.798422 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40676 (request call id 3554) took 1250 ms. Trace:
W20260709 13:07:03.842562 21219 consensus_meta.cc:287] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260709 13:07:03.737056 21377 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.001773 15518 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:03.763408 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:03.742733 15438 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:03.782862 21289 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:03.934417 15340 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 10 to 15, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.802095 20452 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:03.916181 21340 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.924804 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:03.609483 21398 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:03.763011 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:04.026808 15443 raft_consensus.cc:2393] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:03.842355 21281 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.736318 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:03.829780 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 285652us
I20260709 13:07:04.028550 20484 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:03.772862 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.777145 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:03.774073 21378 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.776186 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:03.933638 21366 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.734s	user 0.013s	sys 0.001s
W20260709 13:07:03.726042 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.038901 20484 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:03.747081 21417 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:07:03.989976 21407 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:03.593956 21375 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:03.756157 15439 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:07:03.782858 21406 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.000s
I20260709 13:07:03.735395 20706 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:03.961120 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:04.065289 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:04.065948 15516 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.804788 21300 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:04.067852 21300 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.070724 21300 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:03.804059 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:03.624785 21413 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.146s
I20260709 13:07:04.071713 21269 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.072280 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 268350us
I20260709 13:07:04.072495 21415 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.073895 15556 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:03.917587 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:04.075178 15513 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.784148 21359 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:03.812470 21310 consensus_meta.cc:287] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.001s
W20260709 13:07:03.985314 15587 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.016s	sys 0.000s
I20260709 13:07:03.985095 15515 rpcz_store.cc:276] 0709 13:07:02.580799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.581038 (+   239us) service_pool.cc:224] Handling call
0709 13:07:03.798133 (+1217095us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54003dc554. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:03.798334 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199638400}
I20260709 13:07:03.989857 21304 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.080097 21310 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:04.081898 21304 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:04.082476 21310 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:04.013326 20452 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.083742 15514 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:07:04.052796 21378 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:04.010214 15340 catalog_manager.cc:5697] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.019658 21235 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.085042 21235 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.085860 21378 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:04.085413 15340 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 12 to 14, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 14 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.982560 21180 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:04.087090 21235 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:04.020166 16178 consensus_meta.cc:287] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
W20260709 13:07:04.080099 15587 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.016s	sys 0.000s
I20260709 13:07:04.041044 21281 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.083807 20452 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.089772 21281 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:04.089968 21289 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:04.090117 20452 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:04.012053 21219 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.024062 15511 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:04.091171 15340 catalog_manager.cc:5697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.092337 21219 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:04.025197 15512 raft_consensus.cc:2468] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:04.092470 21407 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.092842 15340 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 9 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 12 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:04.094985 21407 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:04.031914 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:03.981503 21146 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:04.084141 15514 pending_rounds.cc:85] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 9
I20260709 13:07:04.095800 21146 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:04.095961 15514 pending_rounds.cc:107] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:07:04.096637 15438 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:07:04.041561 15555 leader_election.cc:400] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18.
W20260709 13:07:04.097209 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.043398 21152 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:04.043694 21416 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:04.044498 21421 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.046068 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:04.101284 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55298.7us
I20260709 13:07:04.102031 15407 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:04.103206 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:03.993316 21377 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.028860 15442 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:07:03.864260 21354 consensus_meta.cc:287] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.003s
I20260709 13:07:04.040587 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:04.118068 16179 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:07:04.042850 15406 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:07:04.119124 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76326.2us
I20260709 13:07:04.120807 15406 leader_election.cc:400] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13.
I20260709 13:07:04.096361 15514 raft_consensus.cc:2889] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:04.097790 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56384.9us
I20260709 13:07:04.087754 16178 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:04.125524 15555 leader_election.cc:400] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18.
I20260709 13:07:04.125886 15555 leader_election.cc:403] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:07:04.126566 15555 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:04.126722 15513 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:04.109903 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:04.128427 15516 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:04.129423 15440 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:04.132910 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:04.133515 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:04.133749 16179 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 14: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:04.134541 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:04.134718 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:04.135138 16174 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:04.136935 15436 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:07:04.140162 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:04.142390 15583 raft_consensus.cc:2393] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 13: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:04.094363 15340 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:04.146255 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:04.146708 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:04.142544 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:04.147986 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:04.041414 21398 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:04.149958 15406 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:04.157299 15591 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:04.154007 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:04.158562 15515 raft_consensus.cc:2393] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:04.148944 15340 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 12 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:04.161439 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:04.161860 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:04.162693 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:04.163507 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:04.104470 21286 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:04.120079 21428 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:04.120827 21219 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:04.118108 21289 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:04.167721 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:04.193104 15510 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:04.168836 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:04.169459 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:04.194445 15513 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:04.170800 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:04.197896 15585 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:04.175123 16174 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:04.166922 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:04.177438 15340 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 15 to 18, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 18 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:04.106204 21225 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:04.164745 20484 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:04.188618 21428 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.147791 21281 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:04.170560 21351 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:04.205557 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:04.148901 21300 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18.
I20260709 13:07:04.056654 21366 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.281504 21366 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:04.282711 15509 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:04.150763 21159 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:04.072295 21269 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:04.164220 21419 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.104986 21420 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:07:04.188045 21340 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:04.145776 21304 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:07:04.173349 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:04.191915 21395 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:04.229090 20484 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:04.177264 21286 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:04.238021 21180 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:04.230245 15340 catalog_manager.cc:5697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:04.246531 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 91306.9us
I20260709 13:07:04.284603 21281 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:04.253947 21146 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:04.257094 15513 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:04.119310 21421 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.193441 21219 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.259167 15510 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 21.
I20260709 13:07:04.150141 21354 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.205888 21359 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:04.266086 15516 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:04.288161 15518 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:04.263670 21428 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:04.319818 21286 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:04.315629 20484 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:04.320323 15340 catalog_manager.cc:5697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:04.344115 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 196221us
W20260709 13:07:04.318737 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 274742us
I20260709 13:07:04.321152 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:07:04.251935 21377 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:04.286697 21351 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:04.323822 15585 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:04.306491 21340 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:04.328748 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 182599us
W20260709 13:07:04.309680 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 165854us
I20260709 13:07:04.313928 21159 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:04.318619 21395 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:04.349630 15340 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 13 to 16, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:04.358018 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 203203us
I20260709 13:07:04.328496 21219 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:04.373746 15340 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.352496 15438 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:04.351658 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:04.324654 21289 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:07:04.424484 21434 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:07:04.382169 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:04.427618 21421 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:04.427893 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:04.427950 15586 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.429207 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:04.430285 21439 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:04.431991 21281 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.376912 15340 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 6 to 5, leader changed from <none> to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 5 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.290853 21398 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.384917 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:04.454692 15513 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:04.457429 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:04.460208 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:04.462544 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:04.465356 15510 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:07:04.373643 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 184550us
I20260709 13:07:04.466632 15513 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:04.467286 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:04.467629 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:04.468071 15516 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:04.468479 15509 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
W20260709 13:07:04.434223 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71162.3us
W20260709 13:07:04.469519 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 94594.9us
I20260709 13:07:04.472518 15556 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:04.469468 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 97093.6us
I20260709 13:07:04.358985 21389 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.538635 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.375010 21395 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:04.374110 21349 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:04.375975 21340 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:04.552011 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76670us
I20260709 13:07:04.437855 15340 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 11 to 14, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 14 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.542269 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:04.557969 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:04.551636 21180 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.561497 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 89063.9us
I20260709 13:07:04.580464 15556 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:04.574940 15340 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 12 to 14, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 14 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.465101 21377 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.583850 15340 catalog_manager.cc:5697] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.457552 15586 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:04.351342 21359 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.585584 15340 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:04.645105 15326 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet 5b97fcd3d908482fadc6fa54e513304d with cas_config_opid_index 6 failed: Not found: failed to reset TS proxy: No leader found: Tablet 5b97fcd3d908482fadc6fa54e513304d consensus state has no leader
I20260709 13:07:04.590981 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:04.581848 15556 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:04.560184 21351 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:04.667593 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 76803.9us
I20260709 13:07:04.673693 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:04.669615 15340 catalog_manager.cc:5697] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 11, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 11 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.682293 15340 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:04.683820 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 102051us
I20260709 13:07:04.686223 15340 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 9 to 11, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 11 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:04.689248 15340 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.691331 15340 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 13 to 16, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 16 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:04.693027 15340 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 8 to 9, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 9 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:04.550529 21371 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:07:04.581764 21375 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:04.642036 21420 raft_consensus.cc:2804] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:04.706326 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 234946us
I20260709 13:07:04.588076 21349 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:04.645613 21421 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:04.708187 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:04.715727 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 144874us
I20260709 13:07:04.679111 21366 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:04.697434 21407 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:04.563099 21389 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:07:04.721259 21435 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.457s	user 0.001s	sys 0.000s
W20260709 13:07:04.763458 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 86055.8us
I20260709 13:07:04.640772 21180 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.667320 21377 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.785063 21371 raft_consensus.cc:2804] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:04.767447 21315 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:04.768584 21225 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:04.767719 21420 raft_consensus.cc:697] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:04.767102 21378 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
W20260709 13:07:04.914458 21454 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:07:04.799331 21375 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:04.915488 21442 log.cc:927] Time spent T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
W20260709 13:07:04.911449 21437 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:07:04.919409 21371 raft_consensus.cc:697] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:04.755803 21159 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:04.939035 21452 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:07:04.922748 21389 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:04.930891 21455 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:07:04.930742 21340 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:04.903560 21146 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:04.793771 21407 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:07:04.910856 21315 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:04.921811 21420 consensus_queue.cc:237] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.908262 21225 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:04.959450 21286 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 13:07:04.998508 21371 consensus_queue.cc:237] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:04.903357 21349 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.017478 21286 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:05.024533 21428 consensus_meta.cc:287] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.006s
I20260709 13:07:05.025321 21428 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.027256 21286 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.027855 21359 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.006395 21407 consensus_queue.cc:1243] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:05.031518 21340 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.004119 21457 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:05.075681 21428 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:04.694983 15340 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:05.115414 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:05.118274 15340 catalog_manager.cc:5697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 6 to 10, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 10 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:07:05.126199 15406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.000s	sys 0.011s
W20260709 13:07:05.126935 15406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.000s	sys 0.012s
W20260709 13:07:05.127429 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 660681us
W20260709 13:07:05.129354 15409 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.030s	sys 0.029s
I20260709 13:07:05.129113 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:07:05.129842 15409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.030s	sys 0.029s
I20260709 13:07:05.134496 15482 leader_election.cc:400] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18.
I20260709 13:07:05.134500 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3570) took 1488 ms. Trace:
I20260709 13:07:05.135178 15482 leader_election.cc:403] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:07:05.136205 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.138078 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 452394us
W20260709 13:07:05.126194 15407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.014s	sys 0.046s
W20260709 13:07:05.143594 15407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.014s	sys 0.046s
W20260709 13:07:05.144178 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 674318us
I20260709 13:07:05.144591 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 1012) took 1291 ms. Trace:
I20260709 13:07:05.145787 15407 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:05.147107 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 429651us
I20260709 13:07:05.148435 15589 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:05.150274 21281 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.157006 21180 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:04.994619 21219 consensus_meta.cc:287] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.001s
I20260709 13:07:05.160619 21219 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.156617 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:05.043255 21315 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.151232 21281 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.072531 21395 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:05.232734 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 98860.3us
I20260709 13:07:05.234691 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:05.135223 15517 rpcz_store.cc:276] 0709 13:07:03.645690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.982427 (+336737us) service_pool.cc:224] Handling call
0709 13:07:04.022259 (+ 39832us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:04.022833 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.022872 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:04.023715 (+   843us) log.cc:844] Serialized 52 byte log entry
0709 13:07:04.290150 (+266435us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:04.290200 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.291693 (+  1493us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.133678 (+841985us) raft_consensus.cc:1685] finished
0709 13:07:05.133722 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.134199 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3857,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8960,"thread_start_us":206837,"threads_started":1,"wal-append.queue_time_us":721870}
I20260709 13:07:05.239872 21219 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.242059 21281 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.243772 21359 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18.
I20260709 13:07:05.244117 15587 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:05.245136 21468 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.145349 15590 rpcz_store.cc:276] 0709 13:07:03.852657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.854700 (+  2043us) service_pool.cc:224] Handling call
0709 13:07:03.855097 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.100444 (+245347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.100482 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.100991 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.674471 (+573480us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:04.674536 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.796407 (+121871us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000c0654. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:04.796489 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.143557 (+347068us) raft_consensus.cc:1685] finished
0709 13:07:05.143615 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.144161 (+   546us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34548,"raft.queue_time_us":16395,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":38558,"spinlock_wait_cycles":527468288,"thread_start_us":485346,"threads_started":1,"wal-append.queue_time_us":629953}
I20260709 13:07:05.246296 21468 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:05.247078 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 101680us
I20260709 13:07:05.079336 21457 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:05.245091 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 102517us
I20260709 13:07:05.258229 21371 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:07:05.259804 21472 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:05.262537 21472 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:05.263854 16146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.004s	sys 0.012s
W20260709 13:07:05.264595 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 135873us
I20260709 13:07:05.267270 21290 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:05.270367 15406 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
W20260709 13:07:05.269279 16146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.004s	sys 0.013s
I20260709 13:07:05.277720 21290 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:05.280236 21290 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:05.284940 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49988.8us
I20260709 13:07:05.281876 15406 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:05.285609 15440 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:05.286507 21428 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:05.287400 21428 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:05.248968 21468 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.287931 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.288146 21458 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:05.288790 21458 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.289198 21458 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:05.289086 21428 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.290308 21468 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.295815 21468 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:05.300753 21460 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:05.301213 21460 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:05.302552 21460 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.297559 15517 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:05.298502 21420 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:05.309329 21395 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.324321 21146 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:05.325019 21474 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 13:07:05.325418 21146 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.326947 21460 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:05.333243 21146 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.334111 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2778) took 1226 ms. Trace:
I20260709 13:07:05.336665 15438 rpcz_store.cc:276] 0709 13:07:04.107297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.107487 (+   190us) service_pool.cc:224] Handling call
0709 13:07:04.107805 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.376299 (+268494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.333479 (+957180us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002b1e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:05.333910 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562256768}
I20260709 13:07:05.340392 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:05.341346 15518 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:05.343713 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.345008 21180 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:05.350180 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 641941us
I20260709 13:07:05.358918 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:05.359227 21472 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.359833 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.364377 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:05.365844 15438 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:07:05.366662 21447 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:05.367164 21447 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:05.379141 21395 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.380447 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:05.380331 21395 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.384418 21395 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.391625 21300 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.392740 21300 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.393734 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:05.394488 15517 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:05.397626 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:05.403887 21451 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.697s	user 0.011s	sys 0.018s
I20260709 13:07:05.404889 15509 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:05.406625 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:05.406983 21395 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:05.407776 15511 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:05.408829 15442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 2786) took 1263 ms. Trace:
I20260709 13:07:05.409281 15442 rpcz_store.cc:276] 0709 13:07:04.144809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.146365 (+  1556us) service_pool.cc:224] Handling call
0709 13:07:05.408412 (+1262047us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000a4e54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:05.408591 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451085568}
I20260709 13:07:05.411791 21447 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.415565 21371 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:05.416374 21371 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:05.414407 21447 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:05.417887 21371 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.420888 21300 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.386127 21458 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.423889 16174 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:05.408010 21395 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.432899 21371 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:05.433981 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
W20260709 13:07:05.453295 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 113809us
I20260709 13:07:05.461032 15517 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:05.460937 21458 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.465260 21180 raft_consensus.cc:2764] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:07:05.480482 21468 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:05.481626 21436 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.562s	user 0.000s	sys 0.025s
I20260709 13:07:05.483978 21428 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:05.480803 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:05.484503 21428 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:05.485734 21290 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:05.489579 21300 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:05.502684 21300 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.492543 21479 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:05.504299 21479 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.505657 21354 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.506718 21300 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.488718 21428 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.495982 21235 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:05.508035 21235 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.508440 21479 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:05.510577 21449 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.592s	user 0.012s	sys 0.012s
I20260709 13:07:05.510928 21269 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.511083 21235 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:05.513538 21483 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 13:07:05.514180 15589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3369) took 1377 ms. Trace:
I20260709 13:07:05.514672 15589 rpcz_store.cc:276] 0709 13:07:04.136436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.152538 (+ 16102us) service_pool.cc:224] Handling call
0709 13:07:04.153186 (+   648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.149222 (+996036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.513729 (+364507us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540028a0d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:05.514071 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286941056}
I20260709 13:07:05.497241 15583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3378) took 1132 ms. Trace:
I20260709 13:07:05.499238 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:05.515751 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 158505us
W20260709 13:07:05.496428 21450 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.574s	user 0.008s	sys 0.028s
I20260709 13:07:05.484493 21395 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.520308 21377 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.520522 21419 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:05.517210 15583 rpcz_store.cc:276] 0709 13:07:04.364618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.367228 (+  2610us) service_pool.cc:224] Handling call
0709 13:07:04.367683 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:04.374491 (+  6808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.374526 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:04.434892 (+ 60366us) log.cc:844] Serialized 52 byte log entry
0709 13:07:04.784240 (+349348us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:04.795915 (+ 11675us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.796943 (+  1028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.797081 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.492456 (+695375us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b1800369c40. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:07:05.496665 (+  4209us) raft_consensus.cc:1685] finished
0709 13:07:05.496831 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.497046 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18202,"prepare.queue_time_us":11190,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":2660,"raft.queue_time_us":271671,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":10877,"spinlock_wait_cycles":4213504,"thread_start_us":202804,"threads_started":1,"wal-append.queue_time_us":366790}
I20260709 13:07:05.521334 21419 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:05.522277 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.491906 21446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.016s	sys 0.019s
W20260709 13:07:05.523007 21446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.016s	sys 0.020s
I20260709 13:07:05.524134 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3573) took 1484 ms. Trace:
I20260709 13:07:05.524544 15512 rpcz_store.cc:276] 0709 13:07:04.039639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.094511 (+ 54872us) service_pool.cc:224] Handling call
0709 13:07:04.094835 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.166613 (+ 71778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.166650 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.167172 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.264721 (+ 97549us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b1800257620. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:07:04.474678 (+209957us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:04.474723 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.666293 (+191570us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b5400377dd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:04.666385 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.495141 (+828756us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:05.523631 (+ 28490us) raft_consensus.cc:1685] finished
0709 13:07:05.523656 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.523914 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":596,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":15522,"spinlock_wait_cycles":185137536,"thread_start_us":209669,"threads_started":1,"wal-append.queue_time_us":748060}
I20260709 13:07:05.523877 21286 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:05.526455 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.528220 21377 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:05.528420 21419 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.528905 21377 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:05.530526 21377 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.530956 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.538586 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:05.541432 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:05.542280 21366 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:05.542906 21366 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:05.494995 21290 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.538034 21180 raft_consensus.cc:2764] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:05.547341 15517 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 8.
I20260709 13:07:05.559684 21488 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:05.551343 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.564791 21407 raft_consensus.cc:2764] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:05.565235 16145 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:05.566521 21269 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:05.567098 21269 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.567669 21269 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:05.568069 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.569926 21407 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:05.571838 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.573194 21428 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:05.563046 21225 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.554971 21208 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:05.574788 21407 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:05.575817 21407 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:05.575783 21208 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.577073 21407 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.564275 21488 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.551182 21366 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.581348 21488 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.584052 21366 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:05.536723 21235 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:05.596566 21300 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.547679 21482 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.210s	user 0.003s	sys 0.000s
I20260709 13:07:05.599027 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.599694 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.601003 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:05.603746 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:05.603961 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.607162 15509 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:05.609283 21461 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.609923 21488 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:05.610055 21479 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:05.633793 15518 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:05.658810 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:05.664070 21225 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:05.670107 15516 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:05.658663 21461 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.655599 21488 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:05.688593 21488 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.690167 16178 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:05.673056 21225 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.661716 21235 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.674494 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:05.677362 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:05.680765 20484 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:05.682255 15442 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:05.682533 16146 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:05.671454 21359 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:05.667750 21300 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.664420 21479 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.668450 21446 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.717496 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:05.718374 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:05.665148 21208 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.663956 21354 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:05.697724 21416 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:07:05.721230 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 48790.1us
W20260709 13:07:05.725040 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52937.9us
I20260709 13:07:05.727458 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:05.729120 21468 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:05.724766 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47473.5us
I20260709 13:07:05.733315 15516 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:05.690231 21488 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:05.746363 21235 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.746867 21410 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:05.729691 21359 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.743515 15406 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:05.753364 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:05.747241 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:05.754742 15589 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:07:05.755614 15583 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:05.754477 21354 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.759980 15588 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 9.
I20260709 13:07:05.755734 15589 pending_rounds.cc:85] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 7
I20260709 13:07:05.740361 21468 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:05.760921 15589 pending_rounds.cc:107] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:07:05.762665 15589 raft_consensus.cc:2889] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.762096 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:05.765559 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:05.763763 21354 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.740605 21460 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:05.736362 21377 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:05.739705 21446 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.769855 21448 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:05.768565 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:05.763985 21468 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:05.771178 21300 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.762296 21290 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.776360 21479 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.778074 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:05.773604 21461 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.780686 21448 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:05.784493 21448 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.785873 15588 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:07:05.786367 15588 pending_rounds.cc:85] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 9
I20260709 13:07:05.786716 15588 pending_rounds.cc:107] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:07:05.786926 15586 raft_consensus.cc:2410] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:07:05.787699 15588 raft_consensus.cc:2889] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.788385 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:05.780553 21407 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:05.792259 15592 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:05.793476 21446 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.794066 21446 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:05.794669 21446 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.798257 21460 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.801829 15592 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:05.802743 21479 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:05.802989 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 49681.7us
W20260709 13:07:05.808573 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 126189us
I20260709 13:07:05.810207 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:05.812589 21479 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:05.814132 21479 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.816319 21377 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:05.817360 21377 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:05.823463 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.828365 21464 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.829097 21464 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.842161 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:05.853118 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.853140 21300 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.868187 21359 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.868857 21300 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.840894 21208 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:05.871503 21300 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.872862 21337 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:05.873638 21464 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.879503 21337 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.881413 15590 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:05.877449 20484 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:05.877295 21410 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:05.882582 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.882658 21410 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.883942 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.885046 21410 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.879904 21359 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.890058 21337 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:05.878260 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43968.6us
I20260709 13:07:05.892990 21359 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:05.893285 21468 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.827849 21269 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:05.896267 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.904996 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:05.859207 21460 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.910441 20484 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:05.913231 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.900817 21225 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:05.895519 21468 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:05.918602 15589 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:05.920244 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.926059 15439 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:05.924919 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.928143 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.917500 21407 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:05.931516 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.932109 21300 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:05.932765 21371 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:05.933732 21300 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:05.934134 21300 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:05.929510 15440 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:07:05.937206 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:07:05.942449 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47015.3us
I20260709 13:07:05.945114 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.946511 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:05.936246 21460 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.946973 15440 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:05.922593 21416 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:07:05.961938 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.964182 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:05.946573 21446 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:05.974466 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:05.974944 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 281075us
I20260709 13:07:05.977533 21354 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:05.973101 15518 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:05.981827 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:05.983387 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:05.985563 15586 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:05.964109 21208 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:05.986742 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:05.984723 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47948.5us
I20260709 13:07:05.984362 20484 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:05.973856 21479 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:06.000747 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:06.008633 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:06.003716 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.004053 15443 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:06.003945 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:05.995373 21366 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:06.013006 20706 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:06.013691 20706 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.013851 21300 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.015183 21300 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:06.015108 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:05.968909 21460 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.032207 15589 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:06.032526 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:06.031987 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:06.035724 15439 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.038156 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:06.039192 15589 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.060563 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:06.008975 21458 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.063342 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 67402.6us
I20260709 13:07:06.074995 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.081979 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:06.082790 15511 raft_consensus.cc:3060] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.083444 15591 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 20: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:06.071651 20706 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:06.086725 15589 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:07:06.034952 21269 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:06.088433 16146 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:06.003786 21208 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.096741 15518 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:06.077421 21366 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:06.108237 15584 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:07:06.108750 15584 pending_rounds.cc:85] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 10
I20260709 13:07:06.108259 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:06.109345 15584 pending_rounds.cc:107] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:07:06.109633 15584 raft_consensus.cc:2889] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:06.115592 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 114948us
I20260709 13:07:06.064301 21354 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.112703 15437 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:06.122164 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.123167 15442 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
W20260709 13:07:06.124742 21496 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:07:06.132714 21495 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:06.122215 21498 raft_consensus.cc:2804] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:06.134783 21498 raft_consensus.cc:697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 10 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:06.135952 21498 consensus_queue.cc:237] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.140197 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.141098 21505 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:06.141726 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.106822 21446 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.141108 15441 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:06.102087 21458 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.144904 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:06.151955 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.169219 15438 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:06.170528 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.172235 15518 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:06.173298 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:06.173846 15518 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.179728 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.181499 15584 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:06.185531 15439 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:06.189033 15583 raft_consensus.cc:2410] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:07:06.156981 21290 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.181094 21354 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:06.152452 21446 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.195531 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:06.212810 16179 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 17: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:06.215900 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:07:06.218797 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 99815.5us
I20260709 13:07:06.224047 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:06.225854 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.221874 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.211661 21446 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.195209 21290 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.235111 15584 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:06.246858 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:06.246907 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:06.242980 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:06.224633 21208 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:06.257784 16179 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 14: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:06.250321 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:06.268378 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:06.265589 15590 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:06.275396 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48384.1us
I20260709 13:07:06.269778 15587 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:06.278625 16178 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:06.284622 21398 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:06.285468 21460 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:06.286507 21500 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
I20260709 13:07:06.231485 21354 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:06.291711 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.270718 21235 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.293138 21235 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:06.293563 21235 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.235435 21366 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:06.299209 15518 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
W20260709 13:07:06.317770 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 74884.3us
I20260709 13:07:06.318045 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.276928 21208 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:06.320883 15441 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:06.322182 15435 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:07:06.327270 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.306118 21225 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:06.329561 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.324256 21208 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:06.326557 21371 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.331094 21225 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.341055 21208 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.362273 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.364013 21290 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:06.365411 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:06.334992 21337 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:06.376363 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.378176 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.346096 21225 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:06.366088 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:06.392095 16174 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.394217 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.387897 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:06.399034 15440 raft_consensus.cc:606] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:06.401912 16178 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:06.395066 21290 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:06.345515 21371 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: false } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.394523 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.436733 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.437835 21461 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:06.341732 21398 consensus_queue.cc:1059] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 13:07:06.364058 21349 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:07:06.462265 21506 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.463018 21506 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:06.442975 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.465894 21506 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:07:06.446264 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.466653 21506 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.446434 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.467828 15590 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:06.467336 21506 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:06.447144 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 81143.2us
I20260709 13:07:06.469617 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:06.469646 21461 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:06.470831 21506 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:06.471639 21461 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.472167 21461 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.472576 21461 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.448743 21371 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:06.423372 21460 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:07:06.449883 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.454053 15589 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:06.387346 21509 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:06.456980 15587 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:06.390252 21366 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.454849 21446 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:06.488757 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:06.489461 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 92022.3us
W20260709 13:07:06.485046 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 140675us
I20260709 13:07:06.484014 15511 raft_consensus.cc:2468] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 10.
I20260709 13:07:06.486295 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:06.493360 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.494047 15510 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:06.494304 21270 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.495082 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:06.493456 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 68276.6us
I20260709 13:07:06.496457 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:06.497895 21225 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.498466 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:06.498380 21447 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:06.498888 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.499800 21270 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:06.487339 21509 consensus_queue.cc:1243] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:06.500187 21270 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:06.500644 21270 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.501438 21315 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:06.501869 21315 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.502197 15592 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:07:06.502207 21315 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:06.504527 21208 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.506799 21416 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:06.508066 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:06.490067 15513 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:06.507817 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:06.509473 15510 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:06.568463 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.569932 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.576519 15517 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.558063 21269 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:06.527740 21458 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:06.595678 21505 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.596429 21505 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:06.598280 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.600571 21208 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:06.600790 21354 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:06.585777 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 89771us
I20260709 13:07:06.605193 15407 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:06.580574 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.610286 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.611884 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.587242 15437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:06.587513 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.589032 21446 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:06.557621 21488 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:06.522343 21371 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:07:06.592378 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:06.592597 15443 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.587262 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.587285 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.593546 15435 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:06.610428 21460 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:06.649842 15437 raft_consensus.cc:606] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:06.623790 21447 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:06.640079 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.566833 21300 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.667356 15509 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:06.669879 15510 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:06.692343 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.674722 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:06.599294 21505 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:06.723805 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.697849 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:06.727478 15442 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:06.728796 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.732937 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.735586 15511 raft_consensus.cc:2410] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:06.680282 21349 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:06.737989 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.738336 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.738039 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.746212 15513 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:06.746721 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.739512 15441 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:06.746623 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.748385 15518 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:06.748708 15510 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:07:06.657357 21225 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:06.741600 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.750834 15441 raft_consensus.cc:2393] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:06.751919 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:06.756693 15513 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:06.672443 21488 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:06.776062 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.775163 15518 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:06.665746 21235 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.662691 21461 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.747793 21354 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:06.783916 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 109295us
I20260709 13:07:06.651481 21315 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.812522 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:06.813675 15510 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:06.818166 15438 raft_consensus.cc:2376] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18. Re-sending same reply.
I20260709 13:07:06.721370 21300 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.770969 21488 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:06.822623 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:06.841820 15434 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.823027 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:06.824290 15326 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet 5b97fcd3d908482fadc6fa54e513304d with cas_config_opid_index 6 failed: Not found: failed to reset TS proxy: No leader found: Tablet 5b97fcd3d908482fadc6fa54e513304d consensus state has no leader
I20260709 13:07:06.829154 15584 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.828977 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.843731 16181 raft_consensus.cc:2410] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:06.830344 16174 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:06.831297 21315 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:06.832046 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:06.833256 15439 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:06.833889 15436 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:06.763298 21349 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:06.858982 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:06.860831 15438 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:06.864045 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:06.877218 16175 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:06.877616 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.878580 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.879259 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:06.886296 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.878407 15589 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:07:06.878575 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.879521 15587 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:06.888258 15589 pending_rounds.cc:85] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 9
I20260709 13:07:06.891804 15589 pending_rounds.cc:107] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:07:06.892002 15591 raft_consensus.cc:2410] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:06.892071 15589 raft_consensus.cc:2889] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.892534 15589 pending_rounds.cc:107] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:07:06.892767 15589 raft_consensus.cc:2889] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.880716 21458 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:07:06.898178 21319 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:06.898736 21319 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:06.900300 21225 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:06.900864 21225 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:06.902144 21225 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.905494 15517 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:06.906805 15517 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:07:06.856984 21460 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:06.871480 21531 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:06.908874 21531 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.909333 21337 raft_consensus.cc:3055] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:06.909727 21337 raft_consensus.cc:740] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:06.910599 21337 consensus_queue.cc:260] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:06.912398 21521 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:07:06.918525 21235 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:06.849815 21428 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:07:06.920056 21428 consensus_queue.cc:1243] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:06.926285 21514 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:06.928200 21270 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.930459 21270 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:06.931916 21300 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:06.873999 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:06.900859 21461 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:06.934966 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:06.935717 15438 raft_consensus.cc:606] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:06.936611 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.937541 15510 raft_consensus.cc:2410] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:06.939697 21531 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:06.869563 21366 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.942101 21337 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:06.942011 21366 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.934918 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.893702 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:06.948215 15509 raft_consensus.cc:2410] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:07:06.949012 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 55397.8us
I20260709 13:07:06.841610 21505 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:07:06.967250 20706 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.967584 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.968142 20706 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:06.971993 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:06.973842 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.974543 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.976768 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.980379 15586 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:06.984293 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:06.985325 15443 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:06.988221 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:06.985044 21319 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:06.995347 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.001137 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:07.003216 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.004228 15434 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:07.021462 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:06.975426 21498 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.981273 21270 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:07.022460 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:06.978003 21366 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:07.021433 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:07:07.032013 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 65535.1us
I20260709 13:07:07.035723 15509 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:07.021876 21461 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:07:07.049018 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.049237 21461 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:07.049638 21461 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:07:07.018460 15555 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.508s (SENT) [suppressed 17 similar messages]
I20260709 13:07:07.051014 21340 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:07.050747 21461 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:07.055354 21461 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.056772 21225 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.020231 21349 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:07.061966 21528 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:07.063428 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.002954 21208 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:07.071600 20706 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:07.072541 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.073233 15509 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:07.079417 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.081935 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.083585 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.083809 15442 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:07.084669 15511 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:07.085615 15435 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 13:07:07.096132 15510 raft_consensus.cc:1275] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:07.097303 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:07.098125 15512 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:07.099081 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 79354.5us
I20260709 13:07:07.116941 15518 raft_consensus.cc:1275] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:07.117240 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:07.118440 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 85186.7us
I20260709 13:07:07.118921 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:07.133049 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d40d294abeec453098d547799a79f7c5"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:07.138154 15513 pending_rounds.cc:85] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 4
I20260709 13:07:07.138751 15513 pending_rounds.cc:107] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:07.070894 21208 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:07.142129 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:07.139334 15513 raft_consensus.cc:2889] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.139729 15482 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:07.144765 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 191066us
W20260709 13:07:07.161813 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 61762.9us
I20260709 13:07:07.167459 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:07.168097 15438 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:07.169037 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:07.169230 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:07.174134 21180 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:07.176687 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3610) took 1043 ms. Trace:
I20260709 13:07:07.155822 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:07.178937 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:07.180311 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:07.181207 15436 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:07.182459 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 63065.3us
I20260709 13:07:07.183298 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:07.177121 15516 rpcz_store.cc:276] 0709 13:07:06.133266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.135284 (+  2018us) service_pool.cc:224] Handling call
0709 13:07:06.506140 (+370856us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:07:06.506349 (+   209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.506794 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.506826 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.507267 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.770442 (+263175us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:06.770546 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.770649 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.061390 (+290741us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:07.176395 (+115005us) raft_consensus.cc:1685] finished
0709 13:07:07.176427 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.176600 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1837,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":43592,"spinlock_wait_cycles":117705216,"thread_start_us":262661,"threads_started":1,"wal-append.queue_time_us":353132}
I20260709 13:07:07.185300 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:07.187318 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:07.067791 21498 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:07.189100 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.190313 21468 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:07.194353 20484 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:07.139221 21537 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:07.200482 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 60975.1us
I20260709 13:07:07.209308 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:07.219893 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:07.197445 21531 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.229120 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 210695us
I20260709 13:07:07.211076 21468 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:07.241364 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
W20260709 13:07:07.228973 21269 consensus_meta.cc:287] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.577s	user 0.015s	sys 0.000s
W20260709 13:07:07.257037 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 61665.5us
I20260709 13:07:07.264242 15406 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:07.231838 21371 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:07.274816 15442 raft_consensus.cc:606] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:07.278110 15437 raft_consensus.cc:1240] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:07.327893 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 47426.6us
I20260709 13:07:07.269070 21366 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:07.274194 21269 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:07.335093 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 103934us
I20260709 13:07:07.233632 21531 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:07.332299 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.279502 21235 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:07.359581 20484 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:07.246461 21446 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:07.283952 21532 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.284123 21534 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:07.241251 21208 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:07.285831 21371 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:07:07.357757 21533 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 13:07:07.368739 20484 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:07.382112 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.382946 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:07.334684 21366 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:07.416867 20484 consensus_queue.cc:1243] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:07.420055 21517 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:07:07.362413 21300 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:07.283866 21529 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.184s
I20260709 13:07:07.432358 15436 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 18.
I20260709 13:07:07.355792 21349 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:07:07.458323 21446 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.459697 16182 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:07.454358 20706 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:07.455229 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.381462 21534 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:07.365185 21235 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:07.474694 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51704.9us
I20260709 13:07:07.441628 21290 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:07.411245 21366 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.511363 21529 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:07.512077 21538 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:07:07.441476 21180 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:07.514945 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.524220 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 53264.7us
W20260709 13:07:07.498637 21519 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:07.459105 21446 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:07.441476 21464 consensus_queue.cc:1059] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
W20260709 13:07:07.527779 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 144934us
I20260709 13:07:07.474372 21555 raft_consensus.cc:993] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
W20260709 13:07:07.527204 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 88016.3us
I20260709 13:07:07.541181 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.433701 21398 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:07:07.500589 21479 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:07.384338 21468 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:07.368160 21532 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:07.551362 15510 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:07.455343 21300 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:07.548861 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 363652us
I20260709 13:07:07.563426 21416 raft_consensus.cc:1081] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:07.534493 21371 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:07.563738 21286 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.615177 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:07.569247 21543 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:07:07.570467 21545 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:07:07.572163 15518 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:07.573457 15509 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:07.530543 21529 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:07.608075 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:07.609741 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.523226 21530 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:07:07.631736 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:07.638415 21542 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:07:07.575672 21479 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:07.641189 21554 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:07.641640 21479 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:07.634718 21550 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:07:07.637934 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 59750.2us
I20260709 13:07:07.693435 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:07.650732 21428 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:07.647586 21180 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:07.702798 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 87700.5us
I20260709 13:07:07.705972 15584 raft_consensus.cc:1275] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:07.619315 21286 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:07.643167 21498 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:07.709357 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:07.702349 21447 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.715772 21562 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:07.716176 21447 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:07.710079 15588 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:07.646210 21416 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:07:07.718771 21447 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:07.804176 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 73824.5us
I20260709 13:07:07.727769 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:07.701113 21446 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:07.747658 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.620858 21534 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:07.767522 15440 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:07.768507 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:07.771430 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:07.772194 21548 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.354s	user 0.004s	sys 0.000s
I20260709 13:07:07.774686 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:07.777575 21509 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:07.778806 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:07.781236 21208 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:07.795290 15512 consensus_meta.cc:287] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.653s	user 0.014s	sys 0.000s
W20260709 13:07:07.764403 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 191247us
I20260709 13:07:07.813242 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:07.814889 15434 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:07:07.825166 15512 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
W20260709 13:07:07.821834 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 175478us
I20260709 13:07:07.831164 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:07.819113 21553 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:07.722294 21458 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.103s
W20260709 13:07:07.842967 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 62716.1us
W20260709 13:07:07.864817 15555 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.563s (SENT)
I20260709 13:07:07.867925 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:07.820941 21509 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:07.809177 21270 consensus_queue.cc:1048] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:07.824329 21235 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:07.875384 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:07.862391 16146 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:07.882120 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:07.831333 21410 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:07.704198 21529 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:07.842831 21416 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:07.887359 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:07.901464 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:07.955417 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.890836 21269 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:07.964241 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:07.965271 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:07.900184 21300 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:07.979173 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:07.986227 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.957109 21532 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:07.964924 21527 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:07.904876 21410 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:07.873240 21553 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:08.025820 21538 log.cc:927] Time spent T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:07:08.040117 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 207689us
I20260709 13:07:08.042922 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:08.026475 21300 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:08.045969 20484 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:08.046609 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:08.047724 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:08.048955 21535 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
W20260709 13:07:08.049553 21488 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.178s	user 0.019s	sys 0.002s
I20260709 13:07:08.050256 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3626) took 1386 ms. Trace:
I20260709 13:07:08.050633 15514 rpcz_store.cc:276] 0709 13:07:06.664298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.818047 (+153749us) service_pool.cc:224] Handling call
0709 13:07:06.826170 (+  8123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.826576 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.826611 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.827205 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.126756 (+299551us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.126804 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.126905 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.050004 (+923099us) raft_consensus.cc:1685] finished
0709 13:07:08.050030 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.050190 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1201,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":299113,"threads_started":1,"wal-append.queue_time_us":710107}
I20260709 13:07:08.051966 21577 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:08.052575 21577 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.054847 21577 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:08.056447 15514 raft_consensus.cc:3055] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:08.056902 15514 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:07:08.059259 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 94086.3us
I20260709 13:07:08.035991 21479 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:08.035861 21458 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:08.081018 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:08.080479 20484 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:08.056134 21571 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:07:08.055760 21337 consensus_queue.cc:1059] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:07:08.065210 15514 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.079596 21573 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:08.063782 21488 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.051527 21583 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:08.099720 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:08.101272 15514 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.111037 15514 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:07:08.092115 21574 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:07:08.026108 21509 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:08.093097 21582 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:08.093510 21354 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:08.094801 21428 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:08.131381 21516 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 13:07:08.133410 21515 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:07:08.135695 21588 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:08.136325 21588 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.136809 21588 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:08.045533 21527 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:07:08.091096 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 226330us
I20260709 13:07:08.140913 21553 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:08.125350 15592 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 19: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:07:08.141793 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.092027 21286 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:08.142266 15555 leader_election.cc:336] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.740s (SENT)
I20260709 13:07:08.145141 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:08.140542 21527 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.147610 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:08.157387 21225 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 1.100s	user 0.016s	sys 0.000s
I20260709 13:07:08.162575 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:08.147258 21447 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.164487 15443 raft_consensus.cc:606] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:08.165709 21225 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:08.166047 21581 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:08.166383 21585 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.167876 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 125473us
I20260709 13:07:08.125311 21514 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:07:08.173905 21566 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.474s	user 0.006s	sys 0.005s
I20260709 13:07:08.142303 21577 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:08.184593 21488 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:08.182317 21585 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.196137 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:08.191054 21410 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:08.153359 21354 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.213476 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2612) took 1218 ms. Trace:
I20260709 13:07:08.178717 21447 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.220890 21447 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:08.222524 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 126894us
I20260709 13:07:08.224123 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:08.224752 15435 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:08.203435 21573 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:07:08.228276 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86046.9us
W20260709 13:07:08.221828 21366 consensus_meta.cc:287] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.008s
I20260709 13:07:08.214200 15513 rpcz_store.cc:276] 0709 13:07:06.994887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.101653 (+106766us) service_pool.cc:224] Handling call
0709 13:07:07.137885 (+ 36232us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:07.441731 (+303846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.441768 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:07.442452 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 13:07:07.613900 (+171448us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:07.613941 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.614013 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.173103 (+559090us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:08.212980 (+ 39877us) raft_consensus.cc:1685] finished
0709 13:07:08.213015 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.213387 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1801,"raft.queue_time_us":1125,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10443,"spinlock_wait_cycles":7276800,"thread_start_us":290272,"threads_started":2,"wal-append.queue_time_us":151054}
I20260709 13:07:08.233695 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:08.235646 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:08.211213 21553 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:08.239691 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 62445.7us
I20260709 13:07:08.240478 21585 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:08.237723 21269 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:07:08.256686 15482 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:08.243098 21354 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:08.262651 21531 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:08.264473 21596 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:08.252514 21366 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.265583 21464 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.276196 21366 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:08.276906 15516 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:08.280611 16173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:08.281423 16173 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:08.272302 21553 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.310591 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:08.316514 21354 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:08.317029 21354 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.317387 21354 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:08.317732 21208 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:08.319017 21428 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:08.319973 20484 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:08.320356 20484 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:08.321179 20484 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.323459 21468 raft_consensus.cc:993] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:08.324013 21468 raft_consensus.cc:1081] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:08.311287 21540 raft_consensus.cc:3055] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:08.321180 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.333189 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:08.334137 21446 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:08.334544 21446 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.334887 21446 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:08.335099 21561 log.cc:927] Time spent T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.582s	user 0.013s	sys 0.000s
I20260709 13:07:08.336438 15511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2611) took 1341 ms. Trace:
W20260709 13:07:08.337037 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 60429us
I20260709 13:07:08.336833 15511 rpcz_store.cc:276] 0709 13:07:06.994630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.085712 (+ 91082us) service_pool.cc:224] Handling call
0709 13:07:07.086160 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.087109 (+   949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.087154 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.141484 (+ 54330us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.525556 (+384072us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.635518 (+109962us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.645650 (+ 10132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.645726 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.285616 (+639890us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:08.336146 (+ 50530us) raft_consensus.cc:1685] finished
0709 13:07:08.336252 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.336379 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12020,"prepare.queue_time_us":136636,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":253,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":253,"spinlock_wait_cycles":172490880,"thread_start_us":442333,"threads_started":2,"wal-append.queue_time_us":446143}
I20260709 13:07:08.363826 21398 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:08.370361 21398 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.372797 21398 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:08.374127 15592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 3409) took 1498 ms (client timeout 1846 ms). Trace:
W20260709 13:07:08.374607 15592 rpcz_store.cc:269] 0709 13:07:06.876001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.878098 (+  2097us) service_pool.cc:224] Handling call
0709 13:07:08.373895 (+1495797us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540028b4d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:08.374030 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2841087232}
I20260709 13:07:08.375662 21366 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:08.384172 16173 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:08.388541 21366 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:08.390605 21366 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:08.391003 21366 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:08.392077 21366 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.393481 21366 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:08.394075 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:08.395653 21180 consensus_queue.cc:1059] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:08.396544 21180 consensus_queue.cc:1243] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:08.396930 16179 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:08.397050 21180 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:08.397502 21180 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:08.398000 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:08.398898 15438 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 14: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:08.398443 21180 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.329116 21540 raft_consensus.cc:740] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:08.400434 21540 consensus_queue.cc:260] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.401846 21529 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:08.403888 15436 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:08.405078 21180 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:08.406837 21319 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:08.405332 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:08.408411 21319 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:08.408818 21319 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:08.409793 21319 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.412081 21509 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:08.411362 21319 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.417017 21540 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.420253 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:08.420552 21599 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:07:08.421384 21588 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.423588 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:08.424929 21517 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:08.429055 15585 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:07:08.419166 21354 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.429551 15585 pending_rounds.cc:85] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 9
I20260709 13:07:08.429849 15585 pending_rounds.cc:107] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:07:08.430099 15585 raft_consensus.cc:2889] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.433507 15586 pending_rounds.cc:85] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 9
I20260709 13:07:08.433867 15586 pending_rounds.cc:107] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 11.10
I20260709 13:07:08.435585 15586 raft_consensus.cc:2917] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Aborting config change with OpId 11.10: Aborted: Op aborted by new leader
I20260709 13:07:08.436093 15586 raft_consensus.cc:2889] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.437004 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:08.449106 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:08.451795 15436 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:07:08.452574 15436 pending_rounds.cc:85] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 6
I20260709 13:07:08.453150 15436 pending_rounds.cc:107] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:07:08.453603 15436 raft_consensus.cc:2889] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.455523 15592 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:08.455732 15585 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:08.455762 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:08.448642 15555 leader_election.cc:336] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.070s (SENT)
I20260709 13:07:08.459280 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:08.460311 15584 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:08.460182 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:08.441165 21354 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:08.461843 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.436143 21235 raft_consensus.cc:2764] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:07:08.496201 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.495827 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:08.497674 15590 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 17: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:08.498468 15588 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:08.440129 21446 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.507208 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:08.514024 21591 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.514905 21591 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.518440 21591 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:08.519112 21591 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:08.520414 21591 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.522620 21591 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:08.525167 15586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48420 (request call id 0) took 29165 ms. Trace:
W20260709 13:07:08.535667 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.540248 21598 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:08.540606 21588 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:08.540944 21598 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:08.542848 21607 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:08.462453 21573 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.545720 15587 raft_consensus.cc:1240] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 19. Current term is 21. Ops: []
W20260709 13:07:08.548357 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 99782.9us
I20260709 13:07:08.510951 21235 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:08.504928 21553 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:08.554656 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:08.560770 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.565697 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:08.566493 15588 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:08.567435 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:08.584429 21553 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.596596 15588 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:08.597321 21290 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:08.597811 21290 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.598017 21553 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:08.525765 15586 rpcz_store.cc:276] 0709 13:06:39.333406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.481762 (+148356us) service_pool.cc:224] Handling call
0709 13:06:39.511491 (+ 29729us) log.cc:844] Serialized 564 byte log entry
0709 13:06:40.332466 (+820975us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b1800469c60. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c382a6 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd0142 00007fcf7bcb0eaa 00007fcf7bcb7d53
0709 13:06:40.333231 (+   765us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54004b03a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd0142 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354 000000000038f199 00007fcf78c6a475
0709 13:06:40.335470 (+  2239us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b54004b03a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd7b26 00007fcf7bcd149a 00007fcf7bcd0714 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354
0709 13:06:40.638506 (+303036us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54004b03a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd0142 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354 000000000038f199 00007fcf78c6a475
0709 13:07:08.492017 (+27853511us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40868,"raft.queue_time_us":20014,"raft.run_cpu_time_us":19979,"raft.run_wall_time_us":2427102,"spinlock_wait_cycles":161345280,"thread_start_us":83535,"threads_started":1,"wal-append.queue_time_us":212725,"wal-append.run_cpu_time_us":2219,"wal-append.run_wall_time_us":1021417}
W20260709 13:07:08.596799 21601 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.209s	user 0.003s	sys 0.000s
I20260709 13:07:08.543469 21598 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:08.569343 15589 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:07:08.659751 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 60426.4us
W20260709 13:07:08.593197 21606 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:08.686645 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3646) took 1140 ms. Trace:
W20260709 13:07:08.687199 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134460us
I20260709 13:07:08.687146 15512 rpcz_store.cc:276] 0709 13:07:07.545896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.829435 (+283539us) service_pool.cc:224] Handling call
0709 13:07:07.829678 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.829837 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:08.503039 (+673202us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.686238 (+183199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.686298 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:08.686349 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.686419 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.686565 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728920,"prepare.queue_time_us":673498,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":170132,"threads_started":1}
I20260709 13:07:08.688582 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:08.593315 21446 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:08.652061 21180 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.692971 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:08.702683 15407 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:08.703177 16182 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:08.660727 21366 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:08.704562 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:08.579227 21460 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:07:08.555514 21588 consensus_queue.cc:1048] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:07:08.716848 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34302 (request call id 1306) took 1065 ms. Trace:
I20260709 13:07:08.717422 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:08.690601 21468 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.572345 21354 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 13:07:08.712841 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3647) took 1166 ms. Trace:
I20260709 13:07:08.691257 21583 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.553671 21537 consensus_queue.cc:1048] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 13:07:08.725369 15591 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:08.693094 21591 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.773434 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:08.778251 16179 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:07:08.714628 21180 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.690869 21235 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:08.741092 21603 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:08.741345 15389 auto_rebalancer.cc:893] Removing replace marker failed: Op aborted by new leader
I20260709 13:07:08.748194 21516 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:08.711849 21515 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:08.751024 21609 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:08.721239 21366 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.754267 21517 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:08.760424 21269 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.763967 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:08.764895 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:08.736557 21468 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:07:08.768057 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.771484 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.728876 15515 rpcz_store.cc:276] 0709 13:07:07.546261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.902767 (+356506us) service_pool.cc:224] Handling call
0709 13:07:07.903101 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.905357 (+  2256us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:08.503231 (+597874us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.712361 (+209130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.712420 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:08.712470 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.712572 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.712755 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622947,"prepare.queue_time_us":647393,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":20208,"thread_start_us":197606,"threads_started":1}
I20260709 13:07:08.772377 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3645) took 1227 ms. Trace:
I20260709 13:07:08.782807 20484 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:08.784639 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 96190.2us
I20260709 13:07:08.856863 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:08.722656 15514 rpcz_store.cc:276] 0709 13:07:07.651667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.117590 (+465923us) service_pool.cc:224] Handling call
0709 13:07:08.147884 (+ 30294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.148117 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:08.512277 (+364160us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.710246 (+197969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.715976 (+  5730us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:08.716029 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.716647 (+   618us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.716781 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":355360,"prepare.queue_time_us":407158,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":22013,"thread_start_us":183548,"threads_started":1}
I20260709 13:07:08.780028 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:08.772203 21349 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.770346 21337 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.806399 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:08.819787 15389 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 1915fdd81d344a749443e48f07a1fef8 already in progress
I20260709 13:07:08.792168 21563 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:08.775336 21290 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.849829 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:08.866322 15584 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:08.867777 15584 raft_consensus.cc:1240] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:08.868368 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b97fcd3d908482fadc6fa54e513304d with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:58996
I20260709 13:07:08.809464 21515 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:08.870069 21515 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:08.877390 21366 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:08.862910 16181 raft_consensus.cc:2393] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 16: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:07:08.864658 15389 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 1915fdd81d344a749443e48f07a1fef8 already in progress
W20260709 13:07:08.903388 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46634us
I20260709 13:07:08.853339 15510 rpcz_store.cc:276] 0709 13:07:07.545455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.815805 (+270350us) service_pool.cc:224] Handling call
0709 13:07:07.816254 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.817166 (+   912us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:08.502178 (+685012us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.569671 (+ 67493us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.582215 (+ 12544us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b18003cafc0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:07:08.771989 (+189774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.772046 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:08.772103 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.772176 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.772317 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":725763,"prepare.queue_time_us":729796,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":99667,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":19163,"spinlock_wait_cycles":7036544,"thread_start_us":227654,"threads_started":2,"wal-append.queue_time_us":50799}
I20260709 13:07:08.907282 16182 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:08.778155 21591 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.863620 21269 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:08.909873 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 103566us
I20260709 13:07:08.910691 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:08.802981 21235 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.887987 21509 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:08.925595 16174 raft_consensus.cc:2393] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 13: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:08.907753 21622 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:08.915922 21354 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.925487 21300 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:08.886238 21337 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.930348 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:08.939229 15588 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:08.940914 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:08.887004 21349 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.925529 21366 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:08.949095 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:08.929502 21605 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.951360 21578 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.946995 21460 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:08.928700 21509 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.937692 21354 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.951308 21621 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:08.942159 21300 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.967716 21622 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:08.975400 21460 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:08.972795 21235 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:09.008108 15437 raft_consensus.cc:2410] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:08.961366 21605 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:08.971762 21578 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:08.993175 21622 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:08.994163 21180 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.029794 21622 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.037570 21505 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:09.018345 21617 consensus_queue.cc:1059] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:09.068046 15482 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:09.051409 21269 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.054804 21591 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.044768 21621 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:09.076988 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:07:09.080351 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.508s (SENT)
I20260709 13:07:09.080938 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.085393 21235 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:09.086122 15435 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:09.087888 15442 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:09.063938 21468 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:09.056895 21366 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:09.053069 21180 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:07:09.072389 21573 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:09.104656 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.111224 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.115376 15435 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:09.113492 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.116067 15510 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:09.116175 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.113533 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.117077 15515 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:09.051427 21460 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.123464 15592 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:07:09.126173 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:09.124365 15442 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:09.133124 15592 pending_rounds.cc:85] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 12
I20260709 13:07:09.133468 15592 pending_rounds.cc:107] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:07:09.127683 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.128630 15556 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:09.134096 15592 raft_consensus.cc:2889] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.133392 15588 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:07:09.136276 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.136942 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.137534 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:09.137905 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.139811 15442 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:09.138226 15511 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:07:09.141516 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.142503 15514 raft_consensus.cc:2410] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:09.109798 21349 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.142762 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.066069 21505 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.097986 21337 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.114176 21509 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.147936 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:09.123845 21354 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.149726 15442 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:09.149700 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:09.152740 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:09.153326 15435 raft_consensus.cc:3060] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:09.138574 21588 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:09.160406 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.144814 21617 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:09.161697 21625 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:07:09.162082 21553 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:09.162652 21553 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.163054 15517 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:07:09.161309 21617 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.144865 21537 raft_consensus.cc:2804] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:09.165390 15517 pending_rounds.cc:85] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 9
I20260709 13:07:09.173265 15517 pending_rounds.cc:107] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:07:09.173609 15517 raft_consensus.cc:2889] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.165199 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.166836 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.168922 21605 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:09.169739 21578 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.170274 15512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:09.155149 21180 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.100090 21583 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:07:09.182889 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.183454 15435 raft_consensus.cc:2468] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:09.185411 15512 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:09.192094 15556 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:09.192350 15512 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:09.193037 21629 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:07:09.194602 21371 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:09.195848 21371 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:09.196076 21591 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:09.196509 21371 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:09.197242 21591 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:09.198179 21371 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.200995 15510 raft_consensus.cc:2410] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:09.201989 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.202692 15509 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:09.176209 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.187903 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.188448 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.189543 15440 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:09.191447 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:09.207585 15518 raft_consensus.cc:2410] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:07:09.212514 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.184113 21319 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:09.196199 21627 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:09.221042 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:09.218254 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:09.237231 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:09.223408 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:09.224357 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.225800 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:09.184299 21300 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.214653 21479 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:07:09.190924 21537 raft_consensus.cc:697] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:09.223315 21553 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.238771 15518 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:09.239382 15517 raft_consensus.cc:2376] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14. Re-sending same reply.
I20260709 13:07:09.236742 15590 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 13.
I20260709 13:07:09.221880 15512 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.249734 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:09.213949 21626 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.153s	user 0.000s	sys 0.004s
I20260709 13:07:09.259047 16179 raft_consensus.cc:2393] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 21: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:09.276571 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:09.235211 21319 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:09.295605 15442 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:09.297698 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.300073 15517 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:09.318540 15512 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:09.320643 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69289.8us
I20260709 13:07:09.206691 21180 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.328199 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:09.329612 15583 raft_consensus.cc:2410] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:07:09.280615 21505 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.340037 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.341476 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.342685 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.354231 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:09.291872 21319 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:09.375367 15518 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:09.379532 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:09.393206 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.565s (SENT)
I20260709 13:07:09.393786 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.394834 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:09.395900 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 207280us
W20260709 13:07:09.392318 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 178020us
I20260709 13:07:09.356263 21180 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.400852 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.404459 15512 raft_consensus.cc:2410] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:07:09.406240 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.407862 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:09.400341 21479 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:09.410276 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 88532.1us
I20260709 13:07:09.417384 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:09.420351 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.424150 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:09.425053 15512 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:09.400822 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:09.464416 15555 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.634s (SENT)
W20260709 13:07:09.463770 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 63037.4us
I20260709 13:07:09.465054 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:09.467772 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48842.7us
W20260709 13:07:09.469169 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 47570.2us
I20260709 13:07:09.470554 15511 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:09.472841 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.413838 21300 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:09.496827 21642 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:09.506256 21642 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:09.492553 21645 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.142s	user 0.000s	sys 0.005s
I20260709 13:07:09.508755 21642 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.509195 21598 raft_consensus.cc:3055] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:09.509373 21270 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:07:09.503032 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:09.512409 21636 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:07:09.512117 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.412055 21563 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:07:09.513919 15509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:09.512212 15511 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:07:09.419343 21621 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:09.509709 21598 raft_consensus.cc:740] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:07:09.523978 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 53866.3us
I20260709 13:07:09.532706 21428 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:09.400235 21537 consensus_queue.cc:237] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.536558 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.474980 21640 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:09.539479 21640 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.539951 21640 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.541525 21516 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:09.524511 21621 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.543663 21180 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:09.544323 21180 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.543728 15509 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:09.546452 15509 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:09.548105 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.506290 21371 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:09.525331 21633 log.cc:927] Time spent T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
I20260709 13:07:09.539093 15406 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:09.544651 21598 consensus_queue.cc:260] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.522794 21300 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:09.569589 15512 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:09.573971 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.575081 15512 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:09.576427 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.556555 21498 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
W20260709 13:07:09.578755 21644 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:07:09.589496 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 1.761s (SENT)
I20260709 13:07:09.592346 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.582564 21448 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:09.600809 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.588102 21598 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:09.611827 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.617111 15437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2395) took 1223 ms. Trace:
I20260709 13:07:09.616983 21300 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.617720 15437 rpcz_store.cc:276] 0709 13:07:08.393525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.393701 (+   176us) service_pool.cc:224] Handling call
0709 13:07:09.616819 (+1223118us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400269154. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:09.617039 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409489152}
I20260709 13:07:09.599931 21371 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:09.624480 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.599965 21448 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.626516 21448 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:09.597681 21642 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.628582 21642 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.613324 15441 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:09.603348 15511 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:09.608210 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.609227 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.644076 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.647576 15555 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:09.653280 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.653963 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.654676 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.658326 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.658303 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.659248 15442 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:09.659592 21605 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.660107 21562 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:09.660035 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.661079 21605 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:09.660818 21562 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.661608 15555 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.662552 21458 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.663487 21458 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.664227 21562 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.666342 21458 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.667347 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:09.656092 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.675164 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:09.677382 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:09.678031 15555 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:09.678603 16182 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.679515 16182 raft_consensus.cc:2368] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8.
I20260709 13:07:09.681582 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:09.682552 15441 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:09.683986 21605 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:09.684289 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.685770 21583 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:09.686317 21583 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.623446 21180 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.694983 21621 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.682960 15441 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:09.697470 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.689201 21583 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.701807 21588 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:09.702298 21605 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:09.704126 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.705530 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.706650 21605 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:09.708401 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.709745 21605 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:09.711310 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.712121 21583 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:09.713929 21583 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.713105 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:09.656047 21515 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.785s	user 0.016s	sys 0.001s
I20260709 13:07:09.724298 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:09.725666 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:09.654045 21642 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.723248 21180 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:09.702298 21588 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:09.745407 21588 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:09.725883 21605 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:09.669718 21537 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:09.667342 21371 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:09.748862 21371 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:09.749392 21371 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:09.736683 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:07:09.731720 21646 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.002s
W20260709 13:07:09.752806 21634 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.465s	user 0.002s	sys 0.000s
I20260709 13:07:09.755986 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3441) took 1192 ms. Trace:
I20260709 13:07:09.754467 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.743803 21637 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:09.756263 21537 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:09.757436 21605 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.758147 21605 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.757470 21537 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:09.723973 21146 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:09.760717 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:09.761071 15509 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.756562 15585 rpcz_store.cc:276] 0709 13:07:08.563714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.577712 (+ 13998us) service_pool.cc:224] Handling call
0709 13:07:08.577998 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.652434 (+ 74436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.652467 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.669784 (+ 17317us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.034974 (+365190us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b1800430060. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:07:09.110403 (+ 75429us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:09.110446 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.110525 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.751939 (+641414us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:09.755660 (+  3721us) raft_consensus.cc:1685] finished
0709 13:07:09.755694 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.755904 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134463,"raft.queue_time_us":113179,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8797,"spinlock_wait_cycles":67445760,"thread_start_us":75186,"threads_started":1,"wal-append.queue_time_us":497009}
I20260709 13:07:09.774928 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.778271 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.783432 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.755336 21290 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.732801 21583 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.764022 21537 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:09.784595 21637 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:09.793519 21448 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:09.776057 21458 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:09.801121 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:09.776700 21235 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:09.780011 21563 raft_consensus.cc:2764] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:07:09.809468 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.810612 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:09.780457 21479 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:09.785422 21509 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:09.723522 21515 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.776849 21642 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:09.820976 15555 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:09.819252 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:09.776482 21146 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.814991 21605 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:09.826061 21622 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.759s	user 0.012s	sys 0.006s
I20260709 13:07:09.839203 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:09.896477 15443 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:07:09.817821 21290 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:07:09.831508 21661 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:07:09.825464 21529 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:09.901189 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:09.902500 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.903568 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:09.808552 21637 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.816340 21639 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:09.903594 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.827462 21235 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:09.904884 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 85713.1us
W20260709 13:07:09.914175 21627 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:09.827399 21180 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:07:09.819286 21458 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.918702 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.902864 21540 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.935492 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:09.941483 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.905450 21622 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:09.942361 15436 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:09.948103 15482 leader_election.cc:400] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8.
I20260709 13:07:09.948477 15482 leader_election.cc:403] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:09.952198 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:09.952452 21669 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:09.952991 15439 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:09.953064 21669 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.951246 21180 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:09.955219 21180 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.955652 21180 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.956693 15439 raft_consensus.cc:1240] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:07:09.957715 21662 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:09.957882 21667 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:09.958386 21667 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:09.959365 21667 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.966738 21640 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.968672 21146 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:09.947754 21540 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.973165 15438 raft_consensus.cc:1240] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:09.959295 21319 consensus_meta.cc:287] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.559s	user 0.014s	sys 0.000s
I20260709 13:07:09.995322 15515 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:09.997888 15511 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:09.910341 21290 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:09.976944 21669 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:09.997360 21583 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:10.015894 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:09.999573 21642 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.012859 21637 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:10.020197 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.000219 21319 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.056373 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:10.061746 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:10.065249 16178 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:10.065953 16182 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:10.060838 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 239969us
I20260709 13:07:10.071172 21588 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.073665 21537 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:10.079886 21516 consensus_meta.cc:287] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.006s
I20260709 13:07:10.080681 21516 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:10.081626 15437 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:10.084587 21290 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.088546 21622 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.089823 21180 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.091001 21319 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.092258 21537 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.092775 21640 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.092700 21540 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.097586 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:10.099712 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:10.110200 15514 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:10.110828 15555 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:10.109572 21300 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:10.115113 21300 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.115764 21300 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.119689 21683 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.120631 21683 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.121150 15514 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:10.104718 21537 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:10.083437 21371 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.126185 21235 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.134649 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:10.137750 15435 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:10.138746 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:10.139314 15435 raft_consensus.cc:2393] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 7: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:10.140398 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:10.142148 21180 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.144790 21529 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:10.137411 21537 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:10.127329 21588 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.172899 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:10.152558 21605 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:10.153527 21537 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:10.184100 16179 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:07:10.178951 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:10.180446 15511 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:10.188033 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:10.188905 15585 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.194628 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:10.163209 21235 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:10.201404 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:10.202282 15511 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:07:10.190073 21180 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:10.207881 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:10.214387 21529 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:10.216909 15511 raft_consensus.cc:2368] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:07:10.221127 21683 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.225736 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2853) took 1110 ms. Trace:
I20260709 13:07:10.226213 15434 rpcz_store.cc:276] 0709 13:07:09.115097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.131971 (+ 16874us) service_pool.cc:224] Handling call
0709 13:07:09.132390 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.171934 (+ 39544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.171967 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.172014 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:09.172047 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.225480 (+1053433us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b54002256d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:10.225527 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.225655 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90456960}
I20260709 13:07:10.227710 21371 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.220012 21180 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:10.228667 21632 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 1.029s	user 0.002s	sys 0.005s
I20260709 13:07:10.229960 21573 raft_consensus.cc:3055] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:10.230376 21573 raft_consensus.cc:740] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:10.231285 15584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3449) took 1324 ms. Trace:
I20260709 13:07:10.231810 15584 rpcz_store.cc:276] 0709 13:07:08.906826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.907013 (+   187us) service_pool.cc:224] Handling call
0709 13:07:08.907405 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.914919 (+  7514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.914942 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.920443 (+  5501us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.067884 (+147441us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:09.067928 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.068000 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.227980 (+1159980us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:10.230920 (+  2940us) raft_consensus.cc:1685] finished
0709 13:07:10.230949 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.231213 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1430,"raft.queue_time_us":15711,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3798,"spinlock_wait_cycles":14799104,"thread_start_us":119152,"threads_started":1,"wal-append.queue_time_us":221617}
I20260709 13:07:10.239125 21642 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8.
I20260709 13:07:10.243033 15510 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:10.244560 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 3457) took 1038 ms. Trace:
I20260709 13:07:10.245167 15592 rpcz_store.cc:276] 0709 13:07:09.205801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.225537 (+ 19736us) service_pool.cc:224] Handling call
0709 13:07:10.244213 (+1018676us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540028a0d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:10.244427 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779865344}
I20260709 13:07:10.250691 21515 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.192534 21598 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:07:10.242971 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2621) took 1116 ms. Trace:
I20260709 13:07:10.258797 15515 rpcz_store.cc:276] 0709 13:07:09.126973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.127371 (+   398us) service_pool.cc:224] Handling call
0709 13:07:10.242598 (+1115227us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54003778d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:10.242840 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978729856}
I20260709 13:07:10.261041 21235 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:10.261754 21235 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.263412 21448 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.266578 21235 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.267184 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 713) took 1143 ms. Trace:
I20260709 13:07:10.193490 21588 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 13:07:10.280254 15515 pending_rounds.cc:85] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 11
I20260709 13:07:10.285991 21617 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.286918 21631 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:10.287154 21300 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.288106 20706 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.289778 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.290618 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:10.290360 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:10.291663 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:10.293593 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:10.294895 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.296231 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:10.297449 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 110432us
I20260709 13:07:10.298269 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.298075 15585 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:10.272485 21583 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:10.369143 15515 pending_rounds.cc:107] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:07:10.300944 15441 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.369911 15441 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:10.370144 16178 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:10.368839 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.369592 15515 raft_consensus.cc:2889] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.302593 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.371883 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:10.374595 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.369328 20706 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.376885 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:10.377308 15434 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:10.377444 16174 raft_consensus.cc:2368] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14.
I20260709 13:07:10.315871 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.306761 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:10.378679 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:10.379081 15443 rpcz_store.cc:276] 0709 13:07:09.124055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.125041 (+   986us) service_pool.cc:224] Handling call
0709 13:07:10.266914 (+1141873us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54001793d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:10.267082 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596966272}
I20260709 13:07:10.306193 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.379720 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.380532 15585 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
W20260709 13:07:10.304184 21686 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.088s	user 0.001s	sys 0.002s
I20260709 13:07:10.381603 15585 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:10.384292 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:10.323690 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.383744 15589 raft_consensus.cc:2393] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 20: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:10.371570 15592 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:07:10.369149 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:10.386711 15583 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:10.389832 15583 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:10.391970 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.297430 21683 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:10.392860 15585 raft_consensus.cc:1813] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Handling vote request from an unknown peer 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:10.377338 21515 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:10.394181 20706 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.397014 21235 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:10.398963 21235 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:10.399896 21235 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:10.400800 21578 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:10.401270 21578 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.401731 21578 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.403741 21537 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.394487 21527 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:10.380865 21631 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.396427 15585 raft_consensus.cc:2368] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8.
I20260709 13:07:10.382325 21635 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:10.386427 21448 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:10.397312 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:10.417961 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.408393 21527 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:10.396642 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.421793 15583 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:07:10.422919 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.409808 15588 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 18: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:10.410449 15589 raft_consensus.cc:1240] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:10.395480 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.417336 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:10.431074 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.432180 15586 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 15: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:10.429620 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:10.436751 15435 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 7.
I20260709 13:07:10.437760 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.439755 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.418298 21635 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.409085 21371 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:10.417534 15441 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:07:10.445842 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:10.447247 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:10.448097 15586 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.452100 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.457201 15583 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:10.446437 21635 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.468892 15555 leader_election.cc:400] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:07:10.469563 15555 leader_election.cc:403] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:07:10.469761 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.473371 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 78027.9us
I20260709 13:07:10.473631 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3663) took 1196 ms. Trace:
I20260709 13:07:10.419332 21683 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.474828 15512 rpcz_store.cc:276] 0709 13:07:09.277515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.577861 (+300346us) service_pool.cc:224] Handling call
0709 13:07:09.579884 (+  2023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.580219 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:09.580568 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.276486 (+695918us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800405520. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a 00007fcf7bd61a2a
0709 13:07:10.472341 (+195855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.472402 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:10.472465 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.473406 (+   941us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.473568 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2495,"raft.queue_time_us":1189,"spinlock_wait_cycles":5517056,"thread_start_us":195293,"threads_started":1}
I20260709 13:07:10.482048 15592 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:07:10.449965 21371 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.486667 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:10.473201 21638 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:10.485522 21527 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.489284 15584 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:10.489879 21509 consensus_queue.cc:1059] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:10.505167 21683 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.496135 21691 consensus_queue.cc:1059] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:10.506778 21630 tablet_replica.cc:333] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:10.513818 21371 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.495513 21235 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.514171 21537 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.514421 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:10.516764 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:10.532114 15515 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 12.
I20260709 13:07:10.532374 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:10.534276 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.518190 15584 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:10.540659 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.547462 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.546370 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:10.550961 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:10.551934 15584 raft_consensus.cc:2368] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14.
I20260709 13:07:10.553529 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:10.588056 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.596133 15586 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
W20260709 13:07:10.597733 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44310.2us
I20260709 13:07:10.599011 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.604347 21692 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:07:10.612905 21642 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:10.613495 21598 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:10.613991 21598 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:10.614497 21598 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:09.915859 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:10.632668 21578 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.633919 15589 raft_consensus.cc:2368] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14.
I20260709 13:07:10.640017 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:10.496434 21631 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.640630 21591 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.641933 21591 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:10.520462 21509 raft_consensus.cc:3055] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:10.642704 21509 raft_consensus.cc:740] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:10.644207 21446 raft_consensus.cc:3055] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:10.643862 21509 consensus_queue.cc:260] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:10.645668 21509 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.644603 21446 raft_consensus.cc:740] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:10.648406 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:10.650628 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3462) took 1441 ms. Trace:
W20260709 13:07:10.654165 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 166426us
I20260709 13:07:10.554936 21622 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:10.659432 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:10.595767 21617 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:10.658421 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:10.658588 15482 leader_election.cc:400] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 7. Current term is 8.
I20260709 13:07:10.661607 15509 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.666893 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.653976 15587 rpcz_store.cc:276] 0709 13:07:09.209062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.345999 (+136937us) service_pool.cc:224] Handling call
0709 13:07:09.346286 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.346478 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:10.479061 (+1132583us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b180029eae0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7b8ff4bc 00007fcf78c4d48b 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c67455 00007fcf7f74f3c7 00007fcf7bd619a7 00007fcf7bd710bf
0709 13:07:10.479245 (+   184us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.650229 (+170984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.650287 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:10.650335 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.650435 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.650570 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51723,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":88,"spinlock_wait_cycles":8494464,"thread_start_us":236047,"threads_started":2}
I20260709 13:07:10.674225 15509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40676 (request call id 3662) took 1426 ms. Trace:
I20260709 13:07:10.674687 15509 rpcz_store.cc:276] 0709 13:07:09.239693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.513768 (+274075us) service_pool.cc:224] Handling call
0709 13:07:10.619205 (+1105437us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54000ecc54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd4ea3d 00007fcf80d1ecd0 00007fcf7a2a3254 00007fcf7a2a31e2 00007fcf7a2a3111 00007fcf7a2a308c 00007fcf7a2a2342 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:10.665969 (+ 46764us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67245824}
I20260709 13:07:10.653671 21605 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:10.656356 21642 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:10.658178 21658 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.661480 21319 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.661365 21669 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:10.653568 21687 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:10.672652 21670 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:10.673182 21621 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:07:10.713475 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.690562 21622 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:10.720371 21698 log.cc:927] Time spent T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:07:10.660338 21635 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.712749 21300 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.729888 21603 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:10.731410 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3661) took 1510 ms. Trace:
I20260709 13:07:10.771291 15510 rpcz_store.cc:276] 0709 13:07:09.220806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.221127 (+   321us) service_pool.cc:224] Handling call
0709 13:07:10.242798 (+1021671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.243826 (+  1028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.731114 (+487288us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003778d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:10.731318 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2348850048}
I20260709 13:07:10.731878 21578 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.713364 21669 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.703168 21617 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:10.721971 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 328728us
I20260709 13:07:10.698936 21642 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:10.772382 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 114036us
I20260709 13:07:10.733708 21235 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:10.784781 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 125612us
I20260709 13:07:10.744702 21687 consensus_queue.cc:1243] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:10.786625 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:10.711928 21319 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.821527 21319 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.708405 21658 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:10.799712 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.787199 21642 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.808331 15585 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:10.809255 21669 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.707671 21446 consensus_queue.cc:260] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.754870 21622 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.839299 21622 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.818806 21635 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:10.826573 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.795646 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.840927 21180 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:10.841526 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46034.7us
I20260709 13:07:10.843142 20484 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:10.844468 20484 consensus_queue.cc:1059] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:10.845525 20484 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:10.849781 15407 leader_election.cc:400] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14.
I20260709 13:07:10.850186 15407 leader_election.cc:403] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:10.853965 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:10.854616 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:10.853863 15516 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:10.753522 21621 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.827216 21527 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.867048 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:10.868031 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:10.870599 21515 raft_consensus.cc:3055] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:10.872218 21658 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:10.745083 21670 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:10.878187 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 91595.1us
I20260709 13:07:10.876873 21650 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:10.890050 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 172638us
I20260709 13:07:10.880892 21235 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.880659 21635 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.882278 21515 raft_consensus.cc:740] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:10.899688 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:10.900028 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:10.888713 21650 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:10.906893 15442 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:10.906842 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:10.910774 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:10.914414 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 247646us
I20260709 13:07:10.896917 21235 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.922538 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:10.920665 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:10.924932 15436 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:10.926810 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:10.927659 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:10.930217 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:10.886461 21527 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.932749 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:10.934373 15435 raft_consensus.cc:1275] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:07:10.935578 21591 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:10.936013 21591 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:10.936411 21591 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:10.941797 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.943856 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:10.944552 15435 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.946509 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:10.916932 21416 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:10.917917 21704 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:10.950034 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:10.926769 21235 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.926312 21667 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:10.949086 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:10.962929 15442 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
I20260709 13:07:10.955619 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:10.970813 15482 leader_election.cc:400] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14.
I20260709 13:07:10.964288 15406 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.964838 20706 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.971144 15482 leader_election.cc:403] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:10.971500 20706 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.973699 15584 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:10.972558 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:10.975517 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:10.964558 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 159390us
I20260709 13:07:10.977250 15584 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:10.977808 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:10.981648 20484 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:10.981195 21416 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.975366 15326 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 5b97fcd3d908482fadc6fa54e513304d with cas_config_opid_index 6: aborting the task: latest config opid_index 7; task opid_index 6
I20260709 13:07:10.981240 21637 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:10.986884 21180 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:10.987377 21637 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:10.988423 21637 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:10.962836 21479 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:10.992230 21537 consensus_queue.cc:1048] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:07:10.947837 21517 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:10.994099 21517 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.996557 21670 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.997071 21235 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:10.997453 21300 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:10.998289 15435 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:10.999805 15588 raft_consensus.cc:2393] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:10.970117 21650 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.000672 21650 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.004833 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:11.005573 15584 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.009842 21180 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:10.942232 21692 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.016137 21692 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.016808 21235 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:10.976400 21704 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.021642 21180 raft_consensus.cc:493] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:11.022281 21704 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:11.024802 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.969455 21622 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:11.034431 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:11.042750 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.049023 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.039692 15583 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:11.054957 15556 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:10.952641 21671 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.049960 16174 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 8.
I20260709 13:07:11.065349 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:11.070433 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.077178 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.019261 21692 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:10.975800 21667 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:10.975602 21687 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:11.103466 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.022352 15584 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:11.106127 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:11.061533 21603 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:11.131321 21692 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:11.164592 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 58558.5us
I20260709 13:07:11.168035 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:11.080041 21529 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:11.073704 21621 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:11.254844 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86976.2us
I20260709 13:07:11.084206 21670 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:11.261293 21578 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:10.975221 21515 consensus_queue.cc:260] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.146211 21709 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:11.272913 21603 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:11.362387 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
W20260709 13:07:11.363770 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 342627us
I20260709 13:07:11.376582 15443 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:07:11.373211 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 315504us
I20260709 13:07:11.289695 21637 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.291127 21529 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:11.254091 21671 consensus_queue.cc:1059] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 13:07:11.381515 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:11.403141 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 486009us
I20260709 13:07:11.405323 15584 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:11.361892 21603 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:11.392362 21515 raft_consensus.cc:3060] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:11.381382 21622 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:11.022306 21180 raft_consensus.cc:515] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:11.416421 21603 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:11.387166 21670 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:11.438483 21598 consensus_meta.cc:287] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.820s	user 0.009s	sys 0.007s
I20260709 13:07:11.466203 21517 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:11.381199 21709 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:11.466135 15443 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:07:11.476862 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.507423 15437 raft_consensus.cc:2410] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:11.404177 21637 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.437263 21671 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:11.509060 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:11.437832 21706 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:11.464823 21416 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.417687 21591 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.454339 21509 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:11.533962 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:11.537236 16174 raft_consensus.cc:1240] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:11.538976 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.539976 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.502758 21527 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.541019 15510 raft_consensus.cc:2410] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:11.543556 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.402688 21667 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.559633 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:11.560055 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:11.567001 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.544602 21509 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.503998 21598 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:11.540185 21725 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.589165 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.506625 21529 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:11.602890 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 216948us
I20260709 13:07:11.621250 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.601540 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:11.628461 21713 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:07:11.629276 21714 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:11.629850 21715 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:07:11.629878 21180 leader_election.cc:290] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:11.631237 21670 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:11.631449 21180 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:11.581197 21527 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:11.631778 21719 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:07:11.632004 21180 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.632157 21527 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:11.634392 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.634243 21180 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.533527 21671 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.636343 21730 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.636901 21730 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.637456 21671 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.639137 21730 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.598165 21622 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:11.641324 21642 consensus_meta.cc:287] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.802s	user 0.011s	sys 0.001s
I20260709 13:07:11.645728 21709 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:11.647454 21712 log.cc:927] Time spent T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.266s	user 0.001s	sys 0.001s
W20260709 13:07:11.648132 21721 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:07:11.537475 21706 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:11.656776 21509 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:11.624729 21639 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:11.658993 21639 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:11.661185 21720 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:07:11.634574 21598 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:11.630224 21635 consensus_meta.cc:287] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.003s
I20260709 13:07:11.627362 21576 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 13:07:11.666610 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50001.3us
I20260709 13:07:11.668383 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.634243 21527 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:11.671411 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.669866 16178 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 8.
I20260709 13:07:11.676447 21460 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:11.676527 15406 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:11.677773 21460 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:11.678135 21460 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:11.679811 21728 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:11.680382 21639 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:11.684278 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:11.684661 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:11.641988 21642 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.679013 21460 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.686246 21460 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:11.686847 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.687126 21642 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.685277 16182 raft_consensus.cc:3060] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.663151 21458 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:11.696046 21716 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.306s	user 0.000s	sys 0.004s
I20260709 13:07:11.698853 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.631816 21670 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:11.699998 21670 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.702107 21670 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.673089 16174 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:11.708995 15439 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:11.713608 21573 consensus_queue.cc:260] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:11.722084 15434 raft_consensus.cc:2468] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:11.724490 21706 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:11.727448 21694 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 1.086s	user 0.018s	sys 0.053s
I20260709 13:07:11.732173 15585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3471) took 1216 ms. Trace:
I20260709 13:07:11.762367 15585 rpcz_store.cc:276] 0709 13:07:10.516127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.607724 (+ 91597us) service_pool.cc:224] Handling call
0709 13:07:10.808085 (+200361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.829974 (+ 21889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.731882 (+901908us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b540016c6d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:11.732086 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459885440}
I20260709 13:07:11.672287 21635 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14.
I20260709 13:07:11.756516 16182 raft_consensus.cc:2468] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 9.
I20260709 13:07:11.740496 21573 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:11.774322 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.776342 21630 raft_consensus.cc:2243] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:11.777529 21630 raft_consensus.cc:2272] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:11.780738 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.800071 21630 ts_tablet_manager.cc:1916] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:11.803207 21460 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:11.803804 21617 consensus_meta.cc:287] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 1.015s	user 0.010s	sys 0.005s
I20260709 13:07:11.764719 21527 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:07:11.804390 21617 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:11.804886 21527 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:11.805341 21527 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:11.805365 15515 raft_consensus.cc:1240] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:11.806558 21650 consensus_meta.cc:287] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.805s	user 0.014s	sys 0.000s
I20260709 13:07:11.806391 21527 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:11.809403 21603 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:11.811585 15441 raft_consensus.cc:2410] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:07:11.825788 16145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.016s	sys 0.015s
W20260709 13:07:11.826470 16145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.016s	sys 0.016s
I20260709 13:07:11.811396 21725 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:11.828975 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 851650us
I20260709 13:07:11.803907 21460 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.844465 21603 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:11.850513 21637 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.864691 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:11.874945 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:11.833266 21527 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:11.892393 15518 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:11.902271 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:11.903283 15589 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:11.905540 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.906322 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:11.907207 15510 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:11.907876 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58702c00fb4641ec8337a916d4579ec9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:11.909031 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.910732 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.912338 15588 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:11.917064 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:11.918067 15518 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
W20260709 13:07:11.920645 21680 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 1.292s	user 0.003s	sys 0.003s
I20260709 13:07:11.920450 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:11.902072 21637 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:11.921653 21637 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.922706 21725 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:11.924652 21745 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:11.926303 16145 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:11.928648 21736 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:11.929304 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.932775 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.933995 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.934469 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.934690 15589 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:11.935182 15438 raft_consensus.cc:2393] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 9: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:11.935766 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.935889 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:11.936167 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:11.929103 21736 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:11.937403 21736 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.929107 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 2882) took 1007 ms. Trace:
I20260709 13:07:11.941071 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.941201 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:11.942090 15584 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:11.942474 15589 raft_consensus.cc:2393] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 21: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:11.942150 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:11.939491 15441 rpcz_store.cc:276] 0709 13:07:10.921499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.927311 (+  5812us) service_pool.cc:224] Handling call
0709 13:07:11.928818 (+1001507us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540033fc54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:11.929020 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021042432}
I20260709 13:07:11.944970 15518 raft_consensus.cc:1240] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:11.948274 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 268817us
I20260709 13:07:11.950022 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:11.954995 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.939186 21687 consensus_meta.cc:287] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.798s	user 0.009s	sys 0.005s
I20260709 13:07:11.929167 21460 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.940064 21617 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:11.963603 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.963160 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.964691 15435 raft_consensus.cc:1240] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:07:11.961784 21540 consensus_queue.cc:1059] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:07:11.944833 21725 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:11.965432 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.965940 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.001438 21725 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:11.965440 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.970914 21637 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:11.985152 15512 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:12.003521 15436 raft_consensus.cc:2368] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14.
W20260709 13:07:11.991863 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.995888 15440 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:11.998342 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:11.998903 15442 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:12.005867 15440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 723) took 1071 ms. Trace:
I20260709 13:07:12.008472 15440 rpcz_store.cc:276] 0709 13:07:10.934144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.934372 (+   228us) service_pool.cc:224] Handling call
0709 13:07:11.936017 (+1001645us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5800003698. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:07:12.005780 (+ 69763us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12793088}
I20260709 13:07:12.012997 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:12.013768 15442 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:11.961160 21687 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 13. Current term is 14.
I20260709 13:07:12.015000 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:11.947486 21740 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:12.019694 20706 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:12.026000 21517 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:12.005012 21621 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.040457 21517 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:12.045419 21621 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.042032 21740 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:12.006124 21617 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.100623 21517 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:12.103271 15516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2632) took 2912 ms (client timeout 2086 ms). Trace:
I20260709 13:07:12.103653 15514 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:07:12.103718 15516 rpcz_store.cc:269] 0709 13:07:09.191012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.191202 (+   190us) service_pool.cc:224] Handling call
0709 13:07:12.103009 (+2911807us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540036b0d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:12.103158 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3691162880}
I20260709 13:07:12.105831 15513 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:12.105913 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.106766 15443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2889) took 1064 ms. Trace:
I20260709 13:07:12.115756 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:12.114888 15443 rpcz_store.cc:276] 0709 13:07:11.042084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.515367 (+473283us) service_pool.cc:224] Handling call
0709 13:07:11.515918 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.516541 (+   623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.516578 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.543084 (+ 26506us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.855054 (+311970us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b18001ba3c0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:07:12.040069 (+185015us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:12.040124 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.040199 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.106400 (+ 66201us) raft_consensus.cc:1685] finished
0709 13:07:12.106424 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.106684 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28126,"raft.queue_time_us":65962,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10196,"spinlock_wait_cycles":6545152,"thread_start_us":184768,"threads_started":1,"wal-append.queue_time_us":529294}
I20260709 13:07:12.117020 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.118163 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.119371 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.119702 15442 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:07:12.120556 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.120895 15442 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.121357 15443 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:07:12.121629 21717 log.cc:927] Time spent T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.709s	user 0.000s	sys 0.005s
I20260709 13:07:12.107002 15441 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:12.117024 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.102797 21736 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.124660 15436 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:12.128842 21529 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.129678 21529 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.107813 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:12.108650 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:12.143726 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 188105us
I20260709 13:07:12.111018 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:12.133773 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 200072us
W20260709 13:07:12.134637 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.146065 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:12.146908 21687 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.136147 21578 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.136796 21479 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.134380 21617 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:12.137975 21702 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.139339 15587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3485) took 1166 ms. Trace:
I20260709 13:07:12.147042 15588 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:12.149462 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:12.157335 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55298 (request call id 3487) took 1183 ms. Trace:
I20260709 13:07:12.159765 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:12.163298 15516 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.171862 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:12.172653 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:12.161564 15587 rpcz_store.cc:276] 0709 13:07:10.972738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.976756 (+  4018us) service_pool.cc:224] Handling call
0709 13:07:11.080595 (+103839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.080938 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:11.138706 (+ 57768us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.648266 (+509560us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b1800401b60. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f723a 00007fcf7bd61a2a
0709 13:07:12.138941 (+490675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.139005 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:12.139063 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.139142 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.139277 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236734,"prepare.queue_time_us":56443,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":236102,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":17944448,"thread_start_us":255147,"threads_started":1,"wal-append.queue_time_us":842181}
I20260709 13:07:12.165849 15592 rpcz_store.cc:276] 0709 13:07:10.973422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.976836 (+  3414us) service_pool.cc:224] Handling call
0709 13:07:11.069706 (+ 92870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.145872 (+ 76166us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:11.494661 (+348789us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.740444 (+245783us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.760386 (+ 19942us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.105727 (+345341us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b18001286e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a522 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:07:12.125259 (+ 19532us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18001286e0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78be4c0a 00007fcf82324219 00007fcf78c6ca40 00007fcf78c674e4 00007fcf78c67455 00007fcf7bd4f060 00007fcf7bd61716 00007fcf7bd72287 00007fcf7bd72208
0709 13:07:12.125429 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.125478 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:12.125521 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.156924 (+ 31403us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b54001decd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:12.157005 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.157236 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39215,"prepare.queue_time_us":191682,"prepare.run_cpu_time_us":195,"prepare.run_wall_time_us":4610,"raft.queue_time_us":373361,"raft.run_cpu_time_us":421,"raft.run_wall_time_us":5160,"spinlock_wait_cycles":184577024,"thread_start_us":446936,"threads_started":2,"wal-append.queue_time_us":341812}
I20260709 13:07:12.179582 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:12.180773 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:12.179147 15516 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:07:12.175567 15442 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:12.182750 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:12.183022 16145 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:12.161118 21736 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.184016 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:12.183984 21743 consensus_queue.cc:1059] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:12.186786 21658 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:12.186874 21743 raft_consensus.cc:2804] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:12.187299 21658 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:12.187740 15518 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:12.187827 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:12.188369 21658 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.189332 15509 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:12.189881 21658 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:12.161434 21639 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.191431 21639 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.191718 21743 raft_consensus.cc:697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:12.192901 21743 consensus_queue.cc:237] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.193821 21639 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.170593 21702 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.196633 21702 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.198021 21605 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.198621 21605 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.200867 21745 raft_consensus.cc:3055] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:12.201437 21745 raft_consensus.cc:740] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:12.202452 21745 consensus_queue.cc:260] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.201004 21605 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.207579 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 2874) took 1301 ms. Trace:
I20260709 13:07:12.221889 15434 rpcz_store.cc:276] 0709 13:07:10.905720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.905860 (+   140us) service_pool.cc:224] Handling call
0709 13:07:12.207366 (+1301506us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400301bd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:12.207485 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777142528}
I20260709 13:07:12.163898 21479 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.161758 21578 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.206372 21687 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.207607 21621 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:12.220010 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.225101 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:12.167037 21692 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.233635 15516 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:12.244088 15440 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:07:12.261245 15516 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:12.282922 21605 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.258925 21750 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.283205 21591 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:12.285812 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:12.271031 21745 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:12.298843 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.301824 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:12.306886 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:12.318019 20706 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:12.260048 21692 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.323752 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.323697 20706 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:12.312767 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.294713 21687 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.329576 15556 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:12.332080 15438 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:12.332672 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.296007 21529 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:12.336289 15556 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:12.283792 21605 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.346007 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.356102 15436 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:12.322518 21371 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.357331 21371 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.325810 21702 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.359819 21702 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.331712 21235 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:12.362677 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.362550 21235 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.331888 21563 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.364832 21591 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.365206 21563 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.365542 21591 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.305903 21750 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.368202 21591 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:12.341979 21704 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:12.347124 21603 raft_consensus.cc:2804] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:12.385392 16146 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.245.65:36757 timed out after 2.195s (SENT) [suppressed 21 similar messages]
I20260709 13:07:12.338824 21687 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.400179 21603 raft_consensus.cc:697] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:12.404917 21750 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:12.404430 21578 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.414413 21479 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.436075 15513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2674) took 1024 ms. Trace:
W20260709 13:07:12.447280 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 163071us
I20260709 13:07:12.447567 15513 rpcz_store.cc:276] 0709 13:07:11.411661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.559793 (+148132us) service_pool.cc:224] Handling call
0709 13:07:12.435819 (+876026us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54002e3954. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:12.435991 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110972672}
I20260709 13:07:12.429378 16174 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 13.
I20260709 13:07:12.446412 21725 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.422219 21630 ts_tablet_manager.cc:1929] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:07:12.430109 21738 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:12.446856 21605 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.483160 21446 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:12.486510 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.455683 21631 consensus_queue.cc:1059] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 13:07:12.490767 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 167691us
I20260709 13:07:12.460294 21630 log.cc:1199] T 5b97fcd3d908482fadc6fa54e513304d P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/5b97fcd3d908482fadc6fa54e513304d
I20260709 13:07:12.480334 20706 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:12.468766 21687 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:12.468683 21371 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.464258 21692 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.466665 21563 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:12.503979 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 167793us
I20260709 13:07:12.464861 21740 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:07:12.506512 15556 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:12.459810 21725 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.479445 21650 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:07:12.478752 21738 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.522109 15556 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:12.524753 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.531119 21639 raft_consensus.cc:2804] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:12.531848 21639 raft_consensus.cc:697] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:12.510707 21563 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:12.534723 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:12.532092 21725 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:12.528735 21319 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:12.505214 21603 consensus_queue.cc:237] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:12.549793 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.538661 21630 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58996 (request call id 0) took 3763 ms. Trace:
I20260709 13:07:12.584965 21630 rpcz_store.cc:276] 0709 13:07:08.793968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.867635 (+ 73667us) service_pool.cc:224] Handling call
0709 13:07:09.138701 (+271066us) ts_tablet_manager.cc:1151] Deleting tablet 5b97fcd3d908482fadc6fa54e513304d
0709 13:07:09.151479 (+ 12778us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:07:10.506585 (+1355106us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400213754. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5fff9 00007fcf80d6d482 00007fcf80d9e2d0 00007fcf80d8483d 00007fcf80d847e9 00007fcf80d84779 00007fcf80d84741 00007fcf80d8396d 000000000038f354 000000000038f199
0709 13:07:12.112830 (+1606245us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:12.418038 (+305208us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:12.534092 (+116054us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1227222,"spinlock_wait_cycles":421847296,"tablet-delete.queue_time_us":239387,"thread_start_us":172841,"threads_started":1}
I20260709 13:07:12.592350 21639 consensus_queue.cc:237] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.543685 21563 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.599472 21563 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.558475 21319 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.605811 21319 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:12.603298 21563 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:12.616497 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 135259us
W20260709 13:07:12.617103 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 125336us
W20260709 13:07:12.630674 15583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55298 (request call id 3483) took 1652 ms (client timeout 1598 ms). Trace:
W20260709 13:07:12.631331 15583 rpcz_store.cc:269] 0709 13:07:10.971898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.975234 (+  3336us) service_pool.cc:224] Handling call
0709 13:07:12.623979 (+1648745us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b54000c0b54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:12.624165 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141647616}
I20260709 13:07:12.619519 21764 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.638368 21764 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.639236 21728 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:12.639900 21728 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.642104 21728 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:12.642609 21728 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:12.642923 21728 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:12.644004 21479 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.644560 21479 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.648633 15591 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
W20260709 13:07:12.650280 15512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34302 (request call id 1325) took 1992 ms (client timeout 2195 ms). Trace:
W20260709 13:07:12.650697 15512 rpcz_store.cc:269] 0709 13:07:10.657490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.659166 (+  1676us) service_pool.cc:224] Handling call
0709 13:07:12.650099 (+1990933us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400294d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:12.650221 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025717120}
I20260709 13:07:12.653190 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:12.619792 21738 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:12.664520 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 121751us
I20260709 13:07:12.666141 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:07:12.669023 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.686281 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.688892 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.693588 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.695967 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.691813 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.698293 15514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2666) took 2253 ms. Trace:
I20260709 13:07:12.659937 21631 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.664404 21319 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:12.701481 15514 rpcz_store.cc:276] 0709 13:07:10.419215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.437587 (+ 18372us) service_pool.cc:224] Handling call
0709 13:07:12.103158 (+1665571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.104253 (+  1095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.672778 (+568525us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540036b0d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd568ad 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:12.673001 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3829517056}
I20260709 13:07:12.665180 21764 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:12.707299 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.709767 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.711349 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:12.719003 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:12.722530 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 103596us
W20260709 13:07:12.723269 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.671936 21696 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:12.735576 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:12.708362 21319 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.749155 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.709700 21563 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:12.752369 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:12.754695 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:12.793881 16178 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:12.731434 21517 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.732808 21605 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.794721 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 173548us
I20260709 13:07:12.804163 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:12.666589 21728 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.792007 21319 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:12.716403 21631 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.710949 21770 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
W20260709 13:07:12.829367 21766 log.cc:927] Time spent T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:12.855515 21667 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.859762 21669 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:12.860540 21669 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:12.861052 15337 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:12.862900 15337 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 18 to 19, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 19 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:12.871730 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.921511 15515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3694) took 2067 ms. Trace:
I20260709 13:07:12.922019 15515 rpcz_store.cc:276] 0709 13:07:10.854163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.855031 (+   868us) service_pool.cc:224] Handling call
0709 13:07:10.869590 (+ 14559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.806023 (+936433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.921207 (+1115184us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54003f61d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:12.921435 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151459584}
I20260709 13:07:12.834622 21768 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.804459 21563 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.945451 21764 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.814795 21605 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.863497 21669 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:12.933189 21728 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.946357 21764 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.947467 21448 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:12.957460 21300 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.985920 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 216241us
I20260709 13:07:12.992075 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:12.988610 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:12.990435 15591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55304 (request call id 2423) took 1059 ms. Trace:
W20260709 13:07:12.988065 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 184154us
I20260709 13:07:12.947626 21768 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:12.993074 15591 rpcz_store.cc:276] 0709 13:07:11.931432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.932464 (+  1032us) service_pool.cc:224] Handling call
0709 13:07:12.990237 (+1057773us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54001de2d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:12.990372 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644457344}
I20260709 13:07:12.994129 15407 leader_election.cc:400] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 13 election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 13. Current term is 14.
I20260709 13:07:12.993161 15588 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:12.995738 15407 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
W20260709 13:07:12.997614 15510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2673) took 1586 ms (client timeout 2050 ms). Trace:
W20260709 13:07:12.998075 15510 rpcz_store.cc:269] 0709 13:07:11.411288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.559309 (+148021us) service_pool.cc:224] Handling call
0709 13:07:12.997456 (+1438147us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54001e5ad4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:12.997558 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633645824}
I20260709 13:07:12.997913 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:12.999830 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:13.005715 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:13.012584 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:13.015384 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.000744 15588 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:13.007170 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.021138 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:13.022141 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.024077 16182 raft_consensus.cc:1240] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:12.992449 21639 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:13.030085 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:13.037312 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.044476 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:12.986699 21300 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:13.034511 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.048868 15517 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:07:13.049460 15517 pending_rounds.cc:85] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 10
I20260709 13:07:13.049763 15517 pending_rounds.cc:107] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:07:13.049834 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.050186 15517 raft_consensus.cc:2889] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:13.050374 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 245081us
I20260709 13:07:13.048802 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.051811 15585 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:13.047757 15587 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:07:13.020936 21529 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:13.055047 15515 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:13.058022 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:13.039521 21692 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.064906 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:13.026716 21371 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:13.070596 15588 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:13.067184 15591 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:13.079975 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:13.081527 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.081804 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.085325 15442 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:13.083508 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.086248 15586 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:13.087249 15510 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:13.087898 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.090134 15442 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:07:13.091005 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.092788 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.093684 15443 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:13.054188 21591 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.095311 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:13.095850 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.096774 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.097306 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.099267 15442 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:13.103713 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.105096 15442 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:13.107764 21631 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:13.108101 21781 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:07:13.109792 21768 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:13.111377 21783 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:07:13.112979 21300 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.113598 21300 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:13.051828 21639 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.055097 21696 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:13.093840 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.130021 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.135030 15440 raft_consensus.cc:2393] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:13.096354 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:13.137681 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.138602 15438 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
W20260709 13:07:13.142032 21782 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:13.143353 21702 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.132973 21591 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.146369 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.146239 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:13.025921 21767 raft_consensus.cc:2764] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:13.153982 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:13.154753 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.154968 15510 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:13.161737 15510 raft_consensus.cc:1240] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:13.172632 15591 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:13.175565 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:13.118505 21605 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.171355 21631 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:13.196949 15510 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:13.209765 15439 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
W20260709 13:07:13.209801 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 136353us
I20260709 13:07:13.162750 21770 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:13.119619 21371 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.200693 21631 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.209363 21667 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.212278 21789 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:13.234666 15510 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:13.237759 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 163518us
I20260709 13:07:13.233276 21631 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.234189 21563 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.232991 21774 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.264235 21371 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:13.264664 21460 raft_consensus.cc:3055] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:13.265306 21460 raft_consensus.cc:740] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:13.266462 21460 consensus_queue.cc:260] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.228399 21517 consensus_queue.cc:1059] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:13.238202 21789 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.239118 21669 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:13.268013 21750 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:13.274307 21774 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:13.294153 21788 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:07:13.296084 15590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 1087) took 1150 ms. Trace:
I20260709 13:07:13.296612 15590 rpcz_store.cc:276] 0709 13:07:12.146007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.148100 (+  2093us) service_pool.cc:224] Handling call
0709 13:07:12.162175 (+ 14075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.164227 (+  2052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.164258 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.164775 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.851293 (+686518us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b1800310cc0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c4ce07 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b 00007fcf7b8f6d23 00007fcf7b8f70d1 00007fcf7bd12a0f
0709 13:07:13.002250 (+150957us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:13.002293 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.002427 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.295676 (+293249us) raft_consensus.cc:1685] finished
0709 13:07:13.295709 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.296017 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1621,"raft.queue_time_us":2022,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":12094,"spinlock_wait_cycles":38222208,"thread_start_us":150744,"threads_started":1,"wal-append.queue_time_us":873122}
I20260709 13:07:13.246176 21727 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:13.241304 21667 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.314960 21667 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.315587 21667 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:13.316201 21667 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.317116 21460 raft_consensus.cc:3060] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.318313 21667 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.298938 21319 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.315650 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2672) took 1906 ms. Trace:
I20260709 13:07:13.324677 15517 rpcz_store.cc:276] 0709 13:07:11.409252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.409886 (+   634us) service_pool.cc:224] Handling call
0709 13:07:11.410305 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.050744 (+1640439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.315352 (+264608us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54003782d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:13.315577 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3767394176}
W20260709 13:07:13.323944 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 423df90a9f55438bbe1c32ab906c6e10: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:13.268713 21639 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.251520 21764 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:13.308863 21791 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:13.248600 21790 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:07:13.287082 21669 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.341009 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.280933 21743 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:13.286368 21789 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.346590 15482 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:13.347851 15584 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:13.284351 21750 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:13.351106 15482 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:13.334300 21702 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.354162 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:13.356846 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:13.356539 21702 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.357429 15440 raft_consensus.cc:2376] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14. Re-sending same reply.
I20260709 13:07:13.359103 21591 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.360611 21591 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:13.360291 21750 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.361348 21591 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:13.365132 21591 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:13.365686 21591 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.365726 21774 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.366369 21591 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.348554 21667 consensus_queue.cc:1059] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:07:13.369302 21319 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.369724 21667 raft_consensus.cc:3055] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:13.373225 21750 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.378631 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.379940 15434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46590 (request call id 2901) took 1065 ms. Trace:
I20260709 13:07:13.380366 15434 rpcz_store.cc:276] 0709 13:07:12.314270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.314474 (+   204us) service_pool.cc:224] Handling call
0709 13:07:13.378435 (+1063961us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800003698. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32eee 0000000000375939 00007fcf80ca61e0 00007fcf80d6f0c4 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:07:13.379840 (+  1405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4945152}
I20260709 13:07:13.236580 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:13.119102 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet 5b97fcd3d908482fadc6fa54e513304d (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
W20260709 13:07:13.388278 15325 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 331293us
W20260709 13:07:13.371384 21760 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.869s	user 0.004s	sys 0.000s
I20260709 13:07:13.384642 15337 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 5 to 7, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 7 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.349349 21692 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:13.413091 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.416126 21762 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:13.416592 21762 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:13.417487 21762 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.418784 21762 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:13.423368 21529 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:13.423976 21529 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:13.426344 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.427047 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.427723 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.428907 21770 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:13.441159 21728 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:13.441712 21728 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:13.442713 21728 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.453055 21728 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.396680 21669 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.398365 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:13.454403 15515 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:13.350656 21743 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.402784 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46600 (request call id 2428) took 1297 ms. Trace:
I20260709 13:07:13.458029 15439 rpcz_store.cc:276] 0709 13:07:12.105005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.107435 (+  2430us) service_pool.cc:224] Handling call
0709 13:07:13.402517 (+1295082us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003eec54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:13.402685 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347433216}
I20260709 13:07:13.459708 21743 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.466755 21774 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:13.404095 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.404356 15442 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:13.410413 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:13.472396 15441 raft_consensus.cc:3060] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:13.467813 15337 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 13, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 13 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.472554 21702 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.473524 15434 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:13.410952 15556 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:13.473826 15337 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 12 to 15, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 15 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:13.474951 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 64071us
W20260709 13:07:13.467298 15340 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 211) took 16413 ms (client timeout 15000 ms). Trace:
I20260709 13:07:13.476801 21578 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:13.477366 21578 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:13.477424 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:13.478451 21764 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.411369 21767 consensus_queue.cc:1059] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:13.480208 21767 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:13.480247 21639 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.480743 21767 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:13.480957 21639 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.481643 21767 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.484103 21578 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.391206 21235 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.447593 21479 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.494553 15441 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 17.
I20260709 13:07:13.486006 21767 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:13.451943 21770 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.411777 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.485915 21774 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.486413 21631 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.483183 21639 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.475266 15337 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 11 to 14, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:13.371873 21667 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:13.486020 15515 raft_consensus.cc:2468] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 17.
W20260709 13:07:13.501456 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 89765.6us
I20260709 13:07:13.524608 16145 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:13.470484 21775 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:13.502331 21761 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:13.532608 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 178528us
W20260709 13:07:13.533119 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.533416 15482 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
W20260709 13:07:13.533890 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.534560 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.537974 21667 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.539520 21667 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.540339 21529 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.544488 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:13.545305 15515 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.551137 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.528098 21745 raft_consensus.cc:2804] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:13.549604 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:13.559363 15515 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:13.561432 15406 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:13.506522 21770 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:07:13.475903 15340 rpcz_store.cc:269] 0709 13:06:57.053923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.054220 (+   297us) service_pool.cc:224] Handling call
0709 13:06:57.380988 (+326768us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:13.467199 (+16086211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:05.687237 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:05.688098 (+   861us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:05.688155 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:07:05.688203 (+    48us) tablet.cc:662] Decoding operations
0709 13:07:05.690405 (+  2202us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:05.690519 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:05.690593 (+    74us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:07:05.815221 (+124628us) tablet.cc:701] Row locks acquired
0709 13:07:05.815283 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:07:05.815533 (+   250us) write_op.cc:270] Start()
0709 13:07:05.815815 (+   282us) write_op.cc:276] Timestamp: P: 1783602425815437 usec, L: 0
0709 13:07:05.815870 (+    55us) op_driver.cc:348] REPLICATION: starting
0709 13:07:05.905563 (+ 89693us) log.cc:844] Serialized 9907 byte log entry
0709 13:07:06.443792 (+538229us) op_driver.cc:464] REPLICATION: finished
0709 13:07:06.779731 (+335939us) write_op.cc:301] APPLY: starting
0709 13:07:06.818133 (+ 38402us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:08.255862 (+1437729us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b180006e7a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf7ba960ec 00007fcf7ba98af7 00007fcf7ba99fb0 00007fcf7f7ae1bb 00007fcf7f7ae532 00007fcf7f7f5b93 00007fcf7f6a2de3 00007fcf7f6a26ab 00007fcf7f6a3e77
0709 13:07:08.568400 (+312538us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:08.568447 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:09.345558 (+777111us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:09.345996 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:07:09.346068 (+    72us) write_op.cc:312] APPLY: finished
0709 13:07:09.346583 (+   515us) log.cc:844] Serialized 220 byte log entry
0709 13:07:09.584578 (+237995us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.598975 (+ 14397us) write_op.cc:454] Released schema lock
0709 13:07:09.632360 (+ 33385us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:09.633102 (+   742us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.633161 (+    59us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26704,"reported_tablets":52,"spinlock_wait_cycles":513684864,"child_traces":[["op",{"apply.queue_time_us":280812,"apply.run_cpu_time_us":72313,"apply.run_wall_time_us":2884190,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":88295,"prepare.run_cpu_time_us":47773,"prepare.run_wall_time_us":349642,"raft.queue_time_us":103302,"raft.run_cpu_time_us":9437,"raft.run_wall_time_us":184090,"replication_time_us":627705,"spinlock_wait_cycles":5245696,"thread_start_us":512529,"threads_started":5,"wal-append.queue_time_us":519523,"wal-append.run_cpu_time_us":18389,"wal-append.run_wall_time_us":2245880}]]}
I20260709 13:07:13.568342 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.573541 15441 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:13.576232 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.577409 15438 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:13.578595 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.579651 21798 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.581812 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.585341 20706 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:13.586964 15439 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:13.588342 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.548622 21669 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:13.593596 15434 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:13.593714 20706 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:13.594451 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:13.595471 15438 raft_consensus.cc:606] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:13.595976 15438 raft_consensus.cc:614] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:13.597381 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:13.605098 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 153753us
I20260709 13:07:13.547809 21797 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:13.572599 21726 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:13.595476 20706 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.531626 21775 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.621833 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.622640 15441 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:13.583859 21745 raft_consensus.cc:697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:13.627003 15407 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.627764 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:13.629381 16174 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:13.635854 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:13.636500 16174 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
W20260709 13:07:13.637881 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 91121.9us
I20260709 13:07:13.638963 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:13.639128 15407 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.639784 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.609444 21727 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.609881 21726 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.640784 16178 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:13.570401 21796 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:07:13.644148 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:13.657202 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.645725 21797 raft_consensus.cc:2764] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:07:13.644377 21778 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:13.670581 15407 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.649256 21726 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.647684 21777 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:13.604628 21798 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.634747 21789 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.691234 21796 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:13.691691 21769 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:13.691869 21796 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.667348 21805 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:07:13.694296 21805 consensus_queue.cc:1243] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:13.694607 15440 raft_consensus.cc:1275] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:13.695744 15407 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:13.696913 21770 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.698022 21770 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:13.698370 15442 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:13.682364 21774 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.701792 21764 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:13.679570 21631 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.702868 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:13.703775 15512 raft_consensus.cc:2410] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:13.707767 21745 consensus_queue.cc:237] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.708837 21775 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.691773 21591 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.649799 21727 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.718261 21591 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.720263 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:13.681414 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:13.684481 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.661787 21669 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:13.676646 21768 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:13.721099 15515 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:13.738359 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 94009.9us
I20260709 13:07:13.684150 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.739928 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:13.740108 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.740737 15583 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:13.679378 21529 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:13.745500 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.748051 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.719172 21798 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.691691 21789 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.698405 21770 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.722594 21736 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.757151 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.747270 21797 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:07:13.746994 21775 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:07:13.742538 21631 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.755484 21591 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:13.765681 15436 raft_consensus.cc:1275] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:13.767620 15515 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:13.737022 21796 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.769600 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:13.891649 15437 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.890300 21631 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.770606 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.896121 15441 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:13.896971 21631 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.771457 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:13.898777 15435 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:13.777976 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:13.899835 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 121986us
I20260709 13:07:13.808818 21727 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:13.901386 15556 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:13.839247 21769 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:13.841032 15439 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:13.842583 15442 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:13.773288 21669 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:07:13.920332 21529 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:13.922515 21529 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:13.923058 21529 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.923492 21529 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.926808 15406 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:13.928992 21398 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:13.929697 21398 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:13.930766 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:13.931733 15515 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:13.931001 21398 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.754408 21711 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 13:07:13.935704 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.863480 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:13.936769 21775 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:13.937371 15583 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.937427 21775 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.865226 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:13.888028 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:13.890367 21591 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.813234 21770 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.940409 21775 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:13.940651 21591 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.940963 15590 raft_consensus.cc:2410] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:13.903162 15556 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:13.945022 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:13.946929 21300 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:13.948761 21639 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:13.949186 21639 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.949537 21639 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.949347 21591 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.914995 21768 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:13.953378 21774 consensus_queue.cc:1048] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:13.953295 21768 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.954655 15556 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:13.903920 21769 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.747161 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:13.951756 21692 consensus_queue.cc:1059] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:13.916795 21605 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:13.955848 21605 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.956279 21605 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:13.956861 21769 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:13.956976 15437 raft_consensus.cc:2468] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:13.947350 21300 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.957614 21300 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.959882 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:13.966230 21702 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:13.966646 21692 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:13.967176 21692 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:13.966712 21702 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:13.968529 21702 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:13.968091 21692 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.969378 21692 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.971796 21768 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:13.972651 21529 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:13.975339 21775 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:13.975903 21775 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.976300 21775 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:13.974120 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:13.973701 15583 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:13.980230 15556 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:13.980594 21371 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:13.981093 21578 raft_consensus.cc:2804] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:13.981191 21371 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.981654 21578 raft_consensus.cc:697] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:13.981840 21371 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:13.982673 21578 consensus_queue.cc:237] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.983217 21529 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:13.990612 21639 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:13.993212 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:13.994043 15442 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.871025 21736 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:13.998659 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:13.999339 15517 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 13.
W20260709 13:07:14.000013 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 252925us
I20260709 13:07:13.999867 21371 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.000643 16145 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:14.001564 21718 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:14.001974 21718 raft_consensus.cc:493] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.002177 21371 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:14.002334 21718 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.004859 21770 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.010385 15442 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:14.012594 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.023584 15436 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:13.846014 21726 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.017168 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:14.017927 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.025401 15556 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:14.032716 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 312896us
I20260709 13:07:14.035153 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:14.017813 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:14.019519 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 271567us
I20260709 13:07:14.038666 15482 leader_election.cc:304] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.040589 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.045859 15482 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.048003 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:14.020097 21736 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:14.020145 21667 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:14.019574 21591 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:14.213855 15436 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 22.
I20260709 13:07:14.161926 15434 raft_consensus.cc:606] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:14.249588 15434 raft_consensus.cc:614] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:14.222994 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 175874us
I20260709 13:07:14.213367 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:14.217173 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 186140us
I20260709 13:07:14.224972 15438 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:14.050031 21743 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:14.093286 21796 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:14.049209 21692 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:14.049319 21808 raft_consensus.cc:2749] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:14.022573 21702 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.049701 21669 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.158s
W20260709 13:07:14.216063 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 168147us
I20260709 13:07:14.253422 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:14.209358 21527 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:14.261278 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:14.246815 21803 log.cc:927] Time spent T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:07:14.245798 21767 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:14.279834 15482 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:14.253196 21658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.017s	sys 0.038s
W20260709 13:07:14.258267 21708 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.019s
W20260709 13:07:14.269155 16147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.023s
W20260709 13:07:14.273041 21650 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.008s	sys 0.017s
W20260709 13:07:14.285697 21745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.021s	sys 0.042s
W20260709 13:07:14.275969 21806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.019s	sys 0.045s
W20260709 13:07:14.322817 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.313522 16147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.009s	sys 0.023s
I20260709 13:07:14.312608 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:14.323750 15517 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:14.246351 21775 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:14.313341 21658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.017s	sys 0.042s
I20260709 13:07:14.252207 21605 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.300458 21795 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:14.318292 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 64960.9us
W20260709 13:07:14.322268 16148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.018s	sys 0.013s
W20260709 13:07:14.325275 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.365628 16148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.018s	sys 0.014s
I20260709 13:07:14.302664 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.366568 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.295534 21762 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.376570 21762 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.378480 15515 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:14.378834 21762 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:14.292273 21743 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.314283 21708 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.011s	sys 0.021s
I20260709 13:07:14.322571 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:14.333350 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:14.334584 21770 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:14.323084 21806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.019s	sys 0.045s
W20260709 13:07:14.320600 21745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.021s	sys 0.043s
W20260709 13:07:14.341873 21807 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:14.341782 15517 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
W20260709 13:07:14.320348 21650 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.009s	sys 0.017s
I20260709 13:07:14.345573 21300 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.347883 21639 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:14.349771 21702 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:14.331066 21767 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:14.352145 21775 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:14.402242 15406 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:14.295840 21796 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:14.319784 21527 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:14.366883 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 64347.6us
W20260709 13:07:14.308475 21540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.011s	sys 0.023s
I20260709 13:07:14.374333 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:14.422322 15510 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:14.375259 21808 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:14.391647 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.425634 15583 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:07:14.329989 21797 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:14.403996 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.404963 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.428618 15589 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 19.
I20260709 13:07:14.405833 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.407723 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.430512 15436 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 18.
I20260709 13:07:14.409691 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.432017 15517 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:14.354566 21726 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:14.416006 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.422930 15442 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:14.410392 21398 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:14.417977 21540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.013s	sys 0.023s
I20260709 13:07:14.420064 21527 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.439206 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.447079 15583 raft_consensus.cc:2410] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:07:14.436463 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:14.419850 21789 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:14.438392 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:14.397836 21743 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:14.448853 21527 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.410465 21631 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:14.452736 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:14.439554 21669 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:14.462011 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.462682 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.475518 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:14.476226 15590 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.476357 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.473694 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:14.477409 15583 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:14.479732 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.451187 21398 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:14.487496 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.497758 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:14.457253 21796 raft_consensus.cc:2764] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:14.499490 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:14.458274 21789 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:14.509512 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.499534 15591 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:14.503795 15583 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:14.469139 21805 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:14.487803 21591 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:14.526929 20706 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:14.491592 21398 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.509231 21669 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:14.538174 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:14.540405 15437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.023s	sys 0.007s
W20260709 13:07:14.540844 15437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.024s	sys 0.008s
I20260709 13:07:14.518749 21805 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:14.528918 21398 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.557279 15441 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:14.561836 20706 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:14.572453 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 08f534c2cc884d65b268a74636da80eb: Illegal state: Replica 5ccb2e30f44f40c2b22339e1d4c74a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:14.549371 21711 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:14.580480 16174 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:14.582684 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:14.583388 15590 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:14.551697 21639 raft_consensus.cc:493] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:14.550953 21805 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.555011 21692 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:14.562284 21774 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:14.595350 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 115729us
I20260709 13:07:14.598819 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:14.603973 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:14.616010 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.616995 21764 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:07:14.609022 21718 consensus_meta.cc:287] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
I20260709 13:07:14.671975 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.672654 15434 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.608976 21745 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:14.607227 21824 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.621300 21669 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:07:14.638620 21823 log.cc:927] Time spent T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:07:14.678318 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 64664.8us
I20260709 13:07:14.679791 21669 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:07:14.641232 21811 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:07:14.682773 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.683426 15442 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.645694 15584 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:14.687470 21718 raft_consensus.cc:515] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:14.688225 15589 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:07:14.688622 15589 pending_rounds.cc:85] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 7
I20260709 13:07:14.672106 21837 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:14.688963 15589 pending_rounds.cc:107] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:07:14.689261 15589 raft_consensus.cc:2889] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.675273 21745 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.655288 21692 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.689970 21605 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:14.690349 16175 raft_consensus.cc:2368] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:07:14.689805 21745 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:14.692777 21767 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.605659 21774 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:14.694378 21810 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.242s	user 0.007s	sys 0.002s
I20260709 13:07:14.652635 21743 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:14.596858 21639 raft_consensus.cc:515] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:14.664911 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.704638 15437 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.664945 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.668169 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.705902 15436 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.706395 15442 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:14.689803 21718 leader_election.cc:290] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:14.714092 15436 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:14.715924 15437 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
W20260709 13:07:14.670135 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54236.5us
I20260709 13:07:14.720618 15434 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:14.721789 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:07:14.671264 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 74126.5us
I20260709 13:07:14.675833 15514 raft_consensus.cc:1275] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:14.677928 21824 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.680807 21669 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.596279 21789 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.693297 21767 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:14.695984 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:14.696758 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.697099 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:14.729954 15438 raft_consensus.cc:606] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.695484 21774 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:14.669994 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.734038 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.734536 15439 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.705891 15515 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 12.
I20260709 13:07:14.675727 21764 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 22 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:14.730098 15511 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.737113 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:14.701706 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.730558 15438 raft_consensus.cc:614] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:14.731714 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:14.722725 21841 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:07:14.740865 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.745412 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.749060 15587 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 19: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:07:14.749696 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50974.5us
I20260709 13:07:14.751029 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.753364 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:14.754751 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.756191 15584 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:07:14.756633 15585 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:14.763692 15439 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:14.764957 15589 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 18: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:14.767789 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.769821 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.770310 15515 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:14.771461 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.774237 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.775597 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.728219 21796 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:14.778452 15438 raft_consensus.cc:2368] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15.
I20260709 13:07:14.791648 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.791980 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:14.792814 15591 raft_consensus.cc:3060] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.707566 21527 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:14.781343 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.784121 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.807928 15439 raft_consensus.cc:2468] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:14.787770 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:14.765659 15482 connection.cc:256] RPC call timeout handler was delayed by -1.1654383340001004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:07:14.809569 15482 connection.cc:256] RPC call timeout handler was delayed by -1.0898383340000919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:07:14.809819 15442 raft_consensus.cc:2393] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 19: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:14.810719 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.779340 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.811252 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.779707 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.727669 21591 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:14.776467 21667 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.804340 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:14.820796 15437 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:07:14.822180 15437 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:07:14.822415 15511 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:14.765949 21826 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:14.789908 21718 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:14.823949 15434 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:14.823935 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:14.812220 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53286.6us
I20260709 13:07:14.824404 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:14.834370 15439 raft_consensus.cc:2393] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 18: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
W20260709 13:07:14.825532 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 97556us
I20260709 13:07:14.734077 21795 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:07:14.790652 21796 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:14.825800 16145 leader_election.cc:304] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:14.734989 21743 consensus_queue.cc:1048] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:07:14.834065 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.824731 15437 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:14.812814 15442 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
W20260709 13:07:14.841488 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 144812us
I20260709 13:07:14.845825 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:14.827450 21837 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.848297 21711 raft_consensus.cc:2804] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:14.856400 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:14.859318 20706 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:14.831720 21718 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:14.895803 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.847743 21796 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:14.897917 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 53427.4us
I20260709 13:07:14.829487 21667 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.850091 21826 raft_consensus.cc:493] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.908869 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 97676.8us
I20260709 13:07:14.896373 21817 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:14.920797 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.921327 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.921456 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.923367 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.788995 21843 consensus_queue.cc:1048] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:07:14.852501 21795 consensus_queue.cc:1243] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer d225833a2cbf4a5995fdbbb1292d1918 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:14.903956 21711 raft_consensus.cc:697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:14.824950 21669 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:07:14.918134 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.934249 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.910722 15556 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:14.919425 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.919826 15518 raft_consensus.cc:1240] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:14.924780 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.937012 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.901791 21851 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:14.925880 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:14.944334 15590 raft_consensus.cc:3060] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.936843 15556 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:14.925786 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.926530 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:14.947885 15556 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:14.948015 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.901891 21840 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.910679 21718 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.914491 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:14.931061 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.931197 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.935794 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.896960 21762 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:14.937852 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.942817 15438 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:07:14.948529 15442 raft_consensus.cc:606] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:14.917141 21797 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:14.953708 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:14.950452 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:14.959957 15512 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:14.937062 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:14.953496 21774 raft_consensus.cc:2804] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:14.852373 21764 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.959630 21854 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:14.962091 21824 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:14.944541 21808 consensus_meta.cc:287] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.001s
I20260709 13:07:14.978036 21808 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:14.925750 21639 leader_election.cc:290] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:14.979441 21639 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:14.980142 21639 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:14.981369 21639 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:14.910475 21529 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:07:14.950132 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.987192 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.988122 15509 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:14.989272 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.990628 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.964459 15516 raft_consensus.cc:2368] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:07:14.960826 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.992241 15511 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 12: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:14.961787 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.994720 15513 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:14.969028 15590 raft_consensus.cc:2468] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:14.972410 16175 raft_consensus.cc:3055] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:14.996002 16175 raft_consensus.cc:740] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:14.973564 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.976598 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.997090 15518 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 14.
I20260709 13:07:14.949872 21828 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:14.998333 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.923782 21826 raft_consensus.cc:515] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:14.962709 21797 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:15.009070 21845 log.cc:927] Time spent T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:07:15.009970 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:14.938324 21398 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.014856 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:15.016049 21850 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:07:15.016081 15518 raft_consensus.cc:1275] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:15.030411 15407 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:15.019556 15513 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:15.018448 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:15.020347 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.033054 15512 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:15.020320 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 92803.3us
I20260709 13:07:15.026798 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:15.026777 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.031746 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:14.950392 21833 consensus_queue.cc:1059] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:07:15.046954 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952f15e68b0745e5a8ca26a3b527cab0" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.047827 15514 raft_consensus.cc:2368] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:07:14.999766 21774 raft_consensus.cc:697] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:14.998623 21767 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:15.005964 21854 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:15.025437 21852 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.061460 15440 raft_consensus.cc:2368] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15.
W20260709 13:07:15.066354 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 168939us
I20260709 13:07:15.025816 21828 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:15.080024 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:15.063578 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 109972us
I20260709 13:07:15.051287 21527 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:15.093662 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:15.083042 15513 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:15.116451 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:15.117108 15513 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:15.117657 21864 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:15.118366 21864 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:15.119346 21864 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.127884 21300 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:15.097604 21767 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:15.136111 21767 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:15.137583 15513 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:15.139756 15591 raft_consensus.cc:2468] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:07:15.136413 16175 consensus_queue.cc:260] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:15.095598 15512 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 22.
I20260709 13:07:15.044566 21711 consensus_queue.cc:237] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:15.155493 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:15.158223 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 127860us
I20260709 13:07:15.072446 21852 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.082677 21856 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:07:15.161402 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:15.173036 21857 log.cc:927] Time spent T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:15.157455 21854 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.157074 21667 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:15.177542 21728 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:15.184844 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134472us
I20260709 13:07:15.184871 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:15.185976 15435 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:15.186825 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:15.190470 15556 leader_election.cc:400] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:07:15.190997 15556 leader_election.cc:403] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:15.181392 21578 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:15.205750 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.206784 15513 raft_consensus.cc:2393] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:15.207826 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:15.215216 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55899.3us
I20260709 13:07:15.143895 21774 consensus_queue.cc:237] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:15.222067 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:15.223218 21866 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:15.196903 21775 raft_consensus.cc:2749] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529) with higher term. Message: Invalid argument: T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:07:15.229378 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:15.266721 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 75009.8us
I20260709 13:07:15.276682 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.279670 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:15.281095 15435 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:15.282369 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:15.283103 16178 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:15.279788 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:15.286479 15442 raft_consensus.cc:606] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:15.222113 21826 leader_election.cc:290] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:15.288096 15555 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.050s (SENT)
I20260709 13:07:15.289445 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:15.293430 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.294077 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4f3caf80c04c18bd2d225b9e630e92" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.190450 21767 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.168959 21828 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.235213 21796 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
W20260709 13:07:15.288815 21745 consensus_meta.cc:287] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Time spent flushing consensus metadata: real 0.596s	user 0.013s	sys 0.000s
I20260709 13:07:15.301530 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:15.304735 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:15.306102 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.291827 21667 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.326089 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:15.295881 21775 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.325870 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.327922 15591 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:15.328087 15515 raft_consensus.cc:2468] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
I20260709 13:07:15.331394 15509 raft_consensus.cc:2393] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:15.338595 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.304944 21847 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:15.336589 21876 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:07:15.347956 15513 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:15.300180 21718 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:15.352272 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.354094 21718 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:15.355103 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.360908 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:15.309232 21745 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:15.351644 21872 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:07:15.352083 21805 consensus_meta.cc:287] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.004s
I20260709 13:07:15.355391 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.356549 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.358987 16179 raft_consensus.cc:1240] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:15.348919 15513 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:15.394485 15513 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:15.395077 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 63787.4us
I20260709 13:07:15.395609 15513 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.365072 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:15.399869 15511 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:15.359797 21852 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:15.333357 21775 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.331048 21667 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:15.421712 15511 raft_consensus.cc:2468] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:15.421484 16178 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:15.428303 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:15.428488 15513 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:07:15.439189 15513 pending_rounds.cc:85] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 8
I20260709 13:07:15.439590 15513 pending_rounds.cc:107] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:07:15.439918 15513 raft_consensus.cc:2889] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.442305 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:15.435413 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:15.466660 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 57343us
W20260709 13:07:15.467785 15555 leader_election.cc:336] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Timed out: RequestConsensusVote RPC to 127.13.245.66:34291 timed out after 2.230s (SENT)
I20260709 13:07:15.451942 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:15.469959 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:15.418057 21669 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:15.493517 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:15.508648 15513 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.512823 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:15.406728 21805 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.476752 21852 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:15.493002 21718 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:15.603385 21702 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:15.562404 21886 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:15.679826 21852 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.525067 21669 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:15.731647 21880 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
W20260709 13:07:15.727237 21862 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.428s	user 0.002s	sys 0.000s
I20260709 13:07:15.723763 21578 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.724792 21796 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
W20260709 13:07:15.745272 21711 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.013s
I20260709 13:07:15.729378 21852 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:15.741510 21797 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.704s	user 0.014s	sys 0.000s
W20260709 13:07:15.769038 21711 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.008s	sys 0.014s
W20260709 13:07:15.796363 21882 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:07:15.798035 21884 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:07:15.799911 21885 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:07:15.801465 21890 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:15.879494 21775 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:15.784250 21745 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:15.897354 21862 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:07:15.789453 21797 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.894870 21667 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:15.771585 21578 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:15.921554 21805 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:15.941623 21797 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:15.944087 21578 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:16.017366 15437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.018s	sys 0.027s
W20260709 13:07:16.018625 15437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.018s	sys 0.027s
W20260709 13:07:16.019999 15435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.006s	sys 0.009s
W20260709 13:07:16.020684 15435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.006s	sys 0.009s
W20260709 13:07:16.025966 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.024667 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:16.028465 15435 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:16.032208 15510 raft_consensus.cc:1240] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:15.522648 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:16.038244 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 515533us
I20260709 13:07:16.040103 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2712) took 1083 ms. Trace:
I20260709 13:07:16.040719 15516 rpcz_store.cc:276] 0709 13:07:14.956995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.993941 (+ 36946us) service_pool.cc:224] Handling call
0709 13:07:14.994209 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.994598 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.994625 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.995150 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.141684 (+146534us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:15.211666 (+ 69982us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.211988 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.212094 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.039410 (+827316us) raft_consensus.cc:1685] finished
0709 13:07:16.039457 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.039833 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114190,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2171,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":226,"thread_start_us":210964,"threads_started":2,"wal-append.queue_time_us":213738}
I20260709 13:07:16.044910 15441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36426 (request call id 1) took 1344 ms. Trace:
I20260709 13:07:16.045437 15441 rpcz_store.cc:276] 0709 13:07:14.700371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.700545 (+   174us) service_pool.cc:224] Handling call
0709 13:07:16.044204 (+1343659us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003f8ed4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5d735 00007fcf80d1dd29 00007fcf7a29c1d4 00007fcf7a29c162 00007fcf7a29c091 00007fcf7a29c00c 00007fcf7a29b2c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:16.044558 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773497728}
W20260709 13:07:16.046470 15558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.011s	sys 0.032s
W20260709 13:07:16.047173 15558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.011s	sys 0.032s
W20260709 13:07:16.080364 15555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.007s
W20260709 13:07:16.080999 15515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.013s
W20260709 13:07:16.081435 15555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.008s
W20260709 13:07:16.081842 15515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.005s	sys 0.013s
W20260709 13:07:16.082106 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 560687us
I20260709 13:07:16.095328 21867 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.097543 21867 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.121121 21797 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:16.129527 21777 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.131053 21777 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.132876 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:16.134496 21797 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:16.137668 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d8364b020b43deb510a118a19d076a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.139451 15514 raft_consensus.cc:2410] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:16.103263 21858 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:16.150841 21805 raft_consensus.cc:476] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 13:07:16.154657 15482 leader_election.cc:400] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15.
I20260709 13:07:16.158814 21777 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:16.164404 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 80592.9us
I20260709 13:07:16.171271 15590 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:16.177897 15586 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:16.193208 21805 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:16.194238 21805 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.207803 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.208797 21858 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.210754 21770 raft_consensus.cc:993] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:16.213737 21398 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.214651 21858 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:16.213101 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 91258.6us
I20260709 13:07:16.218429 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.214753 15585 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:16.225560 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3769) took 1663 ms. Trace:
I20260709 13:07:16.226277 15510 rpcz_store.cc:276] 0709 13:07:14.561985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.562161 (+   176us) service_pool.cc:224] Handling call
0709 13:07:14.562492 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.032786 (+1470294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.225007 (+192221us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54001e55d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:16.225445 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3378608512}
I20260709 13:07:16.230521 21669 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:16.235883 15514 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:16.237260 21867 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:16.238556 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 84432.7us
I20260709 13:07:16.240772 15482 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:16.247638 21805 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:16.277210 15513 consensus_meta.cc:287] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.767s	user 0.015s	sys 0.012s
I20260709 13:07:16.249581 15509 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:16.278151 21805 raft_consensus.cc:2764] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:16.252903 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.253547 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.279433 15517 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:07:16.280192 15517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40670 (request call id 2729) took 1076 ms. Trace:
I20260709 13:07:16.280644 15517 rpcz_store.cc:276] 0709 13:07:15.204216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.207349 (+  3133us) service_pool.cc:224] Handling call
0709 13:07:16.253204 (+1045855us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800159998. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32eee 0000000000375939 00007fcf80ca61e0 00007fcf80d6f0c4 00007fcf80d6f131 00007fcf80d1d0a0 00007fcf80d1c984 00007fcf7a2976d4 00007fcf7a297662
0709 13:07:16.280105 (+ 26901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2723584}
I20260709 13:07:16.252810 21398 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.282994 21398 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.257711 16175 raft_consensus.cc:3060] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:16.268206 21828 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.288256 21828 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.289093 16178 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:16.292146 21828 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:16.273334 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 43866.2us
I20260709 13:07:16.273792 15592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51310 (request call id 1106) took 1696 ms. Trace:
I20260709 13:07:16.234359 21777 raft_consensus.cc:1081] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:16.248808 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.293709 15516 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 11.
I20260709 13:07:16.294661 15555 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:16.293170 15592 rpcz_store.cc:276] 0709 13:07:14.577325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.577465 (+   140us) service_pool.cc:224] Handling call
0709 13:07:14.577717 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.704088 (+126371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.704120 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.704160 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:14.704190 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.272929 (+1568739us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000564d4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:16.273062 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.273443 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290176256}
I20260709 13:07:16.296212 21828 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:16.296797 21828 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:16.297330 21828 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:16.298007 21789 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.307673 16179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 666) took 1029 ms. Trace:
I20260709 13:07:16.308347 16179 rpcz_store.cc:276] 0709 13:07:15.278314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.284523 (+  6209us) service_pool.cc:224] Handling call
0709 13:07:15.284881 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.393517 (+108636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.306830 (+913313us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b540049bbd4. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:16.307255 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169792384}
I20260709 13:07:16.319420 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:16.345620 16145 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:16.355967 21398 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.363029 15585 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:16.364751 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:16.365257 15514 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:16.365744 15587 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:16.324033 15513 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:16.299036 21789 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.369936 21789 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.371985 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:16.373208 15590 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:16.377055 15406 leader_election.cc:304] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:16.408419 15511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
W20260709 13:07:16.409796 21846 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.024s	sys 0.111s
W20260709 13:07:16.410374 21846 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.024s	sys 0.111s
I20260709 13:07:16.420277 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.421409 15591 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 10.
I20260709 13:07:16.422405 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.423692 15518 raft_consensus.cc:2410] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:16.402606 21805 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:16.429176 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 120531us
I20260709 13:07:16.434495 15585 raft_consensus.cc:1217] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Deduplicated request from leader. Original: 12.10->[14.11-14.11]   Dedup: 14.11->[]
W20260709 13:07:16.434798 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 89863.7us
I20260709 13:07:16.435143 15585 raft_consensus.cc:1240] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:07:16.435840 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76565.8us
I20260709 13:07:16.431748 15511 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.437219 15511 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:16.425726 21805 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:16.438184 16175 raft_consensus.cc:1275] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:16.446022 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.449004 21736 raft_consensus.cc:2804] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:16.450538 21825 consensus_queue.cc:1059] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:16.423702 21906 raft_consensus.cc:2749] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:16.452502 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:16.457175 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.443783 21805 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:16.456763 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:16.469007 21839 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:16.463804 16175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52918 (request call id 663) took 1551 ms. Trace:
I20260709 13:07:16.473259 16175 rpcz_store.cc:276] 0709 13:07:14.907927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.908636 (+   709us) service_pool.cc:224] Handling call
0709 13:07:14.918862 (+ 10226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.972302 (+ 53440us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b54004b94a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bccedc0 00007fcf7bd591c0 00007fcf7bd5a231 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c
0709 13:07:15.136035 (+163733us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b54004b94a0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcd506f 00007fcf7bd4df60 00007fcf7bd4f7de 00007fcf7bd59b49 00007fcf7bd5a416 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62
0709 13:07:16.255848 (+1119813us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b58005798d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd4dfe7 00007fcf7bd4f7de 00007fcf7bd59b49 00007fcf7bd5a416 00007fcf7bd56d8f 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4
0709 13:07:16.443049 (+187201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.459331 (+ 16282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391959040}
I20260709 13:07:16.475586 15587 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:16.484988 15406 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:16.485339 21906 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:16.486478 21827 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:16.486763 21906 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:16.487082 21827 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.487383 21906 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:16.487732 21827 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.465329 21736 raft_consensus.cc:697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:16.488831 21906 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.489743 21767 consensus_queue.cc:1059] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:07:16.490381 21906 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:16.490098 21736 consensus_queue.cc:237] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.492550 21839 raft_consensus.cc:3055] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:16.493161 21839 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:16.494546 21839 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.496145 21839 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.496394 21851 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:16.498163 15406 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:16.516718 15439 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:07:16.507293 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 202677us
I20260709 13:07:16.516062 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:16.524343 15590 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 20.
I20260709 13:07:16.524677 21797 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:16.525437 21797 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.501273 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:16.535943 15443 raft_consensus.cc:2393] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:16.538568 21895 raft_consensus.cc:3055] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:16.539093 21895 raft_consensus.cc:740] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:16.540366 21895 consensus_queue.cc:260] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.542053 21895 raft_consensus.cc:3060] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:16.550733 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:16.503283 21852 consensus_meta.cc:287] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.720s	user 0.004s	sys 0.020s
I20260709 13:07:16.570048 15511 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.562136 21777 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:16.569901 21797 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.569509 21852 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:16.580446 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 79467.1us
I20260709 13:07:16.582329 21852 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:16.583820 21838 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:16.568861 21902 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:16.586027 21669 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:16.587656 21669 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:16.588085 21669 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:16.589146 21669 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.590638 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:16.591436 15437 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:07:16.559413 21796 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:07:16.590447 21669 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:16.592288 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:16.593515 15439 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 14.
I20260709 13:07:16.594013 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.594691 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.595360 15512 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 22.
I20260709 13:07:16.592288 21797 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:16.596565 21797 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:07:16.597317 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 138950us
I20260709 13:07:16.598311 15555 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:16.603147 15437 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 20.
I20260709 13:07:16.614835 21789 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:16.615041 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:16.615929 15584 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.615722 21789 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.616590 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.617911 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.618221 21789 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:16.619801 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:16.620620 16175 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.621273 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:16.622064 21864 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:16.626714 15437 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 20: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:16.629437 21745 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:07:16.627005 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 76531.5us
W20260709 13:07:16.633402 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.637631 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:16.636806 21864 consensus_queue.cc:1048] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:07:16.642242 21745 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 20 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:16.644261 15587 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:07:16.646689 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet f91e9b24450f4bc88be5be6228d8587f: Illegal state: Replica 5ccb2e30f44f40c2b22339e1d4c74a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:16.647166 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:16.650609 21894 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:16.652354 21894 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:16.654403 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:16.655611 21796 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.656324 21796 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.657295 21827 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.658277 15584 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:16.658572 21796 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.659358 21718 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:16.660115 21718 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.662705 21718 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.663828 21864 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:16.666630 15555 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:16.625761 21797 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.668223 21745 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:16.669251 21914 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:16.673087 21797 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:16.667471 16175 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:16.676119 21900 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:16.621258 21777 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:16.692896 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:16.693871 15510 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.681695 15482 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:16.670707 21894 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:16.680080 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.698622 21852 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:16.699348 21852 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.700311 21902 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.700915 21902 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.702610 15511 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:16.703408 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 63869.9us
I20260709 13:07:16.638870 21789 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:16.691182 21900 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.702699 21852 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.670428 21828 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.707037 21827 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.670872 21796 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:16.721724 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:16.723192 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 82533161d7894b3db9b0230e076936b2: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:16.724835 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:16.717603 21900 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:16.726239 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:16.729301 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:16.731036 16175 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 15: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:16.731005 15586 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.707423 21851 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:07:16.735212 15583 raft_consensus.cc:2410] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:16.737417 15511 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:16.739712 21718 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:16.740208 21718 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:16.740607 21718 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:16.732929 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.744196 15509 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:16.729329 21852 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.720436 21789 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.743940 21669 raft_consensus.cc:2804] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:16.773825 21828 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:16.779054 21902 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.783044 21871 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.783771 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 117260us
W20260709 13:07:16.786877 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 115352us
I20260709 13:07:16.789467 15482 leader_election.cc:400] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15.
I20260709 13:07:16.789845 15482 leader_election.cc:403] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:07:16.791260 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:16.771958 21669 raft_consensus.cc:697] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:16.802472 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:16.757007 21777 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.772804 21852 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.770196 21805 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.808465 15443 raft_consensus.cc:2393] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 14: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:16.818418 15555 leader_election.cc:400] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 13. Current term is 14.
I20260709 13:07:16.793236 21871 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.849244 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:16.851366 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:16.862910 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.865703 21918 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:07:16.876478 21900 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:16.881003 21917 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:16.883315 21900 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 23 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.886956 21789 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:16.855912 21838 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:16.923254 15510 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:16.820075 21796 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:16.918883 21669 consensus_queue.cc:237] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.927743 15586 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 12.
I20260709 13:07:16.928619 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:16.930691 15514 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:16.930713 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:16.932328 15406 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:16.922961 21838 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:16.950528 21838 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:16.939236 21805 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:16.959275 21805 raft_consensus.cc:493] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:16.960168 21851 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:16.960022 21805 raft_consensus.cc:515] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.960855 21851 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:16.964277 15516 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:16.927493 21796 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:16.969990 21796 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.971591 20706 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:16.972158 20706 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:16.973219 20706 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.975271 21789 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.976127 21789 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:16.979704 21774 consensus_queue.cc:1048] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:07:16.981698 21925 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15.
I20260709 13:07:16.982705 21925 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:16.979893 21852 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.983343 21925 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:16.986256 21925 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:16.989279 21789 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:16.997326 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 188915us
I20260709 13:07:17.001870 21805 leader_election.cc:290] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:16.825861 21827 consensus_queue.cc:1059] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:07:17.005954 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:17.006397 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:17.021423 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:17.004240 21796 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:17.034598 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 90679.6us
W20260709 13:07:17.046411 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.060688 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:17.064658 15514 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 23.
I20260709 13:07:17.060714 15517 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:17.001789 21851 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:17.061487 21895 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:17.095932 15408 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.098685 21924 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.099314 21924 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:17.101683 21924 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:17.102273 21882 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:07:17.104293 15511 raft_consensus.cc:2410] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:17.114722 15434 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:07:17.127473 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 164176us
I20260709 13:07:17.123515 15406 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:17.153178 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:17.126899 21871 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:17.172389 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 85463.4us
W20260709 13:07:17.176363 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.155151 21770 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:17.127295 21718 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:17.146245 21894 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:17.196017 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:17.223469 21768 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:17.224057 20706 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:17.230945 20706 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:17.236056 21774 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.236747 21774 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:17.238499 21923 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.232s	user 0.004s	sys 0.000s
I20260709 13:07:17.239001 21718 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:17.239136 21774 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:17.242082 21900 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:17.242765 21900 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:17.244378 21900 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:17.245504 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:17.247819 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 458531us
W20260709 13:07:17.248513 21926 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:17.250679 15482 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.252354 21805 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:17.247394 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:17.210608 21827 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:07:17.227087 21768 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.291297 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:17.286796 21895 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:17.264773 21774 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:17.356235 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 199834us
I20260709 13:07:17.296736 21768 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:17.354542 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 134905us
I20260709 13:07:17.233495 21745 consensus_queue.cc:1059] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:07:17.402794 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 206864us
W20260709 13:07:17.407729 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 157166us
I20260709 13:07:17.354141 21895 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:17.432597 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:17.356439 21933 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:17.403245 21902 raft_consensus.cc:493] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:07:17.446908 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 155776us
W20260709 13:07:17.458485 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54462.1us
I20260709 13:07:17.460351 15513 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:17.460578 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.459908 15407 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.458225 21902 raft_consensus.cc:515] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:17.469370 21838 consensus_meta.cc:287] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.002s
W20260709 13:07:17.485567 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.477198 21902 leader_election.cc:290] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:17.547140 21930 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:07:17.548002 21934 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260709 13:07:17.556806 21929 log.cc:927] Time spent T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:07:17.564222 21953 raft_consensus.cc:3055] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:17.565127 21940 log.cc:927] Time spent T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:07:17.569231 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 91293.6us
W20260709 13:07:17.564232 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 111314us
I20260709 13:07:17.489634 21745 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.535624 21933 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:17.606282 21953 raft_consensus.cc:740] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:17.651353 21947 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:17.602639 21851 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:17.676273 21930 log.cc:927] Time spent T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:17.677408 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.495725 21838 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:17.703043 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 248599us
I20260709 13:07:17.677959 21789 raft_consensus.cc:3055] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:17.716645 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:17.621896 21745 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:17.729220 15443 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:17.713349 21789 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
W20260709 13:07:17.743363 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 66066.6us
W20260709 13:07:17.735014 21939 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.142s	user 0.001s	sys 0.003s
I20260709 13:07:17.720489 21933 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:17.748772 15512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40676 (request call id 3805) took 1057 ms. Trace:
I20260709 13:07:17.658567 21947 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:17.653103 21953 consensus_queue.cc:260] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:17.754856 15514 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:17.770773 21947 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:17.772090 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.749246 15512 rpcz_store.cc:276] 0709 13:07:16.691797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.691973 (+   176us) service_pool.cc:224] Handling call
0709 13:07:16.707123 (+ 15150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.711822 (+  4699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.711854 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.713084 (+  1230us) log.cc:844] Serialized 501 byte log entry
0709 13:07:17.124177 (+411093us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:17.124220 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.124290 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.748536 (+624246us) raft_consensus.cc:1685] finished
0709 13:07:17.748559 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.748705 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":410668,"threads_started":1,"wal-append.queue_time_us":513930}
I20260709 13:07:17.779083 21960 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.782677 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.791615 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 84719us
I20260709 13:07:17.783244 21924 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:17.801262 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.808120 15511 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:17.815956 21817 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:07:17.787279 21960 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:17.822057 15555 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:17.819002 21669 raft_consensus.cc:493] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:17.824815 21669 raft_consensus.cc:515] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:17.825600 21960 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:17.833273 21928 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.838513 21745 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:17.834481 21928 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:17.839843 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 380067us
W20260709 13:07:17.844472 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 50564.4us
I20260709 13:07:17.845089 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:17.845391 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.847121 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:17.848225 21886 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:17.850183 21796 consensus_meta.cc:287] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.008s
I20260709 13:07:17.849932 15555 leader_election.cc:304] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:17.828415 21933 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:17.853785 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.854378 21933 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:17.854943 21960 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:17.855512 21529 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:17.862987 21864 raft_consensus.cc:493] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:17.861375 21886 raft_consensus.cc:2749] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:17.863731 21864 raft_consensus.cc:515] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:17.869872 21768 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:17.870715 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:17.861863 21838 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:17.866585 21864 leader_election.cc:290] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:17.874581 21928 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:17.880290 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:17.880635 15337 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 115) took 12306 ms (client timeout 15000 ms). Trace:
I20260709 13:07:17.851435 21669 leader_election.cc:290] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:17.919656 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:17.920118 21669 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:17.920398 15440 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:17.812343 21789 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:17.891084 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:17.922003 21789 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:17.922156 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 72412.7us
I20260709 13:07:17.923154 15555 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:17.924825 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:17.926838 21529 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:17.926951 21886 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:17.906879 21956 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.928951 21956 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:17.931209 21956 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:17.909972 21895 raft_consensus.cc:493] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.912200 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:17.913064 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:17.913899 21838 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:07:17.914521 21957 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.350s	user 0.004s	sys 0.002s
I20260709 13:07:17.915452 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:17.916378 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:17.916640 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:17.917371 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:17.918757 15436 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:17.919365 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:17.932001 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:17.909371 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.928859 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:17.937520 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:17.940096 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:07:17.968613 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 43934us
I20260709 13:07:17.970063 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:17.942981 21770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.021s
I20260709 13:07:17.988030 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:17.989323 21900 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:17.995724 21838 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:17.997534 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:17.998158 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.000201 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.002104 15407 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.010905 21906 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:18.013473 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.017313 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:17.945775 21895 raft_consensus.cc:515] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:18.034149 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:17.982510 21770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.012s	sys 0.021s
I20260709 13:07:18.107576 15591 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:18.006758 21718 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:18.100270 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 88082.4us
I20260709 13:07:18.014122 21967 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:18.014761 21950 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:18.128365 21956 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.128964 21956 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:18.007930 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.125671 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:18.101751 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 52655.6us
I20260709 13:07:18.108191 15587 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:18.125644 21886 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:18.125952 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42725e017f142629708ff226f2d53e1" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.126236 21768 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:18.146826 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:18.147470 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 139557us
I20260709 13:07:18.151358 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.158208 21745 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:18.159722 16147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.903228 15337 rpcz_store.cc:269] 0709 13:07:05.574463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.574803 (+   340us) service_pool.cc:224] Handling call
0709 13:07:17.880334 (+12305531us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:13.682332 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:13.704286 (+ 21954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:13.704324 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:13.704342 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:13.705246 (+   904us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:13.705314 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:13.705342 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:07:13.705943 (+   601us) tablet.cc:701] Row locks acquired
0709 13:07:13.705964 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:13.706143 (+   179us) write_op.cc:270] Start()
0709 13:07:13.706287 (+   144us) write_op.cc:276] Timestamp: P: 1783602433706086 usec, L: 0
0709 13:07:13.706308 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:13.706999 (+   691us) log.cc:844] Serialized 2452 byte log entry
0709 13:07:14.665217 (+958218us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf7b8f286e 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221 00007fcf7b8fb1d9 00007fcf7b8fb169
0709 13:07:14.958950 (+293733us) op_driver.cc:464] REPLICATION: finished
0709 13:07:16.139368 (+1180418us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf78c4d0ac 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7f78def0
0709 13:07:16.526327 (+386959us) write_op.cc:301] APPLY: starting
0709 13:07:16.526478 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:16.531398 (+  4920us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:16.531436 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:16.794308 (+262872us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:16.883076 (+ 88768us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:07:16.883170 (+    94us) write_op.cc:312] APPLY: finished
0709 13:07:16.883829 (+   659us) log.cc:844] Serialized 65 byte log entry
0709 13:07:17.194054 (+310225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:17.242167 (+ 48113us) write_op.cc:454] Released schema lock
0709 13:07:17.242248 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:17.242988 (+   740us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:17.243029 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":600851,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":1513728,"apply.run_cpu_time_us":27748,"apply.run_wall_time_us":723288,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29207,"num_ops":6,"prepare.queue_time_us":85901,"prepare.run_cpu_time_us":65373,"prepare.run_wall_time_us":732086,"raft.queue_time_us":208066,"raft.run_cpu_time_us":137668,"raft.run_wall_time_us":1501646,"replication_time_us":1217748,"spinlock_wait_cycles":47731072,"thread_start_us":2536714,"threads_started":5,"wal-append.queue_time_us":1073837,"wal-append.run_cpu_time_us":68862,"wal-append.run_wall_time_us":1409873}]]}
I20260709 13:07:18.161533 21886 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.131489 21956 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:18.164274 21886 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:18.164621 21864 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:18.165370 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 256081us
I20260709 13:07:18.165297 21864 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.166891 21967 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:18.168475 15584 raft_consensus.cc:1275] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
W20260709 13:07:18.168741 21932 log.cc:927] Time spent T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: Append to log took a long time: real 0.927s	user 0.006s	sys 0.010s
I20260709 13:07:18.168903 15584 pending_rounds.cc:85] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 10
I20260709 13:07:18.169409 21895 leader_election.cc:290] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:18.169538 21950 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:18.170079 21895 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:18.106607 21796 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.170979 21796 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.173218 21796 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:18.175253 21849 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.177294 21838 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:18.177127 21849 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.107056 21770 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:18.177752 20706 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:18.178819 21770 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.181404 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:18.182457 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:18.183053 15518 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:18.184101 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:18.184880 15514 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:18.187407 15515 raft_consensus.cc:1240] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:18.192097 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47348.1us
I20260709 13:07:18.197690 15406 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:18.199092 21900 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:18.199836 21964 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:18.202328 21962 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:18.203145 21838 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:18.203604 21838 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.203938 21838 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.204520 21962 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 6 to 13, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:18.208755 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.209297 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:18.169430 15584 pending_rounds.cc:107] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:07:18.210549 15584 raft_consensus.cc:2889] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:18.200227 15437 raft_consensus.cc:2410] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:07:18.214016 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:18.215030 15514 raft_consensus.cc:2410] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:07:18.216229 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:18.218338 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.219177 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:18.220587 21864 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:18.222985 21849 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:18.227612 15516 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:18.229427 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 46405.8us
I20260709 13:07:18.236969 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:18.238826 15583 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:18.236944 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:18.239733 21950 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.240274 21950 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:18.242591 21950 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:18.238924 15587 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:18.237141 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:18.246704 15510 raft_consensus.cc:2410] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for term 16 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:18.227733 15514 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 6 to 13, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:18.266737 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.269605 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.270531 15586 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:18.262912 16145 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.272562 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.274385 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.280129 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.281373 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.282656 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.284955 15407 leader_election.cc:304] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.285451 21817 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:18.286728 21906 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:18.287247 21906 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:18.289573 21906 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:18.293861 21900 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:18.294684 21900 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:18.297829 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.298010 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.298883 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:18.295328 21900 raft_consensus.cc:2749] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:18.299209 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:18.300105 15511 raft_consensus.cc:2393] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 15: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:18.300443 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.302249 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.302582 21745 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:18.302938 15440 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:18.303885 21959 consensus_queue.cc:1048] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:18.304986 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:18.283425 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:18.306006 15592 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:18.311815 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:18.312536 15437 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:18.313871 15436 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:18.316182 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.336128 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.315239 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:18.338079 15587 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:18.337939 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.341809 15516 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:18.343410 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.347862 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:18.348635 15589 raft_consensus.cc:3060] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:18.310236 21953 raft_consensus.cc:3060] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:18.351281 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.359845 20706 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:18.360512 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.374367 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.375733 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.376447 15584 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:18.384044 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.385775 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.354838 15443 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:07:18.391940 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.410851 21851 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:18.391999 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:07:18.393534 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.411680 21851 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:18.414105 21851 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:18.416546 15435 raft_consensus.cc:1240] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:18.418036 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.398686 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b4902277e34c9f97dd7889ac3f8375" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.422333 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b747e7ea77471f95bf6fbb4eb03bab" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.410686 15518 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:18.423815 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.425436 15592 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:18.419697 15407 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.432587 15440 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:18.436565 21849 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:18.441430 21827 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:18.442844 21968 consensus_queue.cc:1059] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:18.443562 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.443837 21968 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:18.444218 21968 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:18.448642 15406 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.450407 15437 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:18.444218 15443 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:18.447885 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:18.461047 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:18.461333 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:18.462037 15585 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
I20260709 13:07:18.477372 15587 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:18.480458 15406 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.482096 15592 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:18.482787 15482 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.445196 21968 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:18.460538 21924 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.506844 20706 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:18.508687 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.511359 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:18.511328 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 44879.7us
I20260709 13:07:18.514429 15482 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:18.518282 20706 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:18.488413 21718 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:18.457373 21838 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.529515 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.532433 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.536486 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.542841 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:18.539444 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.544137 15440 raft_consensus.cc:1275] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:18.544188 15587 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:18.545043 15482 leader_election.cc:304] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:18.546634 15437 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:18.495683 21852 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:18.570639 16182 raft_consensus.cc:2393] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 15: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:18.548796 15407 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.549479 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:18.512418 21928 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.586076 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:18.588546 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 440133us
W20260709 13:07:18.580870 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 478772us
I20260709 13:07:18.549481 20706 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.593076 15441 raft_consensus.cc:2368] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18.
I20260709 13:07:18.488756 21849 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:07:18.594817 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 46102.9us
I20260709 13:07:18.570892 21967 raft_consensus.cc:2749] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.545789 21718 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.593547 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:18.571934 21966 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:18.571086 21796 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:18.581476 21941 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:18.614347 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.515609 21924 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.549054 21959 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:18.550068 21777 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:18.586030 21852 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:18.637921 15555 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.606024 21968 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:18.622610 21718 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:18.628887 21398 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:18.641943 21967 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:18.646564 21900 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:18.649847 21796 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:18.671876 21966 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:18.706462 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 66612.7us
I20260709 13:07:18.635713 21972 consensus_queue.cc:1059] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:07:18.645486 21959 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:18.696623 21967 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.708530 21529 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:18.741120 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:18.736564 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 187128us
I20260709 13:07:18.775381 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:18.713465 21902 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:18.708146 21398 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.728828 21977 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:18.750458 21967 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:18.788419 15482 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:18.789398 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 168865us
I20260709 13:07:18.814966 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.756147 21928 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:07:18.850417 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:18.815341 21851 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:18.856005 15440 raft_consensus.cc:2393] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:18.831063 21838 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:18.865132 15555 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.869338 21900 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:18.869899 21900 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:18.771936 21852 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:18.876552 21993 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:07:18.878146 21979 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:07:18.880070 15443 raft_consensus.cc:1240] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:18.886780 21900 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:18.834105 21796 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.889111 21900 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:18.894239 15589 consensus_meta.cc:287] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.000s
I20260709 13:07:18.894727 15589 raft_consensus.cc:2468] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:18.913204 21959 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:18.915076 21398 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:18.915321 21928 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:18.891839 21989 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:18.933987 21972 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:18.934280 21982 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:07:18.944526 21895 raft_consensus.cc:3055] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:18.945272 21895 raft_consensus.cc:740] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:18.937211 21924 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:18.947896 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 88500.1us
I20260709 13:07:18.949260 15555 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:18.950831 21529 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:18.951449 21529 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:18.954196 21989 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:18.955423 21989 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.963961 21529 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:18.966706 21529 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:18.924422 21962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56808 (request call id 4) took 4584 ms. Trace:
I20260709 13:07:18.977980 16174 raft_consensus.cc:2468] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:18.969457 15439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47420 (request call id 763) took 1055 ms. Trace:
W20260709 13:07:18.978363 16146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.000597 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:18.974058 21971 log.cc:927] Time spent T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.599s	user 0.005s	sys 0.002s
I20260709 13:07:18.946637 21895 consensus_queue.cc:260] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:19.005226 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 216852us
I20260709 13:07:19.007477 15482 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:18.969472 21962 rpcz_store.cc:276] 0709 13:07:14.361813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.390196 (+ 28383us) service_pool.cc:224] Handling call
0709 13:07:14.550287 (+160091us) spinlock_profiling.cc:243] Waited 925 us on lock 0x7b58006ce6d0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd5270a 00007fcf7bd5376a 00007fcf7bd5291b 00007fcf7bd5e03c 00007fcf7bd5d6b3 00007fcf7bd559fa 00007fcf80d1d4c9 00007fcf7a299c54
0709 13:07:14.588716 (+ 38429us) log.cc:844] Serialized 501 byte log entry
0709 13:07:16.161010 (+1572294us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b2c000014c8. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a650a11 00007fcf7a65fa0a 00007fcf7a65f693 00007fcf7a65f631 00007fcf7bd93b52 00007fcf7bd93cf5 00007fcf7bcd0691 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69
0709 13:07:16.245846 (+ 84836us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b18000e5f20. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd93d01 00007fcf7bcd0691 00007fcf7bcb0eaa 00007fcf7bcb7d53 00007fcf7bcb7cd9 00007fcf7bcb7c69 00007fcf7bcb7c31 00007fcf7bcb6dfd 000000000038f354 000000000038f199
0709 13:07:18.911950 (+2666104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70018,"raft.queue_time_us":66858,"raft.run_cpu_time_us":73582,"raft.run_wall_time_us":2978904,"spinlock_wait_cycles":3315625344,"thread_start_us":78272,"threads_started":1,"wal-append.queue_time_us":78523,"wal-append.run_cpu_time_us":11660,"wal-append.run_wall_time_us":1194442}
I20260709 13:07:18.990859 15439 rpcz_store.cc:276] 0709 13:07:17.913951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.915458 (+  1507us) service_pool.cc:224] Handling call
0709 13:07:17.915821 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.101430 (+185609us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:07:18.515276 (+413846us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.813715 (+298439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.814950 (+  1235us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:18.815031 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.969104 (+154073us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b5400069d54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:18.969177 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.969351 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":497128,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6514,"raft.queue_time_us":32256,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8477,"spinlock_wait_cycles":187987328,"thread_start_us":601641,"threads_started":2,"wal-append.queue_time_us":386659}
I20260709 13:07:19.018570 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:19.000344 21864 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:19.023136 21981 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.241s	user 0.004s	sys 0.000s
I20260709 13:07:19.029610 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.032016 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.033051 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.039917 21928 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:19.040824 21992 log.cc:927] Time spent T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:07:19.020725 21999 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:19.041437 15438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 2999) took 1124 ms. Trace:
I20260709 13:07:19.041818 15438 rpcz_store.cc:276] 0709 13:07:17.916681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.917397 (+   716us) service_pool.cc:224] Handling call
0709 13:07:17.917718 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.918116 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.918145 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.918804 (+   659us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.980283 (+ 61479us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.980322 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.980387 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.973585 (+993198us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b2400139e98. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78af09c4 00007fcf78aeeacb 00007fcf78ca9dc9 00007fcf78ca9a55 00007fcf78ca909d 00007fcf7b8db10e 00007fcf7b8f288c 00007fcf7b8f1bb6 00007fcf7b8f17d8 00007fcf7b8fb221
0709 13:07:19.040950 (+ 67365us) raft_consensus.cc:1685] finished
0709 13:07:19.040974 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.041243 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4887,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":63817088,"thread_start_us":56732,"threads_started":1,"wal-append.queue_time_us":204321}
I20260709 13:07:19.042789 21967 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.029171 21895 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:19.042935 15336 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 9 to 13, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 13 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.045586 21967 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:19.046486 21894 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.003796 21972 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:19.047101 21894 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.049656 21894 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:19.050578 21796 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:19.057339 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:19.058459 22000 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:19.059016 22000 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:19.059422 22000 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:19.062333 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.063256 21999 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:19.063686 21999 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.064043 21999 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:19.071847 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1915fdd81d344a749443e48f07a1fef8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:07:19.072394 15513 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:19.083575 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:19.087921 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.088665 15512 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 21.
I20260709 13:07:19.096365 21718 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:19.097736 16179 raft_consensus.cc:1240] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:19.100175 15406 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:19.101159 21962 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:19.101613 21962 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:19.102006 21962 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:19.110273 15482 leader_election.cc:304] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.113778 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:19.117444 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.102917 21718 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:19.125941 21928 raft_consensus.cc:2804] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:19.097930 21900 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:07:19.141225 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:19.142025 15590 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:19.141896 16179 raft_consensus.cc:2955] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 6 to 13, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:19.143527 22000 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.109452 21796 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:19.148348 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:19.151237 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:19.155879 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:19.158002 15586 raft_consensus.cc:1240] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:19.115150 21989 raft_consensus.cc:2749] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:19.165874 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.166917 21928 raft_consensus.cc:697] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:19.168073 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:19.172528 21906 consensus_queue.cc:1059] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:19.168140 21928 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.173527 21838 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:19.181427 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 64086.7us
I20260709 13:07:19.182895 15482 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:19.184597 15482 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.186470 15482 leader_election.cc:400] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18.
I20260709 13:07:19.196799 15590 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:19.174925 21906 raft_consensus.cc:3055] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:19.197438 21967 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:07:19.223748 22003 log.cc:927] Time spent T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.197s	user 0.000s	sys 0.002s
I20260709 13:07:19.197084 21924 consensus_queue.cc:1048] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:07:19.210590 15589 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:19.228456 15589 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:19.197045 21989 raft_consensus.cc:2804] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:19.209662 21906 raft_consensus.cc:740] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:19.243878 22000 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:19.235417 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:19.234071 15589 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:19.312757 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 61800.3us
I20260709 13:07:19.317539 21902 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:19.318274 21902 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.320791 21902 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:19.322098 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:19.211097 21967 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.339370 15589 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:19.323586 21967 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:19.355290 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 167744us
I20260709 13:07:19.357318 15434 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:19.359719 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:19.363325 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:19.363925 15590 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:19.363797 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:19.363731 15443 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:19.325071 21989 raft_consensus.cc:697] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:19.374279 15434 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:19.371879 15589 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
W20260709 13:07:19.373082 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 62461.2us
I20260709 13:07:19.375155 15589 pending_rounds.cc:85] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 12
I20260709 13:07:19.376497 15589 pending_rounds.cc:107] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:07:19.376812 15589 raft_consensus.cc:2889] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.386440 15510 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 22. Current term is 23. Ops: []
W20260709 13:07:19.398123 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 144639us
W20260709 13:07:19.395094 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 70533.9us
I20260709 13:07:19.400432 15434 raft_consensus.cc:1240] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 LEADER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:19.402103 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.409045 15434 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:19.415288 15510 raft_consensus.cc:1240] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:19.373863 21906 consensus_queue.cc:260] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:19.431936 15590 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:19.439515 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:19.440277 15434 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:19.403795 21838 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:19.441632 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.444289 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:19.444885 15443 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:19.443745 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.448227 15517 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:19.441071 21902 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:19.415843 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:19.449956 16179 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:19.453292 15517 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:07:19.450860 15435 raft_consensus.cc:606] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:19.453644 15517 pending_rounds.cc:85] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 8
I20260709 13:07:19.454314 15517 pending_rounds.cc:107] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:07:19.454602 15517 raft_consensus.cc:2889] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.521171 21989 consensus_queue.cc:237] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:19.525070 21768 consensus_queue.cc:1059] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:19.456849 21906 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:19.528700 22002 log.cc:927] Time spent T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:07:19.455175 21902 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.545535 21902 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:19.547641 15406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.548763 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:19.550511 21962 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.554112 15513 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:19.556157 21994 consensus_queue.cc:1059] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:19.540298 15336 catalog_manager.cc:5697] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 10 to 13, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 13 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:19.556341 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.451478 21999 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.560820 15443 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:19.562354 15437 raft_consensus.cc:1240] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:19.571888 15509 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:19.577374 15439 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:19.590680 21999 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:19.593050 15406 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:19.600097 21864 consensus_queue.cc:1059] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:19.601095 21864 consensus_queue.cc:1243] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:19.601691 21864 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:19.602051 21864 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:19.605448 21966 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:19.605783 21972 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:19.607306 21972 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:19.607963 21972 consensus_queue.cc:1243] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 5ccb2e30f44f40c2b22339e1d4c74a83 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:19.609123 21894 raft_consensus.cc:3055] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:19.609550 21894 raft_consensus.cc:740] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:19.610503 21894 consensus_queue.cc:260] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:19.603063 21864 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.611225 21838 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:19.628062 21894 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:19.628584 21789 raft_consensus.cc:3055] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:19.584553 21852 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:19.684645 15517 raft_consensus.cc:1240] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:19.695642 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 274061us
I20260709 13:07:19.696190 15512 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:19.697412 15407 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:19.701130 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.692230 21838 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:19.718508 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 113364us
I20260709 13:07:19.694662 21789 raft_consensus.cc:740] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:19.704767 21852 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:19.703914 21924 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:19.707623 21770 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:19.787020 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 57908.1us
W20260709 13:07:19.741959 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.713996 21864 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:19.803923 15509 raft_consensus.cc:3060] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:19.728835 21838 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:19.809615 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:19.720461 21902 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:07:19.814858 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:19.820782 15517 raft_consensus.cc:2368] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
W20260709 13:07:19.823453 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 123821us
I20260709 13:07:19.795737 21852 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:19.810282 15434 raft_consensus.cc:606] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:19.835074 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.840675 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:19.842370 15443 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Rejecting Update request from peer 6ff41728dec842afad5b53c20446a5a0 for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:19.847909 15557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.848093 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:19.845688 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.809284 21398 raft_consensus.cc:493] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:19.814254 21770 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:19.857461 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:19.859786 22012 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:07:19.860814 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 423df90a9f55438bbe1c32ab906c6e10: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:07:19.861045 22014 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:07:19.865758 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9178296553b44a3f82267d1278be3746"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:19.826118 21962 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:19.894795 15587 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:19.895224 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:19.868983 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f193cb849d4553a3e9a29aa592583a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.869340 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.870158 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.873256 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4152881cdccb4731a3bd4a47c960307b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.824447 21999 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.876663 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:19.884631 15509 raft_consensus.cc:1275] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:19.890650 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:19.892673 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:19.898406 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:19.900095 15509 raft_consensus.cc:1240] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:19.812377 21978 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:07:19.894228 15438 raft_consensus.cc:606] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:19.905560 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:19.826310 21529 consensus_queue.cc:1059] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:07:19.920487 21529 raft_consensus.cc:3055] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:19.921013 21529 raft_consensus.cc:740] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:19.815014 21924 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.885828 21966 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.931453 22019 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:07:19.884002 21398 raft_consensus.cc:515] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.855369 21789 consensus_queue.cc:260] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:19.960455 21789 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:19.960557 21398 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:19.970335 15482 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:19.976473 21796 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:19.989019 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:19.719918 15336 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 11 to 15, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 15 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.990859 15555 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:19.994535 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56799.9us
I20260709 13:07:19.907676 21999 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:20.018929 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:20.026135 15435 pending_rounds.cc:85] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting all ops after (but not including) 7
I20260709 13:07:20.026640 15435 pending_rounds.cc:107] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:07:20.026928 15435 raft_consensus.cc:2889] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.026206 21902 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:20.028594 21902 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.031391 21902 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.039934 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:19.945318 21966 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:20.050966 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:20.017086 21796 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:20.045137 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:20.065955 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 102896us
I20260709 13:07:20.068550 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:20.073701 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:20.040709 21978 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.051914 21977 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.085506 15437 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:20.054137 21900 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:20.063455 21928 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:20.090935 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 45884.4us
I20260709 13:07:20.023904 22024 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:07:19.992094 21770 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:20.108723 21906 consensus_meta.cc:287] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.001s
I20260709 13:07:20.136059 15436 raft_consensus.cc:2410] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:20.067353 21972 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:20.094310 21953 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:20.142549 22029 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:07:20.143260 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 100179us
I20260709 13:07:20.141036 21743 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:07:20.148700 22013 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.147940 21796 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.137723 21736 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.096973 21928 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.189787 21928 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:20.190377 21924 leader_election.cc:290] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:20.183976 22009 log.cc:927] Time spent T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:20.177532 21838 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.192169 15336 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 15 to 18, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 18 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:20.194489 21838 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.185804 22013 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.207880 22013 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.211243 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:20.157199 21902 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.216917 21967 consensus_meta.cc:287] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.005s
W20260709 13:07:20.277837 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 264100us
I20260709 13:07:20.287187 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:20.290992 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.299942 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 205605us
I20260709 13:07:20.222229 21736 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:20.305215 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 225681us
I20260709 13:07:20.310972 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:20.310799 22027 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:20.252121 21967 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.331974 21736 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.337749 21838 raft_consensus.cc:993] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:20.338613 21838 raft_consensus.cc:1081] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:20.341873 15510 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:20.300208 22029 log.cc:927] Time spent T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:20.309942 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:20.229712 21902 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.352946 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:20.353914 15438 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:20.359094 15590 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:20.361475 15590 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:20.363070 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:20.365283 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.366003 15590 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:20.366161 15588 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 20: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:20.368252 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd0644c7dd431aa808e206e7ea031e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.277290 22039 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:07:20.370261 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.306114 21978 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.340313 21839 raft_consensus.cc:993] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:20.377166 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:20.388124 15435 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:20.389305 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:20.392323 15437 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:20.396265 15509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:20.344321 21906 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.397169 15509 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:20.397895 15509 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:20.377007 21768 raft_consensus.cc:993] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:20.457343 15440 raft_consensus.cc:1240] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:20.456521 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 61727us
I20260709 13:07:20.459740 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:20.230373 15336 catalog_manager.cc:5697] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 10 to 18, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 18 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:20.407032 21987 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:20.470184 21987 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.472748 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:20.473488 16179 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 15.
I20260709 13:07:20.436914 21966 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:20.411464 21906 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.400339 22013 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:07:20.488353 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.470582 21987 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:20.504884 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:20.393963 21978 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.475610 21839 raft_consensus.cc:1081] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:20.521461 15509 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.406550 21851 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
W20260709 13:07:20.528064 21864 consensus_meta.cc:287] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.705s	user 0.003s	sys 0.012s
W20260709 13:07:20.531153 21894 consensus_meta.cc:287] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.002s
I20260709 13:07:20.531678 22028 raft_consensus.cc:1081] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:20.549429 15586 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:07:20.533416 15509 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.540475 15589 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:20.473178 21928 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.552971 15512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:20.553167 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 274217us
I20260709 13:07:20.554440 21928 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.555222 15555 leader_election.cc:400] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:07:20.555724 15555 leader_election.cc:403] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:07:20.557731 15585 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:07:20.558319 15585 pending_rounds.cc:85] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 11
I20260709 13:07:20.558679 15585 pending_rounds.cc:107] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:07:20.558421 15555 leader_election.cc:304] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.559072 15585 raft_consensus.cc:2889] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.565318 15555 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:20.571308 22047 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:20.572840 21978 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:20.572569 15336 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:20.579623 21902 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.579416 21529 consensus_queue.cc:260] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.581001 21906 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.580892 22061 consensus_queue.cc:1048] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:20.572880 22053 log.cc:927] Time spent T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:20.586319 21789 consensus_meta.cc:287] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.000s
I20260709 13:07:20.565073 21977 raft_consensus.cc:2749] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.571483 22023 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:20.591202 21795 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:20.592072 21795 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:20.592308 22020 consensus_queue.cc:1059] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:20.561328 21894 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291) with higher term. Message: Invalid argument: T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 14. Current term is 15.
I20260709 13:07:20.593685 22042 raft_consensus.cc:3055] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:20.593348 21795 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:20.594269 22042 raft_consensus.cc:740] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:07:20.595086 22049 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.199s	user 0.001s	sys 0.002s
I20260709 13:07:20.595367 22042 consensus_queue.cc:260] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.597961 15555 leader_election.cc:304] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:20.598419 21852 consensus_meta.cc:287] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.004s
I20260709 13:07:20.598915 21864 raft_consensus.cc:2749] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.600353 15510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40670 (request call id 2752) took 1128 ms. Trace:
I20260709 13:07:20.600719 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.602185 21864 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.598858 21852 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.591336 21977 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:20.603951 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.609359 21977 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:07:20.609705 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 46abb05486504a60be4a4d104d3295f7: Illegal state: Replica 8a55534dc8864943937d5b6ec0e6aaf9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:20.610838 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.611692 21977 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:20.613097 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.614554 21977 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.614886 21967 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.615482 21852 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.624200 21999 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:20.600781 15510 rpcz_store.cc:276] 0709 13:07:19.520670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.523338 (+  2668us) service_pool.cc:224] Handling call
0709 13:07:19.523709 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.345783 (+822074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.600069 (+254286us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400213c54. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd57e01 00007fcf7bd5683e 00007fcf80d1b419 00007fcf7a292bd4 00007fcf7a292b62 00007fcf7a292a91 00007fcf7a292a0c 00007fcf7a291cc2 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:20.600282 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880966400}
I20260709 13:07:20.574568 15336 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 14 to 17, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 17 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:20.595122 21795 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:20.639246 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:20.639967 15586 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:20.642788 21950 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:20.643419 21950 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:20.645816 21950 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:20.656836 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 43848.2us
I20260709 13:07:20.658258 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:20.660311 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:20.664320 15482 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:20.669152 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:20.672104 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:20.663200 21967 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:07:20.677932 21977 consensus_queue.cc:1059] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:20.678936 21977 consensus_queue.cc:1243] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:20.686625 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:20.690932 21928 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.661520 21999 consensus_queue.cc:1059] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:07:20.673725 21968 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:20.663445 22040 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.721251 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:20.732753 15586 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:20.736935 15509 raft_consensus.cc:1240] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:07:20.719866 21796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.015s	sys 0.030s
I20260709 13:07:20.731021 21894 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:20.734145 21967 raft_consensus.cc:493] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:20.731253 22039 consensus_queue.cc:1059] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:20.760180 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:20.734701 15482 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:20.773594 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.771831 15438 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:07:20.733803 22042 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:20.778430 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43862.8us
I20260709 13:07:20.771185 21967 raft_consensus.cc:515] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:20.830353 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:20.776861 21928 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:20.754487 22051 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:20.833330 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.833807 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:20.842855 15440 raft_consensus.cc:606] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.843600 15440 raft_consensus.cc:614] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:20.765750 21736 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.851876 21736 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:20.854841 21736 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:20.856035 15591 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:20.831864 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.861861 15436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47420 (request call id 781) took 1021 ms. Trace:
I20260709 13:07:20.862476 15436 rpcz_store.cc:276] 0709 13:07:19.840330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.847838 (+  7508us) service_pool.cc:224] Handling call
0709 13:07:20.861587 (+1013749us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54000a5354. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bd5b2fa 00007fcf80d1cb17 00007fcf7a2976d4 00007fcf7a297662 00007fcf7a297591 00007fcf7a29750c 00007fcf7a2967c2 00007fcf7a09248c 00007fcf7a0918c6 00007fcf7a09126f
0709 13:07:20.861779 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659690368}
I20260709 13:07:20.771823 22013 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:20.865558 21972 consensus_queue.cc:1059] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:20.866622 21972 raft_consensus.cc:3055] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:20.867028 21972 raft_consensus.cc:740] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:20.868014 21972 consensus_queue.cc:260] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.834635 15407 leader_election.cc:304] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:20.770654 21796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.019s	sys 0.030s
I20260709 13:07:20.764958 22059 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.846915 22051 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.848150 21989 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:20.809116 22026 raft_consensus.cc:2804] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:20.891877 21989 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.879244 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:20.830402 22055 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.893502 15442 raft_consensus.cc:606] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.893638 22055 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.841583 21928 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:20.895115 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.879457 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:20.895535 21928 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.896375 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.896632 21928 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:20.837069 22039 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:20.897177 22055 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:20.897607 22039 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.884269 22059 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:20.898514 22045 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.309s	user 0.000s	sys 0.005s
I20260709 13:07:20.878250 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:20.771013 21894 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:20.887159 21967 leader_election.cc:290] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:20.894308 21989 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.879061 21972 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:20.886657 22051 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.906044 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:20.903007 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:20.909683 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:20.911316 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:20.893090 22026 raft_consensus.cc:697] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:20.896663 21968 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:20.913822 15440 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:20.915040 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:20.916163 22063 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:20.899804 21987 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:20.917622 22062 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:20.919450 15517 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:20.920531 22026 consensus_queue.cc:237] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.922411 21895 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:20.923947 21895 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:20.924335 21895 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:20.925310 21895 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.926789 21895 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:20.931061 21945 raft_consensus.cc:2749] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.935923 22059 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:20.937310 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 381149us
I20260709 13:07:20.942655 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:20.943352 15509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9178296553b44a3f82267d1278be3746"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:20.944000 15509 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:20.944343 22030 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:20.944380 15509 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.954457 21967 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:20.958612 15516 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:20.960045 15516 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:20.960959 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:20.962898 15516 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:20.960736 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:20.975400 15440 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:20.976073 22039 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:20.928762 21968 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:20.977998 21968 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.980429 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:20.982427 21977 consensus_queue.cc:1059] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:20.983793 21977 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:20.984177 21977 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:20.985185 21977 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.986934 21977 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:20.980063 21796 consensus_queue.cc:1175] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:20.991653 15482 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.012378 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 51758.1us
I20260709 13:07:21.015784 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
W20260709 13:07:21.018363 15556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.022284 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:21.026719 15440 raft_consensus.cc:1240] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:21.028021 15509 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:20.979411 21968 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:21.030494 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.031620 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:21.032298 16179 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:21.035409 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f534c2cc884d65b268a74636da80eb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:21.039678 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:21.039755 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:21.014928 22024 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:21.048936 15518 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:21.052544 16182 raft_consensus.cc:1275] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:21.056185 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:21.059569 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c950883b754dd6bb39c54f8c8134aa" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:21.061177 15584 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:21.031739 21978 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:21.034530 22063 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:21.069380 15509 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.077847 15440 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:21.077927 21736 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:21.069177 15441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.081971 21994 raft_consensus.cc:3055] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:21.038476 21906 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.088605 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet badc8a91586140ab8a3903619efbd8c9: Illegal state: Replica 8a55534dc8864943937d5b6ec0e6aaf9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:21.090957 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.096800 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:21.098805 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.099828 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:21.100482 15590 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:21.091856 21994 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:21.085614 22063 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.091575 21736 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.121472 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.125798 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:21.129367 15439 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:21.129701 15439 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:21.131124 15510 raft_consensus.cc:1240] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:21.119077 15516 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.134009 15515 raft_consensus.cc:1240] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:21.101864 21928 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:21.130407 15439 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.144076 15439 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:21.150658 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:21.156976 21718 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:21.128121 22063 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:21.132339 21736 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:21.107977 21906 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.169727 15516 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.170955 15406 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.148095 21852 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:07:21.180640 22072 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:07:21.189414 15590 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:21.193989 15439 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
W20260709 13:07:21.198652 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.200397 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.217809 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.140415 21994 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.152122 21928 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.199117 21945 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:21.200969 22062 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:21.208824 22059 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.240926 15583 raft_consensus.cc:1240] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:21.241032 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:21.195886 21852 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.250814 15438 raft_consensus.cc:1240] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:21.248593 21950 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:21.275519 15437 raft_consensus.cc:3055] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:21.276141 15437 raft_consensus.cc:740] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:21.277109 15437 consensus_queue.cc:260] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.279693 15437 raft_consensus.cc:3060] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:21.227641 21900 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.304219 15437 raft_consensus.cc:2468] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:21.286549 21994 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:21.313468 15407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.316215 15407 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.252882 22059 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.294592 21796 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:21.329483 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 83133us
I20260709 13:07:21.295578 21900 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:21.320640 22048 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:21.339345 21928 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.339892 21398 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:21.329017 21796 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.328770 22024 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:07:21.339848 21906 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.357286 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:21.358876 15514 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:21.353119 21900 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:21.372433 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:21.375048 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:21.377013 21796 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.361397 21928 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:21.378268 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:21.379813 21959 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:21.378540 21928 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.382752 21928 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.384084 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.384805 15587 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
W20260709 13:07:21.392335 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.400480 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:21.401295 16179 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:21.405385 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.406261 15587 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:21.413540 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:21.430945 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
I20260709 13:07:21.433799 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:21.423086 21928 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
W20260709 13:07:21.428112 22064 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:21.440761 22079 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:21.474346 21852 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.480384 21987 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:21.481768 21978 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
W20260709 13:07:21.498358 22075 log.cc:927] Time spent T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.270s	user 0.003s	sys 0.000s
I20260709 13:07:21.449536 21770 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:21.500742 22073 log.cc:927] Time spent T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.328s	user 0.002s	sys 0.000s
W20260709 13:07:21.503724 22070 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.481s	user 0.005s	sys 0.000s
I20260709 13:07:21.504611 15407 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:21.510061 22082 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:21.510818 22082 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.493945 21978 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:21.512475 21987 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:21.574666 21987 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.577711 21987 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.441280 21928 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.580600 21928 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.455168 22079 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.581519 22079 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:21.582901 21977 consensus_meta.cc:287] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: Time spent flushing consensus metadata: real 0.595s	user 0.015s	sys 0.001s
I20260709 13:07:21.523316 21529 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:21.511315 22082 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:21.597311 21978 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:21.483826 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 269014us
I20260709 13:07:21.537477 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:21.624977 16178 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:21.632258 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.632651 15482 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.633289 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:21.545127 22059 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:21.547205 22074 log.cc:927] Time spent T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:07:21.634335 16179 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:07:21.549655 22071 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:07:21.551944 15510 raft_consensus.cc:1240] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:07:21.552645 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:21.560343 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.560549 21900 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:21.640122 21900 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:21.642002 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.642760 16178 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:21.561542 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.564155 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:21.564992 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.644544 15440 raft_consensus.cc:2393] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 22: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:21.562569 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.648644 15583 raft_consensus.cc:2393] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 18: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:21.566514 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:21.650652 15584 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:21.572229 21968 consensus_meta.cc:287] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
I20260709 13:07:21.571951 21894 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:21.598861 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.652133 15518 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:07:21.652648 15518 pending_rounds.cc:85] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 9
I20260709 13:07:21.653067 15518 pending_rounds.cc:107] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:07:21.653384 15518 raft_consensus.cc:2889] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.528096 22063 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:21.601003 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.602205 15437 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:21.565615 15590 raft_consensus.cc:1275] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:21.603994 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.657168 15435 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 16: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:21.605346 22081 consensus_queue.cc:1059] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:21.611887 21852 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:21.663713 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:21.634233 15482 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.636571 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.665253 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:21.547821 21796 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:21.642839 21900 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.603281 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
W20260709 13:07:21.659466 15558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.591619 21736 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:21.668213 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:21.685734 15518 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:21.664937 15509 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:21.676872 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:21.657724 22063 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:21.663839 21928 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:21.693220 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:21.679610 21968 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:21.697443 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:21.717337 15590 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
I20260709 13:07:21.699452 15438 raft_consensus.cc:3055] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:21.718564 15438 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:21.717864 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.723362 16179 raft_consensus.cc:2393] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:21.733814 15584 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 22.
I20260709 13:07:21.733672 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.735638 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:21.731491 15438 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.715960 22026 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:21.685463 22068 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:21.674499 21852 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:21.696635 21945 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:07:21.685554 21796 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.757251 15438 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:21.744421 22036 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:21.742810 21827 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:21.763798 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:21.768286 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 73481.3us
W20260709 13:07:21.765010 22065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.005s	sys 0.035s
I20260709 13:07:21.752095 22026 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:07:21.774904 22065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.005s	sys 0.035s
I20260709 13:07:21.769347 22085 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:21.795531 22087 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:21.799734 22026 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.809015 15438 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 22.
W20260709 13:07:21.811184 22083 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:21.804124 22087 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:21.818130 21796 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.819197 15586 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 22.
I20260709 13:07:21.820433 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:21.815037 22082 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:21.841564 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 68387.6us
I20260709 13:07:21.844003 15482 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:21.832261 21529 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:21.835994 21886 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.835012 22087 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:21.853132 15439 raft_consensus.cc:2368] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19.
I20260709 13:07:21.857932 21736 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.859359 21852 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:21.842559 21900 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:21.863133 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:21.855263 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:21.860512 21886 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.870411 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:21.856506 21529 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:21.875823 15406 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:21.885947 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.841974 21796 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:07:21.861490 21987 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:21.861794 21968 consensus_queue.cc:1048] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:07:21.888684 21900 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:21.895488 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.900817 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.903914 15434 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 21: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:21.903731 15482 leader_election.cc:304] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.907651 21987 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:21.905084 22094 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:21.912209 15482 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.899328 22068 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:21.911921 21529 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:21.914736 22082 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:21.916712 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:21.917353 15509 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:07:21.924366 22094 raft_consensus.cc:2749] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.909096 21906 raft_consensus.cc:993] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:21.933064 21906 raft_consensus.cc:1081] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:21.935175 15510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:21.935817 15510 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:21.936151 15510 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:21.884924 22079 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:21.941493 22079 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:21.942292 15442 raft_consensus.cc:2368] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18.
I20260709 13:07:21.943810 22068 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:21.908748 21987 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:21.948834 22068 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:21.966351 21886 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:21.969087 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 58875.6us
W20260709 13:07:21.975871 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 0af1111c429c4e6fad608ff1eeac116b: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:21.978657 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:21.979334 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:21.979449 15584 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:21.979449 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:21.980013 15589 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:21.980203 15586 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:21.982501 21770 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:07:21.986688 21928 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:21.988210 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 76587.7us
I20260709 13:07:21.990007 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:21.990736 16179 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:21.992856 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:21.993376 15556 leader_election.cc:400] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18.
I20260709 13:07:21.993726 15556 leader_election.cc:403] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.993579 16178 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:21.995102 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:21.995779 15439 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 22.
I20260709 13:07:21.997243 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:21.999738 21796 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:22.001991 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.002230 15509 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:22.003525 16179 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:22.004024 21972 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:22.012400 21972 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.012805 21972 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:22.014536 15586 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:22.009418 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:22.016040 15434 raft_consensus.cc:3060] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:22.016494 15406 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:22.010721 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:22.017387 22062 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:22.017544 22026 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:22.018113 22062 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:22.019014 22062 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.055605 15584 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 18.
I20260709 13:07:22.011797 15589 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:22.069621 16146 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.052863 15510 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.058749 15482 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:22.060243 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:22.065274 15434 raft_consensus.cc:2468] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:22.070880 15407 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.076246 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:22.077905 15434 raft_consensus.cc:2393] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 20: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:22.068717 22000 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 for earlier term 17. Current term is 18.
I20260709 13:07:22.078953 22026 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:22.057928 22087 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.079397 22026 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:22.091202 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:22.092337 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:22.093297 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:22.096751 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:22.100888 15589 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:22.102402 15434 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 19: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:22.108060 15516 raft_consensus.cc:1240] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:22.116282 15510 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.118248 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
W20260709 13:07:22.120759 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 49945.2us
I20260709 13:07:22.121294 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:22.121984 15584 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:22.123347 15482 leader_election.cc:400] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19.
I20260709 13:07:22.123699 15482 leader_election.cc:403] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.123036 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:22.079991 22026 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:22.060345 21987 consensus_queue.cc:1048] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:22.143817 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:22.156870 15515 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 16: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:22.146741 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:22.147517 21796 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 18. Current term is 19.
I20260709 13:07:22.079739 22043 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:22.088371 21736 raft_consensus.cc:2804] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:22.083051 22087 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.164927 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:22.130158 21770 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:22.177330 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:22.178278 15584 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:22.176496 22094 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:22.181671 22094 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:22.182363 22094 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:22.191461 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:22.191350 22079 consensus_queue.cc:1059] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:22.192831 15442 raft_consensus.cc:3055] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:22.193174 15442 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:22.193897 15442 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.195147 15442 raft_consensus.cc:3060] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:22.200824 21770 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:22.201984 21770 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:22.205904 21972 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.171833 21736 raft_consensus.cc:697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:22.209467 21736 consensus_queue.cc:237] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:22.210268 15442 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
W20260709 13:07:22.211583 22079 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:07:22.162599 22043 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
W20260709 13:07:22.215142 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 50296.7us
W20260709 13:07:22.223948 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 81493.1us
I20260709 13:07:22.233232 15482 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:22.261968 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:22.266575 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:22.267421 15438 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:22.223888 22043 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:22.278878 15584 raft_consensus.cc:2468] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:22.281281 15438 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 23.
I20260709 13:07:22.282748 15556 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.276312 22093 raft_consensus.cc:2804] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:22.288033 21987 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:22.290117 21529 raft_consensus.cc:2804] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:22.308082 21987 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:22.316535 21529 raft_consensus.cc:697] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 23 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:22.310945 22093 raft_consensus.cc:697] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:22.316332 21972 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:22.351261 22093 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.336490 21987 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:22.358616 15585 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 16.
W20260709 13:07:22.362475 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 100611us
I20260709 13:07:22.363387 15482 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:22.380029 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:22.401434 22026 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.402902 15516 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 22.
W20260709 13:07:22.403128 22109 log.cc:927] Time spent T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:22.404949 21529 consensus_queue.cc:237] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.407652 22068 raft_consensus.cc:2749] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:22.379266 22094 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.414216 22094 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.417745 22043 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:22.435920 22026 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.441738 22043 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:22.445369 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 125884us
I20260709 13:07:22.446061 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:22.435288 21987 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.452637 21852 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.452848 21902 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:22.453378 21902 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.453295 21852 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:22.454329 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 63880us
I20260709 13:07:22.468299 16178 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:22.479662 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:22.480643 15442 raft_consensus.cc:2393] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 21: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:22.470208 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.488499 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:22.489007 21864 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:22.489167 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:22.489874 15439 raft_consensus.cc:2368] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 22. Current term is 23.
I20260709 13:07:22.489607 21864 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.485163 22026 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.492079 22026 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.494190 22026 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.498327 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:22.501523 15442 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:22.502748 15590 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:22.504339 15583 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:22.485342 21978 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:22.507856 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:22.508843 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:22.509948 15439 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 19: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:22.510640 21838 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.511210 21838 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.512202 21529 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.527010 21529 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.531327 21864 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:22.534032 21838 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.542397 21529 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:22.542704 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:22.543452 15442 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:22.533962 21902 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.544839 15556 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.545439 21852 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:22.546782 21864 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:22.547303 21864 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.547737 21864 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:22.521708 21978 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:22.552444 21978 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:22.557189 21864 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.564038 21894 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.529462 21987 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.564957 21894 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.568251 21894 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:22.568969 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:22.569667 15442 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:22.579133 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:22.581760 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:22.582472 16178 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 21.
I20260709 13:07:22.579996 15436 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 19.
I20260709 13:07:22.585793 15556 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.588428 21529 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:22.588933 21529 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.589284 21529 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:22.594964 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:22.595896 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:22.597285 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:22.597958 15513 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:07:22.580480 21796 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.595896 15509 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:22.601581 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:22.602222 15442 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:22.602242 15515 raft_consensus.cc:3060] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:22.603886 15482 leader_election.cc:400] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 22. Current term is 23.
I20260709 13:07:22.604238 15482 leader_election.cc:403] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.603614 15556 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.636813 15407 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:22.645188 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: 
W20260709 13:07:22.650252 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 46522.7us
I20260709 13:07:22.647933 22043 raft_consensus.cc:2804] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:22.652503 22043 raft_consensus.cc:697] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:22.653455 22043 consensus_queue.cc:237] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.663960 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:22.666611 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:22.667253 15509 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:22.667906 15513 raft_consensus.cc:2393] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 20: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:22.669570 15515 raft_consensus.cc:2468] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 23.
I20260709 13:07:22.668155 22079 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:22.648268 22082 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:22.671691 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:22.670904 22079 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.601027 21796 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.669297 21864 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:22.664427 21972 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.700716 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:22.700878 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49877.1us
I20260709 13:07:22.700825 15436 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:22.707409 15583 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:22.716012 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:22.717991 16178 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:22.714099 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:22.671140 22091 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 22. Current term is 23.
I20260709 13:07:22.674562 22079 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:22.716223 21972 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.744681 21864 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:22.746429 21972 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:22.751523 21796 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.778178 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:22.799082 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:22.800249 15586 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:22.803174 15586 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:22.810446 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:22.811482 15513 raft_consensus.cc:3060] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:22.780057 22122 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:22.816334 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:22.810784 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:22.737279 22036 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.820159 15589 raft_consensus.cc:2410] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:22.821259 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.716478 22068 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.097s
W20260709 13:07:22.826267 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 112336us
I20260709 13:07:22.804656 21987 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:22.747351 21529 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.831382 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.844230 15589 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:22.829996 22081 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:22.820477 22093 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:22.849310 15589 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:22.850131 15590 raft_consensus.cc:2368] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 20. Current term is 21.
I20260709 13:07:22.853809 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:22.846822 22094 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:07:22.843676 22112 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:22.861619 15515 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:22.837482 21987 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:22.839432 22082 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:22.843943 22063 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.877899 15513 raft_consensus.cc:2468] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:22.848976 22081 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.739992 22022 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.130s
I20260709 13:07:22.839401 22026 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:07:22.863778 22112 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:22.890452 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 186733us
I20260709 13:07:22.870316 15587 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:22.895167 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:22.879859 21900 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.881911 22081 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:22.909363 15513 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:22.898360 22112 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:22.880712 22063 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.905710 21906 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.904204 21968 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:22.927409 15407 leader_election.cc:400] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 20. Current term is 21.
I20260709 13:07:22.927812 15407 leader_election.cc:403] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.945062 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:22.962694 15436 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:22.926930 21906 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.955793 15442 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:22.903729 22124 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:07:22.956427 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:22.957134 21838 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:07:22.956948 22082 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.907281 21770 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:22.973865 15509 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:22.971004 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:22.879768 21987 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:22.979260 15435 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:22.910387 21900 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.014986 15585 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:23.025499 15436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:23.019063 21906 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:23.021737 21900 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:22.825480 22036 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.031116 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e2091b55004aafb70a88703ef6fbfc" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:23.032693 15513 raft_consensus.cc:3060] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:23.031915 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:23.044348 22127 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:23.046176 22063 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:23.064918 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:23.065778 15587 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 19.
I20260709 13:07:23.067525 15513 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:23.075253 22091 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:23.079936 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:23.072120 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:23.082926 15407 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:23.100601 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:23.101583 15587 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:23.032967 21529 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:23.108146 15407 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:23.117523 21968 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:23.096217 22091 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.118693 21968 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.136667 22048 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:23.114598 21906 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:07:23.138716 22081 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.149391 15443 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:23.114988 22137 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:23.122489 22130 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:23.176056 15443 raft_consensus.cc:1275] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:23.179522 15439 raft_consensus.cc:2368] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 20. Current term is 21.
I20260709 13:07:23.181960 21838 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005) with higher term. Message: Invalid argument: T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 20. Current term is 21.
I20260709 13:07:23.161899 22137 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.190347 22137 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:23.193853 15437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:23.170401 22130 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.203686 16178 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:23.201531 22130 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:23.206954 22131 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:07:23.239908 22081 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:23.250502 22112 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.252715 22036 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:23.253757 22125 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.386s	user 0.002s	sys 0.002s
I20260709 13:07:23.257862 15510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:23.262888 22112 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:23.250975 22079 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:23.281595 15440 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:23.283046 22079 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 election: Requested vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:23.290014 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:23.290701 15591 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:23.297693 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:23.304379 21978 consensus_queue.cc:1048] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:23.304525 15555 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:23.307754 22043 raft_consensus.cc:2804] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:23.308324 22043 raft_consensus.cc:697] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:23.313189 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:23.314018 15587 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:23.319339 15591 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 21.
I20260709 13:07:23.326112 15407 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:23.330803 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 126795us
I20260709 13:07:23.338967 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:23.339428 15587 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 21.
I20260709 13:07:23.340680 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:23.346962 16178 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:23.349326 15436 raft_consensus.cc:2468] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:23.351622 22043 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.353331 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:23.373286 16179 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:23.336126 22062 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:23.348510 22068 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:23.330890 22130 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.381269 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
W20260709 13:07:23.387071 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 314565us
I20260709 13:07:23.393194 22068 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:23.398463 21945 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:07:23.399519 22068 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.390486 22062 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:23.401944 22062 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.406077 15437 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 21: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:23.424063 22130 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:23.427995 16179 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 22.
I20260709 13:07:23.429603 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:07:23.436970 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 48827.9us
W20260709 13:07:23.451841 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 70667.3us
I20260709 13:07:23.456095 15407 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0; no voters: d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:23.444031 22137 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.480715 22137 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:23.486084 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:23.486904 15588 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:23.486965 22132 log.cc:927] Time spent T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.518s	user 0.002s	sys 0.000s
W20260709 13:07:23.493498 22145 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260709 13:07:23.479339 21839 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:23.498220 21839 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:23.499171 21839 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:23.454352 22156 raft_consensus.cc:2764] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:07:23.509107 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:23.512230 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:23.517104 22026 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:23.522442 15586 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in current term 21: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:23.523195 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:23.526124 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:23.532089 15511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:23.534346 15482 leader_election.cc:400] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Vote denied by peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757) with higher term. Message: Invalid argument: T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 20. Current term is 21.
I20260709 13:07:23.538702 15511 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:07:23.547876 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 209229us
I20260709 13:07:23.555994 15588 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 20.
I20260709 13:07:23.589067 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:23.590292 15434 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 21: Already voted for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in this term.
I20260709 13:07:23.537240 22026 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:07:23.598282 15556 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:23.624210 15406 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:23.626358 15435 raft_consensus.cc:1275] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:23.611460 21864 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.645099 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:23.597805 22043 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:23.597292 21972 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:07:23.673857 15585 raft_consensus.cc:1275] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:23.681727 15407 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:23.685117 15586 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:23.656209 22149 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.671269 21770 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:23.708038 22081 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:23.667810 22082 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:23.719353 21968 consensus_queue.cc:1059] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:23.741731 21987 raft_consensus.cc:3055] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:23.742218 21987 raft_consensus.cc:740] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:23.743148 21987 consensus_queue.cc:260] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:23.744493 21987 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:23.755221 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 124511us
I20260709 13:07:23.708770 22081 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:23.780287 15438 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:23.696115 22156 consensus_queue.cc:1059] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.088s
W20260709 13:07:23.768523 22161 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:23.789845 22165 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 13:07:23.790091 22163 log.cc:927] Time spent T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:23.760720 22082 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:23.770355 22080 consensus_queue.cc:1048] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:07:23.813376 22081 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:23.840397 22171 log.cc:927] Time spent T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:07:23.860762 22173 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:23.861438 22082 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:23.858260 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 109058us
I20260709 13:07:23.871057 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:23.889263 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 106338us
W20260709 13:07:23.896819 22170 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:07:23.905500 15336 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 207) took 26781 ms (client timeout 15000 ms). Trace:
I20260709 13:07:23.908761 15335 catalog_manager.cc:5697] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 19 to 21, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 21 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:23.754027 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:23.926937 15440 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:23.947960 15335 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:23.958014 22168 log.cc:927] Time spent T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.114s	user 0.005s	sys 0.006s
I20260709 13:07:23.950165 15335 catalog_manager.cc:5697] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:23.983258 15335 catalog_manager.cc:5697] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 15, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 15 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.970322 22189 consensus_queue.cc:1048] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:23.997473 15511 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:07:23.999704 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 153264us
I20260709 13:07:24.012262 22177 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:07:24.030047 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 72108.2us
I20260709 13:07:24.004055 15335 catalog_manager.cc:5697] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.043947 15439 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:07:23.922835 15336 rpcz_store.cc:269] 0709 13:06:57.123674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.123928 (+   254us) service_pool.cc:224] Handling call
0709 13:06:57.335251 (+211323us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:23.905387 (+26570136us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:20.976686 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:20.977454 (+   768us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:20.977507 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:07:20.977526 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:20.978542 (+  1016us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:20.978670 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:20.978705 (+    35us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:07:20.979390 (+   685us) tablet.cc:701] Row locks acquired
0709 13:07:20.979442 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:07:20.979660 (+   218us) write_op.cc:270] Start()
0709 13:07:20.979825 (+   165us) write_op.cc:276] Timestamp: P: 1783602440979587 usec, L: 0
0709 13:07:20.979848 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:21.054927 (+ 75079us) log.cc:844] Serialized 2870 byte log entry
0709 13:07:21.462102 (+407175us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b4400022b4c. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78b90c85 00007fcf78b916a2 00007fcf7b9031db 00007fcf7b8feaaf 00007fcf78c4d0ac 00007fcf81aa7ab9 00007fcf78c6969b 00007fcf78c6793f 00007fcf78c69c02 00007fcf7b8f120b
0709 13:07:21.968181 (+506079us) op_driver.cc:464] REPLICATION: finished
0709 13:07:22.284747 (+316566us) write_op.cc:301] APPLY: starting
0709 13:07:22.284856 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:22.331695 (+ 46839us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:22.331724 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:22.395308 (+ 63584us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:22.395613 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:07:22.395667 (+    54us) write_op.cc:312] APPLY: finished
0709 13:07:22.395955 (+   288us) log.cc:844] Serialized 73 byte log entry
0709 13:07:22.396883 (+   928us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:22.397018 (+   135us) write_op.cc:454] Released schema lock
0709 13:07:22.397088 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:22.397560 (+   472us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:22.397590 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5698,"reported_tablets":52,"spinlock_wait_cycles":317609344,"child_traces":[["op",{"apply.queue_time_us":291731,"apply.run_cpu_time_us":13418,"apply.run_wall_time_us":121454,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":150998,"prepare.run_cpu_time_us":46605,"prepare.run_wall_time_us":849747,"raft.queue_time_us":107575,"raft.run_cpu_time_us":50492,"raft.run_wall_time_us":197416,"replication_time_us":988108,"spinlock_wait_cycles":13737344,"thread_start_us":987374,"threads_started":4,"wal-append.queue_time_us":743235,"wal-append.run_cpu_time_us":13105,"wal-append.run_wall_time_us":1597189}]]}
I20260709 13:07:24.055351 22166 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:07:24.080516 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 78803.9us
I20260709 13:07:24.094640 15511 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:24.097368 15435 raft_consensus.cc:1240] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:24.107741 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.108551 22043 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:24.109483 22043 consensus_queue.cc:1243] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Peer 8a55534dc8864943937d5b6ec0e6aaf9 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:24.118480 15510 pending_rounds.cc:85] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 11
I20260709 13:07:24.118993 15510 pending_rounds.cc:107] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:07:24.119318 15510 raft_consensus.cc:2889] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.146270 21864 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:24.146839 21864 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:24.149072 16179 raft_consensus.cc:1240] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:07:24.136785 15335 catalog_manager.cc:5697] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 7 to 9, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 9 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:24.166180 15513 raft_consensus.cc:3055] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:24.166640 15513 raft_consensus.cc:740] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:24.167807 15513 consensus_queue.cc:260] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:24.173596 15513 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:24.174585 15481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.174790 22193 log.cc:927] Time spent T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.107s	user 0.001s	sys 0.002s
I20260709 13:07:24.184810 22156 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:24.185431 22156 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:24.187813 22000 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:24.188439 22000 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:24.165524 21864 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:24.192389 21864 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:24.202478 15440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:24.222541 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b48cca7667444b8c8bb999a280076795" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:24.235306 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:24.237176 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:24.237823 15435 raft_consensus.cc:606] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:24.238128 15335 catalog_manager.cc:5697] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.240234 15335 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 6 to 13, term changed from 14 to 16, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:24.241660 15435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:24.242363 15435 raft_consensus.cc:606] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:24.242803 15435 raft_consensus.cc:614] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.242214 15335 catalog_manager.cc:5697] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 15 to 17, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 17 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.244439 22156 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:24.251590 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 50291.4us
I20260709 13:07:24.254194 15590 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:07:24.276957 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:24.282466 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:24.283775 15438 raft_consensus.cc:606] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:24.284130 15438 raft_consensus.cc:614] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.287917 22149 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:24.199589 22189 consensus_queue.cc:1175] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ff41728dec842afad5b53c20446a5a0" responder_term: 22 status { last_received { term: 20 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d225833a2cbf4a5995fdbbb1292d1918 for earlier term 21. Current term is 22. Ops: [21.15-21.15]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:24.289788 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:24.291270 15438 raft_consensus.cc:606] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:24.292266 15335 catalog_manager.cc:5697] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.299059 22000 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:24.300668 15513 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:07:24.301064 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f012dbeed0364c8195192ae55ff12fef"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:24.302872 15438 raft_consensus.cc:606] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:24.303702 15438 raft_consensus.cc:614] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:24.304399 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 55644.9us
W20260709 13:07:24.304286 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47572.6us
I20260709 13:07:24.301074 15513 pending_rounds.cc:85] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 11
I20260709 13:07:24.306377 15513 pending_rounds.cc:107] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:07:24.308018 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:24.309249 16178 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:24.310313 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:24.312116 15513 raft_consensus.cc:2889] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.322606 15556 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:24.318506 21902 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
W20260709 13:07:24.344020 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 9178296553b44a3f82267d1278be3746: Illegal state: Replica 5ccb2e30f44f40c2b22339e1d4c74a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:24.348191 15585 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:07:24.348901 15585 pending_rounds.cc:85] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Aborting all ops after (but not including) 14
I20260709 13:07:24.349468 15585 pending_rounds.cc:107] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:07:24.349941 15585 raft_consensus.cc:2889] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.357681 15588 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:07:24.357990 22187 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:24.328315 22000 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:24.376963 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:24.377233 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:24.382202 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:24.390416 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.396523 22192 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:24.432111 15588 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:24.436017 15590 raft_consensus.cc:1240] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Rejecting Update request from peer 8a55534dc8864943937d5b6ec0e6aaf9 for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:24.457536 22201 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:24.434530 22188 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.461253 22188 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:24.464243 22200 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:07:24.470669 15555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.471599 15590 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:07:24.491838 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet badc8a91586140ab8a3903619efbd8c9: Illegal state: Replica 8a55534dc8864943937d5b6ec0e6aaf9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:24.540514 15407 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:24.544154 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:24.537792 22124 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:07:24.531740 22188 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:24.551652 22082 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:24.562413 22130 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:07:24.587877 22128 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:07:24.588989 22195 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:07:24.601078 22154 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
W20260709 13:07:24.620606 22208 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:07:24.651376 21906 raft_consensus.cc:993] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:24.666316 21906 raft_consensus.cc:1081] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
W20260709 13:07:24.663275 22197 log.cc:927] Time spent T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.384s	user 0.003s	sys 0.000s
I20260709 13:07:24.691362 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:24.794410 15435 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:24.863463 15556 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:24.873443 22043 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:24.890302 15409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.897593 15509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:24.898402 15509 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:24.899044 15509 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:24.926792 15509 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:24.945914 22129 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:07:24.976337 15509 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:24.984128 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:24.985142 16182 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:25.029589 22216 log.cc:927] Time spent T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:25.049041 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106707us
I20260709 13:07:25.046471 16182 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:25.072693 15482 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:25.080065 22177 raft_consensus.cc:2804] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:25.089056 22177 raft_consensus.cc:697] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:25.090087 22177 consensus_queue.cc:237] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:25.108654 21767 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:25.109377 21767 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:25.111761 22130 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:25.112636 22130 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:25.115091 22130 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:25.116896 21770 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:25.150754 21770 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:25.168815 21767 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:25.214943 21770 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:25.233739 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 155109us
I20260709 13:07:25.238595 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:25.242465 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:25.244078 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:25.243350 15586 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:25.257718 22225 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:25.258458 22225 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:25.260711 22225 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:25.262481 22228 raft_consensus.cc:993] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:25.263041 22130 raft_consensus.cc:1081] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:25.310438 15510 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:25.313164 15514 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:07:25.313618 15514 pending_rounds.cc:85] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting all ops after (but not including) 11
I20260709 13:07:25.313853 15514 pending_rounds.cc:107] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:07:25.314086 15514 raft_consensus.cc:2889] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:25.314133 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:25.315588 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:25.315920 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:25.308251 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:25.324136 15434 raft_consensus.cc:3055] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:25.324569 15434 raft_consensus.cc:740] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:25.326694 15509 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:25.335879 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:25.333531 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:25.334218 15511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:25.338212 15511 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.338703 15511 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.345597 15434 consensus_queue.cc:260] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:25.349859 15434 raft_consensus.cc:3060] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.368373 15434 raft_consensus.cc:2468] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:25.376354 22228 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:25.378424 22177 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.379221 22177 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:25.382404 15407 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:25.387965 22128 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:25.394505 15407 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:25.394371 22149 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:25.395901 22079 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:25.399957 15407 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:25.400934 21767 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:25.401371 15407 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 562c25b8842b442a928630e10d13e618. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:25.412389 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:25.412823 16179 raft_consensus.cc:1240] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ccb2e30f44f40c2b22339e1d4c74a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:25.365394 22222 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:07:25.416889 15407 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:25.418231 22048 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:25.433920 15511 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:25.436152 15511 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:25.439710 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 105489us
I20260709 13:07:25.464949 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:25.465682 15442 raft_consensus.cc:3055] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:25.465977 15442 raft_consensus.cc:740] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:25.466002 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee09de23aee40d689e3f0426ed38fc1" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:25.466919 15585 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.466933 15442 consensus_queue.cc:260] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:25.474364 15442 raft_consensus.cc:3060] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.482162 15585 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:25.483705 15439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" is_pre_election: true
I20260709 13:07:25.490509 15442 raft_consensus.cc:2468] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:25.494181 15482 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:25.505785 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:25.507894 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:25.497306 22177 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:25.503464 22196 raft_consensus.cc:2804] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:25.528275 22196 raft_consensus.cc:697] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:25.529265 22196 consensus_queue.cc:237] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:25.522634 22233 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:25.562790 15338 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.573544 22079 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:25.580828 15435 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:25.584277 15513 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
W20260709 13:07:25.604681 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 52896.3us
I20260709 13:07:25.623865 15588 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:25.614933 15335 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51916 (request call id 116) took 6208 ms. Trace:
I20260709 13:07:25.609879 22196 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:07:25.645745 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet 1915fdd81d344a749443e48f07a1fef8 with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:48416
I20260709 13:07:25.654656 16179 raft_consensus.cc:1275] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:25.656726 22178 consensus_queue.cc:1048] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:25.684376 22238 tablet_replica.cc:333] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:07:25.631561 15335 rpcz_store.cc:276] 0709 13:07:19.417420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.435723 (+ 18303us) service_pool.cc:224] Handling call
0709 13:07:25.614580 (+6178857us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:24.488191 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:24.489125 (+   934us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:24.489180 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:07:24.489197 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:24.491783 (+  2586us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:24.492028 (+   245us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:24.492142 (+   114us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:24.541523 (+ 49381us) tablet.cc:701] Row locks acquired
0709 13:07:24.544802 (+  3279us) write_op.cc:260] PREPARE: finished
0709 13:07:24.551743 (+  6941us) write_op.cc:270] Start()
0709 13:07:24.560386 (+  8643us) write_op.cc:276] Timestamp: P: 1783602444549836 usec, L: 0
0709 13:07:24.562455 (+  2069us) op_driver.cc:348] REPLICATION: starting
0709 13:07:24.588932 (+ 26477us) log.cc:844] Serialized 3984 byte log entry
0709 13:07:25.099749 (+510817us) op_driver.cc:464] REPLICATION: finished
0709 13:07:25.253938 (+154189us) write_op.cc:301] APPLY: starting
0709 13:07:25.254048 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:25.312739 (+ 58691us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:25.312836 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:25.393108 (+ 80272us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:25.393410 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:07:25.393463 (+    53us) write_op.cc:312] APPLY: finished
0709 13:07:25.398279 (+  4816us) log.cc:844] Serialized 97 byte log entry
0709 13:07:25.402727 (+  4448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.402881 (+   154us) write_op.cc:454] Released schema lock
0709 13:07:25.402937 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:25.403429 (+   492us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.403461 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":279970,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":147906,"apply.run_cpu_time_us":16938,"apply.run_wall_time_us":152091,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45927,"num_ops":10,"prepare.queue_time_us":86437,"prepare.run_cpu_time_us":158753,"prepare.run_wall_time_us":310572,"raft.queue_time_us":236705,"raft.run_cpu_time_us":12238,"raft.run_wall_time_us":133247,"replication_time_us":520384,"thread_start_us":485460,"threads_started":4,"wal-append.queue_time_us":238691}]]}
I20260709 13:07:25.686025 22238 raft_consensus.cc:2243] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.697693 22079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36426 (request call id 4) took 1012 ms. Trace:
I20260709 13:07:25.701860 22079 rpcz_store.cc:276] 0709 13:07:24.685540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.688568 (+  3028us) service_pool.cc:224] Handling call
0709 13:07:24.752474 (+ 63906us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b5800922ad0. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc0571 00007fcf7bcb30aa 00007fcf7bd35447 00007fcf7bd5270a 00007fcf7bd5376a 00007fcf7bd5291b 00007fcf7bd5e03c 00007fcf7bd5d6b3 00007fcf80d1dd29 00007fcf7a29c1d4 00007fcf7a29c162
0709 13:07:24.901562 (+149088us) log.cc:844] Serialized 506 byte log entry
0709 13:07:25.209352 (+307790us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b18002a0160. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:07:25.211030 (+  1678us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18002a0160. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:07:25.697590 (+486560us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":283,"mutex_wait_us":4626,"raft.queue_time_us":11368,"raft.run_cpu_time_us":2514,"raft.run_wall_time_us":36920,"spinlock_wait_cycles":102674048,"thread_start_us":209965,"threads_started":1,"wal-append.queue_time_us":292983}
W20260709 13:07:25.732193 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 35e9ed1641e04cbfb3dfb6d3b9c4fd5f: Illegal state: Replica d225833a2cbf4a5995fdbbb1292d1918 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:25.725454 22238 raft_consensus.cc:2272] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.759234 22238 ts_tablet_manager.cc:1916] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:25.725224 22241 ts_tablet_manager.cc:933] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:07:25.813890 15335 catalog_manager.cc:5697] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 16 to 17, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 17 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:25.815851 15335 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 20 to 22, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 22 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:25.825713 15335 catalog_manager.cc:5697] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 14 to 16, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 16 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.829094 15335 catalog_manager.cc:5697] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 10 to 15, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 15 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:25.832108 22241 tablet_copy_client.cc:323] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:07:25.836254 15453 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 562c25b8842b442a928630e10d13e618 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:07:25.836920 15453 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 562c25b8842b442a928630e10d13e618 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-562c25b8842b442a928630e10d13e618
I20260709 13:07:25.836701 15335 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 11 to 18, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 18 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:25.838299 22238 ts_tablet_manager.cc:1929] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:07:25.838866 22238 log.cc:1199] T 1915fdd81d344a749443e48f07a1fef8 P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/1915fdd81d344a749443e48f07a1fef8
I20260709 13:07:25.838577 15335 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 13 to 16, leader changed from 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:25.841045 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet 1915fdd81d344a749443e48f07a1fef8 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
W20260709 13:07:25.852988 15338 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 206) took 51085 ms (client timeout 15000 ms). Trace:
W20260709 13:07:25.853487 15338 rpcz_store.cc:269] 0709 13:06:34.786290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.797106 (+ 10816us) service_pool.cc:224] Handling call
0709 13:07:25.852877 (+51055771us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:25.703193 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:25.722390 (+ 19197us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:25.723300 (+   910us) write_op.cc:435] Acquired schema lock
0709 13:07:25.725038 (+  1738us) tablet.cc:662] Decoding operations
0709 13:07:25.751713 (+ 26675us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:25.751809 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:25.751849 (+    40us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:25.752077 (+   228us) tablet.cc:701] Row locks acquired
0709 13:07:25.752106 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:07:25.752294 (+   188us) write_op.cc:270] Start()
0709 13:07:25.752457 (+   163us) write_op.cc:276] Timestamp: P: 1783602445752244 usec, L: 0
0709 13:07:25.752485 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:25.753428 (+   943us) log.cc:844] Serialized 541 byte log entry
0709 13:07:25.771064 (+ 17636us) op_driver.cc:464] REPLICATION: finished
0709 13:07:25.778355 (+  7291us) write_op.cc:301] APPLY: starting
0709 13:07:25.778449 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:25.779356 (+   907us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:25.779460 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:25.780226 (+   766us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:25.780406 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:07:25.780455 (+    49us) write_op.cc:312] APPLY: finished
0709 13:07:25.780664 (+   209us) log.cc:844] Serialized 25 byte log entry
0709 13:07:25.780838 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.780940 (+   102us) write_op.cc:454] Released schema lock
0709 13:07:25.780987 (+    47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":178544,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":7001,"apply.run_cpu_time_us":3090,"apply.run_wall_time_us":3100,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":24624,"prepare.run_cpu_time_us":3511,"prepare.run_wall_time_us":50634,"replication_time_us":18418,"thread_start_us":23326,"threads_started":1}]]}
I20260709 13:07:25.853008 15453 tablet_copy_source_session.cc:215] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:25.861270 22241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562c25b8842b442a928630e10d13e618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.933415 15590 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:25.937686 22196 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:25.962075 15339 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:25.989471 15339 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.021801 22241 tablet_copy_client.cc:806] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:26.023020 22241 tablet_copy_client.cc:670] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:26.027678 15434 raft_consensus.cc:1275] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:26.058421 22241 tablet_copy_client.cc:538] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:26.043381 22196 consensus_queue.cc:1048] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:07:26.133646 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 64385.2us
I20260709 13:07:26.167582 22241 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:26.167439 15340 catalog_manager.cc:5697] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.169373 15340 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 13 to 15, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:07:26.172447 15339 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 214) took 37862 ms (client timeout 15000 ms). Trace:
I20260709 13:07:26.173362 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b97fcd3d908482fadc6fa54e513304d with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:58996
I20260709 13:07:26.173137 15340 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 18 to 19, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 19 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:26.172967 15339 rpcz_store.cc:269] 0709 13:06:48.308623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.308813 (+   190us) service_pool.cc:224] Handling call
0709 13:07:26.171243 (+37862430us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:26.001633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:26.002196 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:26.002236 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:07:26.002248 (+    12us) tablet.cc:662] Decoding operations
0709 13:07:26.002667 (+   419us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:26.002728 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:26.002754 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:07:26.003093 (+   339us) tablet.cc:701] Row locks acquired
0709 13:07:26.005916 (+  2823us) write_op.cc:260] PREPARE: finished
0709 13:07:26.008201 (+  2285us) write_op.cc:270] Start()
0709 13:07:26.012891 (+  4690us) write_op.cc:276] Timestamp: P: 1783602446007252 usec, L: 0
0709 13:07:26.012964 (+    73us) op_driver.cc:348] REPLICATION: starting
0709 13:07:26.013839 (+   875us) log.cc:844] Serialized 929 byte log entry
0709 13:07:26.016729 (+  2890us) op_driver.cc:464] REPLICATION: finished
0709 13:07:26.017194 (+   465us) write_op.cc:301] APPLY: starting
0709 13:07:26.017279 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:26.018766 (+  1487us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:26.018881 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:26.020229 (+  1348us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:26.020411 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:07:26.020456 (+    45us) write_op.cc:312] APPLY: finished
0709 13:07:26.020681 (+   225us) log.cc:844] Serialized 33 byte log entry
0709 13:07:26.020847 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.020945 (+    98us) write_op.cc:454] Released schema lock
0709 13:07:26.020988 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:26.021384 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.021414 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110493,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":235,"apply.run_cpu_time_us":4140,"apply.run_wall_time_us":4140,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":7234,"prepare.run_cpu_time_us":3280,"prepare.run_wall_time_us":12582,"replication_time_us":3605}]]}
I20260709 13:07:26.175127 15340 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 9 to 10, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 10 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.194082 15340 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.318234 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet 5b97fcd3d908482fadc6fa54e513304d (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:26.339711 15340 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 11 to 13, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 13 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.360539 15340 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.374655 15340 catalog_manager.cc:5697] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 10 to 13, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 13 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.389194 15340 catalog_manager.cc:5697] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 13 to 15, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 15 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.405973 15340 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 15 to 17, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 17 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.422741 15340 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 18 to 19, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 19 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.425555 15340 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.427881 15340 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.445808 15340 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 13 to 15, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.448334 15340 catalog_manager.cc:5697] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 18 to 21, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 21 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:26.465463 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 76873.4us
I20260709 13:07:26.467856 15340 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.469717 15340 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:26.485271 15340 catalog_manager.cc:5697] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 17 to 20, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 20 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.488170 15340 catalog_manager.cc:5697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 8 to 18, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 18 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.527907 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:26.750696 22241 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.751978 22241 tablet_bootstrap.cc:492] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:26.757308 22241 ts_tablet_manager.cc:1403] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.590s	user 0.041s	sys 0.035s
I20260709 13:07:26.783303 22241 raft_consensus.cc:359] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:26.784492 22241 raft_consensus.cc:740] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:26.820091 22241 consensus_queue.cc:260] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:26.843660 22241 ts_tablet_manager.cc:1434] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.008s
I20260709 13:07:26.848599 15453 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-562c25b8842b442a928630e10d13e618 received from {username='slave'} at 127.0.0.1:47420
I20260709 13:07:26.849316 15453 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-562c25b8842b442a928630e10d13e618 on tablet 562c25b8842b442a928630e10d13e618 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:26.917210 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:26.918179 15442 raft_consensus.cc:606] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:26.934727 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:26.935470 15442 raft_consensus.cc:606] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:26.955096 15339 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:27.004094 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:27.004910 15442 raft_consensus.cc:606] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:27.005386 15442 raft_consensus.cc:614] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:27.038053 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9178296553b44a3f82267d1278be3746"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:27.038738 15442 raft_consensus.cc:606] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:27.039165 15442 raft_consensus.cc:614] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:27.054631 15340 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50468 (request call id 208) took 12721 ms (client timeout 15000 ms). Trace:
I20260709 13:07:27.057729 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet 1915fdd81d344a749443e48f07a1fef8 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:48416
W20260709 13:07:27.055213 15340 rpcz_store.cc:269] 0709 13:07:14.333592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.333893 (+   301us) service_pool.cc:224] Handling call
0709 13:07:14.420033 (+ 86140us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:27.054536 (+12634503us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:26.737059 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:26.763821 (+ 26762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:26.763877 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:07:26.763917 (+    40us) tablet.cc:662] Decoding operations
0709 13:07:26.798581 (+ 34664us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:26.798685 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:26.798715 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:07:26.800466 (+  1751us) tablet.cc:701] Row locks acquired
0709 13:07:26.800512 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:07:26.800708 (+   196us) write_op.cc:270] Start()
0709 13:07:26.800873 (+   165us) write_op.cc:276] Timestamp: P: 1783602446800637 usec, L: 0
0709 13:07:26.800908 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:07:26.802351 (+  1443us) log.cc:844] Serialized 7526 byte log entry
0709 13:07:26.895851 (+ 93500us) op_driver.cc:464] REPLICATION: finished
0709 13:07:26.912930 (+ 17079us) write_op.cc:301] APPLY: starting
0709 13:07:26.913060 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:26.925056 (+ 11996us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:26.925189 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:26.936746 (+ 11557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:26.937213 (+   467us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:07:26.937276 (+    63us) write_op.cc:312] APPLY: finished
0709 13:07:26.937777 (+   501us) log.cc:844] Serialized 172 byte log entry
0709 13:07:26.938710 (+   933us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.938928 (+   218us) write_op.cc:454] Released schema lock
0709 13:07:26.939013 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:26.967903 (+ 28890us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.967937 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18258,"reported_tablets":52,"spinlock_wait_cycles":100804352,"child_traces":[["op",{"apply.queue_time_us":16724,"apply.run_cpu_time_us":25474,"apply.run_wall_time_us":54920,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83547,"num_ops":19,"prepare.queue_time_us":93728,"prepare.run_cpu_time_us":7375,"prepare.run_wall_time_us":76879,"replication_time_us":94731,"thread_start_us":81153,"threads_started":2}]]}
I20260709 13:07:27.080097 15442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d40d294abeec453098d547799a79f7c5"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:27.090742 15442 raft_consensus.cc:606] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:27.096320 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:27.100494 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:27.112850 15337 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.158010 15337 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 14 to 15, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.171975 22130 raft_consensus.cc:993] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:27.172843 22062 raft_consensus.cc:1081] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:27.175413 15511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:27.176143 15511 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.176589 15511 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:27.190909 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet 1915fdd81d344a749443e48f07a1fef8 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:27.219264 15337 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.230604 15337 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.268855 22130 raft_consensus.cc:993] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:27.269549 22130 raft_consensus.cc:1081] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:27.278877 15515 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:27.279503 15515 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.279939 15515 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:27.335222 16178 raft_consensus.cc:1217] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:07:27.339722 15515 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.342096 15515 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:27.343794 15511 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.360222 15511 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:27.384558 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:27.385320 15589 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:27.387006 15438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e5d29fb564b08bdca15f666c0c986" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:27.388375 15438 raft_consensus.cc:3055] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:27.392297 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:27.398059 15585 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:27.394053 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:27.404019 15442 raft_consensus.cc:3055] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:27.404407 15442 raft_consensus.cc:740] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:27.405401 15442 consensus_queue.cc:260] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.406819 15442 raft_consensus.cc:3060] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:27.422057 22079 raft_consensus.cc:993] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:27.422704 22079 raft_consensus.cc:1081] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:27.425359 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d40d294abeec453098d547799a79f7c5"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:27.426064 15513 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.426522 15513 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.431634 15438 raft_consensus.cc:740] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:27.432798 15438 consensus_queue.cc:260] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.434351 15438 raft_consensus.cc:3060] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:27.459867 15442 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:27.464728 15589 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:27.467244 15585 raft_consensus.cc:2468] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:27.487794 15482 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:27.488704 22120 raft_consensus.cc:2804] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:27.489323 22120 raft_consensus.cc:697] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:27.489537 15482 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:27.490376 22120 consensus_queue.cc:237] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.492121 22251 raft_consensus.cc:2804] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:27.492710 22251 raft_consensus.cc:697] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:27.493649 22251 consensus_queue.cc:237] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.536335 15513 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.565135 15435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:27.565901 15435 raft_consensus.cc:3055] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:27.566222 15435 raft_consensus.cc:740] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:27.567191 15435 consensus_queue.cc:260] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.568533 15435 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.569125 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40d294abeec453098d547799a79f7c5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:27.569700 15589 raft_consensus.cc:3060] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.577754 15435 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:27.579188 15482 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:27.580683 22120 raft_consensus.cc:2804] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:27.581607 22120 raft_consensus.cc:697] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:27.582679 22120 consensus_queue.cc:237] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:27.590324 15589 raft_consensus.cc:2468] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:27.592036 15513 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:27.561017 15438 raft_consensus.cc:2468] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:27.613270 15341 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.640033 15341 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 15 to 16, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.644133 15337 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50450 (request call id 212) took 9048 ms. Trace:
I20260709 13:07:27.644649 15337 rpcz_store.cc:276] 0709 13:07:18.684762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.709631 (+ 24869us) service_pool.cc:224] Handling call
0709 13:07:27.644059 (+8934428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:27.319944 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:27.320528 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:27.320566 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:27.320586 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:27.321197 (+   611us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:27.321254 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:27.321278 (+    24us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:07:27.321661 (+   383us) tablet.cc:701] Row locks acquired
0709 13:07:27.321675 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:07:27.321833 (+   158us) write_op.cc:270] Start()
0709 13:07:27.321959 (+   126us) write_op.cc:276] Timestamp: P: 1783602447321785 usec, L: 0
0709 13:07:27.321981 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:27.322648 (+   667us) log.cc:844] Serialized 1706 byte log entry
0709 13:07:27.325002 (+  2354us) op_driver.cc:464] REPLICATION: finished
0709 13:07:27.325555 (+   553us) write_op.cc:301] APPLY: starting
0709 13:07:27.325683 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:27.328690 (+  3007us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:27.328805 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:27.331224 (+  2419us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:27.331458 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:07:27.331502 (+    44us) write_op.cc:312] APPLY: finished
0709 13:07:27.352012 (+ 20510us) log.cc:844] Serialized 49 byte log entry
0709 13:07:27.352199 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.352336 (+   137us) write_op.cc:454] Released schema lock
0709 13:07:27.352384 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:27.352818 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.352846 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27971,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":139,"apply.run_cpu_time_us":7100,"apply.run_wall_time_us":27251,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20847,"num_ops":4,"prepare.queue_time_us":120,"prepare.run_cpu_time_us":2983,"prepare.run_wall_time_us":2984,"replication_time_us":2846}]]}
I20260709 13:07:27.778235 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b97fcd3d908482fadc6fa54e513304d with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:58996
W20260709 13:07:27.779341 15341 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 215) took 19210 ms (client timeout 15000 ms). Trace:
W20260709 13:07:27.779852 15341 rpcz_store.cc:269] 0709 13:07:08.569276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.570245 (+   969us) service_pool.cc:224] Handling call
0709 13:07:27.779224 (+19208979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:27.690947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:27.691622 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:27.691663 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:07:27.691683 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:27.692179 (+   496us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:27.692249 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:27.692283 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:07:27.692649 (+   366us) tablet.cc:701] Row locks acquired
0709 13:07:27.692668 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:07:27.692825 (+   157us) write_op.cc:270] Start()
0709 13:07:27.692957 (+   132us) write_op.cc:276] Timestamp: P: 1783602447692775 usec, L: 0
0709 13:07:27.692985 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:27.693764 (+   779us) log.cc:844] Serialized 929 byte log entry
0709 13:07:27.697980 (+  4216us) op_driver.cc:464] REPLICATION: finished
0709 13:07:27.705624 (+  7644us) write_op.cc:301] APPLY: starting
0709 13:07:27.705723 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:27.707441 (+  1718us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:27.707595 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:27.714442 (+  6847us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:27.714694 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:07:27.714757 (+    63us) write_op.cc:312] APPLY: finished
0709 13:07:27.714994 (+   237us) log.cc:844] Serialized 33 byte log entry
0709 13:07:27.716870 (+  1876us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.716977 (+   107us) write_op.cc:454] Released schema lock
0709 13:07:27.717025 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:27.717506 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.717544 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77226,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":3204,"apply.run_cpu_time_us":4631,"apply.run_wall_time_us":11825,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":644,"prepare.run_cpu_time_us":3202,"prepare.run_wall_time_us":10959,"replication_time_us":4788}]]}
I20260709 13:07:27.785957 15336 catalog_manager.cc:5697] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.804662 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet 5b97fcd3d908482fadc6fa54e513304d (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:27.804140 15336 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.806928 15336 catalog_manager.cc:5697] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 18 to 19, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 19 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.809501 15336 catalog_manager.cc:5697] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 12 to 13, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 13 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.822927 22079 raft_consensus.cc:1064] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:27.826548 22079 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:27.811105 15336 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 18 to 21, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 21 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.833638 15336 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 21 to 22, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 22 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.836854 15336 catalog_manager.cc:5697] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 12 to 18, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 18 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.848311 15336 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 18 to 20, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 20 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.854851 15336 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.863296 15336 catalog_manager.cc:5697] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.872279 15336 catalog_manager.cc:5697] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.874536 15336 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.884698 15336 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 15 to 23, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 23 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.886446 15336 catalog_manager.cc:5697] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 11 to 16, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.892426 15336 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 16 to 17, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 17 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.894455 15336 catalog_manager.cc:5697] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.904201 15336 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.906250 15336 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 15 to 16, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.916364 15336 catalog_manager.cc:5697] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 11 to 16, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 16 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } }
I20260709 13:07:27.918206 15336 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:27.963845 15585 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:27.994791 22178 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:28.010054 15589 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:28.046094 16178 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:28.048071 15340 catalog_manager.cc:5697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 10 to 16, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:28.051349 15340 catalog_manager.cc:5697] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 12 to 13, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 13 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:28.054020 15340 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 19 to 21, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 21 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:28.055749 22079 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:28.057739 15589 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:28.075582 15340 catalog_manager.cc:5697] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 18 to 20, leader changed from d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 20 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:28.085942 22062 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:28.092425 15336 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50466 (request call id 216) took 3060 ms. Trace:
I20260709 13:07:28.097450 15515 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:28.092971 15336 rpcz_store.cc:276] 0709 13:07:25.032426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.033132 (+   706us) service_pool.cc:224] Handling call
0709 13:07:25.287608 (+254476us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003ec454. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7bcc1090 00007fcf7bd5ff3a 00007fcf81b161cc 00007fcf81c1437e 00007fcf800d52a4 00007fcf800d5232 00007fcf800d5161 00007fcf800d50dc 00007fcf800d4392 00007fcf7a09248c 00007fcf7a0918c6
0709 13:07:28.092296 (+2804688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:27.942707 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:27.943262 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:27.943304 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:07:27.943320 (+    16us) tablet.cc:662] Decoding operations
0709 13:07:27.944919 (+  1599us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:27.944983 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:27.945012 (+    29us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:07:27.946899 (+  1887us) tablet.cc:701] Row locks acquired
0709 13:07:27.946921 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:07:27.947073 (+   152us) write_op.cc:270] Start()
0709 13:07:27.947196 (+   123us) write_op.cc:276] Timestamp: P: 1783602447947027 usec, L: 0
0709 13:07:27.947221 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:27.947981 (+   760us) log.cc:844] Serialized 7910 byte log entry
0709 13:07:27.950807 (+  2826us) op_driver.cc:464] REPLICATION: finished
0709 13:07:27.951321 (+   514us) write_op.cc:301] APPLY: starting
0709 13:07:27.951401 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:27.964299 (+ 12898us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:27.964394 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:27.987361 (+ 22967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:27.987715 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:07:27.987760 (+    45us) write_op.cc:312] APPLY: finished
0709 13:07:27.988201 (+   441us) log.cc:844] Serialized 180 byte log entry
0709 13:07:27.995992 (+  7791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.996209 (+   217us) write_op.cc:454] Released schema lock
0709 13:07:27.996280 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:27.996947 (+   667us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.996983 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41563,"reported_tablets":53,"spinlock_wait_cycles":238588800,"child_traces":[["op",{"apply.queue_time_us":287,"apply.run_cpu_time_us":24297,"apply.run_wall_time_us":45584,"cfile_cache_hit":80,"cfile_cache_hit_bytes":83600,"num_ops":20,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":5274,"prepare.run_wall_time_us":16669,"replication_time_us":3461}]]}
I20260709 13:07:28.104411 15438 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:28.108669 15438 raft_consensus.cc:1275] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:28.140978 15438 raft_consensus.cc:1275] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:28.138386 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:28.140941 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 43650.2us
I20260709 13:07:28.162804 22278 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:28.218974 22271 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:28.223137 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 58739.4us
I20260709 13:07:28.224398 22274 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:28.235394 22178 consensus_queue.cc:1048] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:28.319332 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 134499us
I20260709 13:07:28.323657 15340 catalog_manager.cc:5697] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 18 to 19, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 19 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:28.445951 22277 consensus_queue.cc:1048] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:07:28.461302 15583 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:28.470890 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 52234.5us
I20260709 13:07:28.467103 22290 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:28.481599 15513 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:28.524705 15336 catalog_manager.cc:5697] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 16 to 17, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 17 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
W20260709 13:07:28.550352 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 117047us
I20260709 13:07:28.552488 15340 catalog_manager.cc:5697] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 19 to 20, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 20 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } }
I20260709 13:07:28.566618 15583 raft_consensus.cc:1275] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:28.609525 22178 consensus_queue.cc:1048] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:28.679530 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 121795us
W20260709 13:07:28.744131 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 62036.1us
I20260709 13:07:28.812242 16182 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:28.876470 15340 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:28.931740 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 320426us
I20260709 13:07:28.946355 15438 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:28.955106 16182 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:28.955444 15589 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:28.957605 22130 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:28.959457 22291 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:28.973942 22130 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:28.982105 16178 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:28.993001 15585 raft_consensus.cc:2955] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:29.020241 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 562c25b8842b442a928630e10d13e618 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:07:29.079262 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 48525.1us
I20260709 13:07:29.090242 15336 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 16 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:29.220757 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet 562c25b8842b442a928630e10d13e618 with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:58996
I20260709 13:07:29.246201 22315 tablet_replica.cc:333] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:29.247821 22315 raft_consensus.cc:2243] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:29.248978 22315 raft_consensus.cc:2272] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:29.264050 22315 ts_tablet_manager.cc:1916] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:29.324040 22315 ts_tablet_manager.cc:1929] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:07:29.324710 22315 log.cc:1199] T 562c25b8842b442a928630e10d13e618 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/562c25b8842b442a928630e10d13e618
I20260709 13:07:29.328130 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet 562c25b8842b442a928630e10d13e618 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:29.378980 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:29.456663 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:29.457351 15434 raft_consensus.cc:606] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:29.466418 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:29.467533 15434 raft_consensus.cc:606] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:29.474695 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:29.480278 15434 raft_consensus.cc:606] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Received request to transfer leadership to TS d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:29.580200 22079 raft_consensus.cc:993] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:07:29.580976 22079 raft_consensus.cc:1081] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:07:29.586022 15589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:07:29.586827 15589 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.587325 15589 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.599180 15589 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:29.602142 15589 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:29.602464 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:29.603669 15434 raft_consensus.cc:3055] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:29.604063 15434 raft_consensus.cc:740] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:29.605388 15434 consensus_queue.cc:260] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:29.607672 15434 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.611505 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:29.612259 15514 raft_consensus.cc:3060] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.631090 15513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:37880
I20260709 13:07:29.632603 15513 raft_consensus.cc:606] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:29.644436 15514 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:29.645134 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:29.655145 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:29.657213 15555 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:29.658229 22309 raft_consensus.cc:2804] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:29.658780 22309 raft_consensus.cc:697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:29.659740 22309 consensus_queue.cc:237] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:29.662209 15434 raft_consensus.cc:2468] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:29.702421 15339 catalog_manager.cc:5697] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 15 to 16, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 16 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:29.809082 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 44387.4us
I20260709 13:07:29.821033 22079 raft_consensus.cc:993] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:07:29.821746 22221 raft_consensus.cc:1081] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:07:29.825155 15583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:07:29.825779 15583 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.826139 15583 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:29.836331 15583 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:29.845557 15583 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:29.846565 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:29.847251 15434 raft_consensus.cc:3055] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:29.847579 15434 raft_consensus.cc:740] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:29.849246 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:29.849952 15509 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:29.849314 15434 consensus_queue.cc:260] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:29.882128 15434 raft_consensus.cc:3060] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:29.894115 15509 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 24.
I20260709 13:07:29.906508 22322 raft_consensus.cc:993] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:07:29.907392 22322 raft_consensus.cc:1081] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 LEADER]: Signalling peer d225833a2cbf4a5995fdbbb1292d1918 to start an election
I20260709 13:07:29.907635 15434 raft_consensus.cc:2468] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 24.
I20260709 13:07:29.908907 15556 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:29.909849 22297 raft_consensus.cc:2804] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:29.910373 22297 raft_consensus.cc:697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 24 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:29.911381 22297 consensus_queue.cc:237] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:29.915795 15583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84"
dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
 from {username='slave'} at 127.0.0.1:55298
I20260709 13:07:29.917476 15583 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.917989 15583 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:29.962013 15583 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:29.963569 15339 catalog_manager.cc:5697] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 23 to 24, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 24 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.965416 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:29.966070 15434 raft_consensus.cc:3055] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:29.966372 15434 raft_consensus.cc:740] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:29.982416 15434 consensus_queue.cc:260] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:29.988790 15434 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:29.998714 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cabc9d5f694971847d85f82e81df84" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:29.999461 16182 raft_consensus.cc:3060] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:30.000258 15583 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:30.010077 16182 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 23.
I20260709 13:07:30.021126 15556 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:30.012001 15434 raft_consensus.cc:2468] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 23.
I20260709 13:07:30.023216 22309 raft_consensus.cc:2804] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:30.023859 22309 raft_consensus.cc:697] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:30.024801 22309 consensus_queue.cc:237] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:30.046681 22277 raft_consensus.cc:993] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: : Instructing follower 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:07:30.047295 22277 raft_consensus.cc:1081] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Signalling peer 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:07:30.049705 15434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:46600
I20260709 13:07:30.050367 15434 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:30.050761 15434 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:30.126701 15434 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:30.132350 15438 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:30.121439 15340 catalog_manager.cc:5697] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 22 to 23, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 23 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.142165 22297 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:30.184281 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:30.184333 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:30.185071 15509 raft_consensus.cc:3055] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:30.185240 16178 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:30.185444 15509 raft_consensus.cc:740] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:30.190843 15509 consensus_queue.cc:260] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:30.192165 15509 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:30.220621 15434 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:30.228118 15509 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:30.232432 16178 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 17.
I20260709 13:07:30.233127 15406 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:30.234355 22322 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:30.234959 22322 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:30.236033 22322 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:30.254240 15509 raft_consensus.cc:1275] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:30.260640 22297 consensus_queue.cc:1048] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:30.308207 15514 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 24 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:07:30.312772 22297 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:30.354750 15340 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 16 to 17, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 17 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:30.375087 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 51612.6us
W20260709 13:07:30.407743 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 54000.5us
I20260709 13:07:30.436666 15434 raft_consensus.cc:1275] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 24 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:07:30.447434 22335 consensus_queue.cc:1048] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:07:30.464743 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 86463.9us
W20260709 13:07:30.471666 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 54724.1us
I20260709 13:07:30.595788 15514 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:30.633409 15438 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:30.635267 22297 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:30.640383 16178 raft_consensus.cc:1275] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:30.644207 22297 consensus_queue.cc:1048] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:30.656289 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:30.755787 15482 consensus_peers.cc:597] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 790046238f9f42cfa9d478a7ed4f2e21. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:30.768553 15442 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:30.772558 15583 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:07:30.795387 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 106385us
I20260709 13:07:30.803059 15514 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:30.805034 22079 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:30.781258 22271 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:07:30.812067 22337 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:30.828342 16178 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:30.843026 22322 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:30.884604 22277 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:30.900022 15434 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
W20260709 13:07:30.993515 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 77682.3us
I20260709 13:07:30.998530 15340 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index -1 to 15, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 22 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:31.150825 15516 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:31.172585 15583 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:31.209378 22363 ts_tablet_manager.cc:933] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:31.240299 22363 tablet_copy_client.cc:323] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:07:31.242848 15527 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet 790046238f9f42cfa9d478a7ed4f2e21 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:07:31.243599 15527 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet 790046238f9f42cfa9d478a7ed4f2e21 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-790046238f9f42cfa9d478a7ed4f2e21
I20260709 13:07:31.251107 15438 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:31.251191 15590 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:31.256790 15527 tablet_copy_source_session.cc:215] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:31.264415 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790046238f9f42cfa9d478a7ed4f2e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:31.270306 22361 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:31.284489 22350 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:31.288748 15482 consensus_peers.cc:597] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f012dbeed0364c8195192ae55ff12fef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:31.373497 22350 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:31.391358 15439 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:31.379403 22363 tablet_copy_client.cc:806] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:31.393791 22363 tablet_copy_client.cc:670] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:31.402714 15589 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:31.419000 22363 tablet_copy_client.cc:538] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:31.442358 22363 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:31.462101 15590 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:07:31.492944 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 49163.6us
I20260709 13:07:31.486653 15339 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 12, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 17 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:31.605250 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 56335.4us
W20260709 13:07:31.619443 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 72273us
W20260709 13:07:31.648284 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 90685.3us
W20260709 13:07:31.688014 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 120294us
W20260709 13:07:31.692346 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55915.1us
I20260709 13:07:31.770253 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:31.787460 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59608.4us
W20260709 13:07:31.817608 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 117807us
I20260709 13:07:31.843276 22391 ts_tablet_manager.cc:933] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:31.855285 15515 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:31.856133 22391 tablet_copy_client.cc:323] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
W20260709 13:07:31.875344 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 159318us
I20260709 13:07:31.878399 15438 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:31.884338 15527 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet f012dbeed0364c8195192ae55ff12fef from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:07:31.884968 15527 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet f012dbeed0364c8195192ae55ff12fef from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-f012dbeed0364c8195192ae55ff12fef
I20260709 13:07:31.895963 15527 tablet_copy_source_session.cc:215] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:31.902837 22390 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.917085 22391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f012dbeed0364c8195192ae55ff12fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:31.931470 22390 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.978235 15434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:31.979144 15434 raft_consensus.cc:606] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:31.982512 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 13:07:31.983948 15556 consensus_peers.cc:597] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27b4902277e34c9f97dd7889ac3f8375. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:31.984664 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:31.990414 22391 tablet_copy_client.cc:806] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:31.993995 22391 tablet_copy_client.cc:670] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:31.995432 22339 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:32.000537 15511 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:32.018625 22391 tablet_copy_client.cc:538] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:32.032927 22391 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:32.033483 15341 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 8, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:32.040861 22363 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:32.048903 22363 tablet_bootstrap.cc:492] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:32.056458 22363 ts_tablet_manager.cc:1403] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.614s	user 0.090s	sys 0.100s
I20260709 13:07:32.054044 15439 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:32.061702 15434 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:32.067166 22363 raft_consensus.cc:359] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:32.088277 22363 raft_consensus.cc:740] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:32.089226 22363 consensus_queue.cc:260] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:32.092555 22363 ts_tablet_manager.cc:1434] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 13:07:32.097537 15527 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-790046238f9f42cfa9d478a7ed4f2e21 received from {username='slave'} at 127.0.0.1:34302
I20260709 13:07:32.098098 15527 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-790046238f9f42cfa9d478a7ed4f2e21 on tablet 790046238f9f42cfa9d478a7ed4f2e21 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:32.131821 15513 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:32.132365 15588 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:07:32.134334 15407 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff30e083feaf42a3aca56510e7fe367a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:32.136039 22388 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:32.138530 22388 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:32.224354 22322 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:32.232234 15586 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:32.240895 16178 raft_consensus.cc:1217] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 13:07:32.283968 15511 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:32.315172 22363 ts_tablet_manager.cc:933] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:32.359216 15340 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 19 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:32.374972 22363 tablet_copy_client.cc:323] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.67:37005
I20260709 13:07:32.380272 22079 raft_consensus.cc:993] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:32.384958 22079 raft_consensus.cc:1081] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:32.387468 15511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:32.388146 15511 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.388573 15511 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:32.389343 15602 tablet_copy_service.cc:140] P d225833a2cbf4a5995fdbbb1292d1918: Received BeginTabletCopySession request for tablet 27b4902277e34c9f97dd7889ac3f8375 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:51310)
I20260709 13:07:32.389993 15602 tablet_copy_service.cc:161] P d225833a2cbf4a5995fdbbb1292d1918: Beginning new tablet copy session on tablet 27b4902277e34c9f97dd7889ac3f8375 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:51310: session id = 6ff41728dec842afad5b53c20446a5a0-27b4902277e34c9f97dd7889ac3f8375
I20260709 13:07:32.413578 15602 tablet_copy_source_session.cc:215] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:32.415422 15511 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:32.418952 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b4902277e34c9f97dd7889ac3f8375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:32.444484 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:32.445228 15434 raft_consensus.cc:3055] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:32.445338 22391 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:32.445660 15434 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:32.449610 15434 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:32.450212 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:32.450603 15434 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:32.450871 15586 raft_consensus.cc:3060] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:32.458560 22391 tablet_bootstrap.cc:492] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:32.466240 15434 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 21.
I20260709 13:07:32.448375 15511 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:32.470711 22391 ts_tablet_manager.cc:1403] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.438s	user 0.061s	sys 0.008s
I20260709 13:07:32.474519 22391 raft_consensus.cc:359] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:32.479504 15482 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:32.496829 22391 raft_consensus.cc:740] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:32.497553 22350 raft_consensus.cc:2804] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:32.498157 22350 raft_consensus.cc:697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:32.498292 22391 consensus_queue.cc:260] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:32.499212 22350 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:32.507102 22363 tablet_copy_client.cc:806] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
W20260709 13:07:32.526602 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47207.8us
I20260709 13:07:32.527887 22391 ts_tablet_manager.cc:1434] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.002s
I20260709 13:07:32.529871 15527 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-f012dbeed0364c8195192ae55ff12fef received from {username='slave'} at 127.0.0.1:34302
I20260709 13:07:32.530345 15527 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-f012dbeed0364c8195192ae55ff12fef on tablet f012dbeed0364c8195192ae55ff12fef with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:32.547910 22363 tablet_copy_client.cc:670] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:32.553798 22363 tablet_copy_client.cc:538] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:32.488933 15586 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 21.
I20260709 13:07:32.604796 22404 ts_tablet_manager.cc:933] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:07:32.619486 22404 tablet_copy_client.cc:323] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:07:32.621613 15453 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet ff30e083feaf42a3aca56510e7fe367a from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:07:32.622447 15453 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet ff30e083feaf42a3aca56510e7fe367a from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-ff30e083feaf42a3aca56510e7fe367a
I20260709 13:07:32.624123 15339 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 20 to 21, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 21 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.649430 22363 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:32.652118 15453 tablet_copy_source_session.cc:215] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:07:32.667827 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 82776.3us
I20260709 13:07:32.703596 22404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff30e083feaf42a3aca56510e7fe367a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:32.744735 16182 raft_consensus.cc:1217] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:07:32.753242 22404 tablet_copy_client.cc:806] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:32.753902 22404 tablet_copy_client.cc:670] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:32.789655 22404 tablet_copy_client.cc:538] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:32.826514 22404 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:32.847208 22372 raft_consensus.cc:1064] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:32.850222 22372 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:32.925450 16182 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:32.927917 15588 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:32.931190 15434 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:32.970685 22410 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:07:32.972851 22363 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:32.974887 22363 tablet_bootstrap.cc:492] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:32.975741 22363 ts_tablet_manager.cc:1403] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.327s	user 0.039s	sys 0.017s
I20260709 13:07:32.970940 22380 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:07:32.975695 22410 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:07:32.992286 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.033921 15435 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:33.068032 22411 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:07:33.085043 22363 raft_consensus.cc:359] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:33.094780 22363 raft_consensus.cc:740] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:33.106689 22363 consensus_queue.cc:260] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:33.117187 22363 ts_tablet_manager.cc:1434] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.138s	user 0.006s	sys 0.003s
I20260709 13:07:33.119853 15602 tablet_copy_service.cc:342] P d225833a2cbf4a5995fdbbb1292d1918: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-27b4902277e34c9f97dd7889ac3f8375 received from {username='slave'} at 127.0.0.1:51310
I20260709 13:07:33.120422 15602 tablet_copy_service.cc:434] P d225833a2cbf4a5995fdbbb1292d1918: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-27b4902277e34c9f97dd7889ac3f8375 on tablet 27b4902277e34c9f97dd7889ac3f8375 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:33.187520 15588 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:33.193271 15588 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:33.214596 22357 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:33.187724 22380 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:33.248788 22416 log.cc:927] Time spent T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:07:33.360286 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 85244.6us
W20260709 13:07:33.409137 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 45823.8us
I20260709 13:07:33.437305 16182 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:33.466957 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106765us
I20260709 13:07:33.474407 15340 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 15 to 16, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.492640 15439 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:33.507144 16178 raft_consensus.cc:1217] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 13:07:33.529656 22380 raft_consensus.cc:1064] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:33.533049 22380 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:33.681129 15586 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:33.690253 15434 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:33.693048 22423 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:33.697871 16182 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:33.699523 22380 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:33.725152 22404 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:33.726277 22404 tablet_bootstrap.cc:492] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:33.727120 22404 ts_tablet_manager.cc:1403] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.901s	user 0.042s	sys 0.016s
I20260709 13:07:33.732892 22404 raft_consensus.cc:359] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:33.733762 22404 raft_consensus.cc:740] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:33.734441 22404 consensus_queue.cc:260] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:33.741343 22404 ts_tablet_manager.cc:1434] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 13:07:33.755584 15453 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-ff30e083feaf42a3aca56510e7fe367a received from {username='slave'} at 127.0.0.1:47420
I20260709 13:07:33.756121 15453 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-ff30e083feaf42a3aca56510e7fe367a on tablet ff30e083feaf42a3aca56510e7fe367a with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:33.781128 22426 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:33.782371 15515 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:33.809252 16182 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:07:33.815973 15589 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:07:33.820686 22426 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:07:33.849560 22423 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:33.887506 22380 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:07:33.904824 15589 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:33.902974 15434 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:33.982404 15336 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 12 to 13, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.991328 22426 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:34.023979 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 79047.4us
I20260709 13:07:34.030386 16182 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.036895 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 790046238f9f42cfa9d478a7ed4f2e21 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:34.040922 15589 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.042547 16174 raft_consensus.cc:2955] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.047783 15339 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 16 to 17, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 22 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.096542 22383 raft_consensus.cc:1064] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:34.099422 22383 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 6, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:34.111073 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet 790046238f9f42cfa9d478a7ed4f2e21 with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:56808
I20260709 13:07:34.117280 15515 consensus_queue.cc:237] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:34.133795 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.151266 22448 tablet_replica.cc:333] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:34.163264 22448 raft_consensus.cc:2243] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:34.165177 16174 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:34.165177 15434 raft_consensus.cc:1275] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:34.168591 22421 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:34.172883 22421 consensus_queue.cc:1048] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:34.179278 16182 raft_consensus.cc:1217] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:07:34.179193 22447 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.188795 15435 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:34.188894 16174 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEARNER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:34.192605 22390 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:34.198699 22390 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:34.198062 16179 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.196249 15434 raft_consensus.cc:2955] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.205054 15515 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:34.210624 22383 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:34.224157 22448 raft_consensus.cc:2272] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:34.280421 15339 catalog_manager.cc:5697] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 13 to 14, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 17 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.303329 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f012dbeed0364c8195192ae55ff12fef with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:34.305092 22383 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.308188 15511 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.311133 15515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:37880
I20260709 13:07:34.311702 15515 raft_consensus.cc:606] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:34.322094 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:34.324013 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:34.332206 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet f012dbeed0364c8195192ae55ff12fef with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:48416
I20260709 13:07:34.340981 16182 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.351218 22448 ts_tablet_manager.cc:1916] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:34.397022 15435 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:34.376904 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 50483.5us
I20260709 13:07:34.446993 22454 tablet_replica.cc:333] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:07:34.449512 22454 raft_consensus.cc:2243] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:34.441460 15341 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 8 to 9, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.472414 22454 raft_consensus.cc:2272] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:34.502058 15586 consensus_queue.cc:237] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:34.508456 22448 ts_tablet_manager.cc:1929] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.16
I20260709 13:07:34.512032 22448 log.cc:1199] T 790046238f9f42cfa9d478a7ed4f2e21 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/790046238f9f42cfa9d478a7ed4f2e21
I20260709 13:07:34.515019 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet 790046238f9f42cfa9d478a7ed4f2e21 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:34.515498 16182 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:34.517621 15516 raft_consensus.cc:1275] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:34.518045 22339 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:34.518986 22383 consensus_queue.cc:1048] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:34.516984 22454 ts_tablet_manager.cc:1916] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:34.528290 22383 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.535789 15516 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.548895 16179 raft_consensus.cc:2955] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.554946 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 27b4902277e34c9f97dd7889ac3f8375 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:34.576360 22426 raft_consensus.cc:993] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: : Instructing follower 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:07:34.577296 22426 raft_consensus.cc:1081] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Signalling peer 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:07:34.581167 15435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:46600
I20260709 13:07:34.581801 15435 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.582183 15435 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:34.606113 15339 catalog_manager.cc:5697] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 9 to 10, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 14 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.594584 15435 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:34.620630 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:34.621295 15509 raft_consensus.cc:3055] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:34.621589 15509 raft_consensus.cc:740] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:34.622545 15509 consensus_queue.cc:260] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:34.627707 15509 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:34.629606 22455 raft_consensus.cc:1064] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:34.631392 15435 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:34.633617 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:34.634145 15589 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:34.637627 22455 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:34.638213 15509 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 22.
I20260709 13:07:34.642328 15406 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:34.643739 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet 27b4902277e34c9f97dd7889ac3f8375 with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:56808
I20260709 13:07:34.644496 22453 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:34.644695 22448 tablet_replica.cc:333] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:34.645123 22453 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:34.646102 22448 raft_consensus.cc:2243] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:34.646245 22453 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:34.647141 22448 raft_consensus.cc:2272] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:34.681620 22448 ts_tablet_manager.cc:1916] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:34.674779 15589 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 22.
I20260709 13:07:34.694734 15589 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:34.697505 22435 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:34.706178 16179 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:34.710131 15509 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:34.716823 22456 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:07:34.731653 22435 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:34.729205 22454 ts_tablet_manager.cc:1929] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:07:34.732901 22454 log.cc:1199] T f012dbeed0364c8195192ae55ff12fef P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/f012dbeed0364c8195192ae55ff12fef
I20260709 13:07:34.741300 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet f012dbeed0364c8195192ae55ff12fef (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:34.743083 15339 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 21 to 22, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 22 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.772974 22448 ts_tablet_manager.cc:1929] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 13:07:34.773644 22448 log.cc:1199] T 27b4902277e34c9f97dd7889ac3f8375 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/27b4902277e34c9f97dd7889ac3f8375
I20260709 13:07:34.776953 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet 27b4902277e34c9f97dd7889ac3f8375 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:34.789626 22435 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.811090 15589 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.830976 15516 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.802503 16179 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:34.834674 15339 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.870806 15435 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:34.940701 15589 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:34.953079 16174 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:34.954357 22435 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:34.958052 22435 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:34.965605 22453 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:35.004357 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff30e083feaf42a3aca56510e7fe367a with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:35.011006 16174 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:35.022796 15336 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 19 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.024859 15586 raft_consensus.cc:2955] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:35.052421 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet ff30e083feaf42a3aca56510e7fe367a with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:58996
I20260709 13:07:35.071187 15589 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:35.075049 22456 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:07:35.133442 22462 tablet_replica.cc:333] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:35.134774 22462 raft_consensus.cc:2243] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.144097 22462 raft_consensus.cc:2272] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.161337 22462 ts_tablet_manager.cc:1916] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:35.184250 15509 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:35.189141 22455 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:35.235430 22462 ts_tablet_manager.cc:1929] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 13:07:35.236188 22462 log.cc:1199] T ff30e083feaf42a3aca56510e7fe367a P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/ff30e083feaf42a3aca56510e7fe367a
I20260709 13:07:35.243351 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet ff30e083feaf42a3aca56510e7fe367a (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:35.325170 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:36.296077 15516 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:36.341756 15439 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:36.343941 15588 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:07:36.350687 15482 consensus_peers.cc:597] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb9e1d3b1096451da3fea10491454092. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.351349 22469 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:36.353458 22469 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:36.431131 22469 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:36.518956 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:36.513849 15589 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:36.620419 15439 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:36.678617 15336 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 13, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.743326 15588 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:36.745401 15434 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:36.748607 15511 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:36.752700 22476 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:36.783038 22475 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:36.807282 15407 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6c6411adf9842fc9281582ab8b1842c. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:36.833689 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 111967us
I20260709 13:07:36.870922 22349 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:36.883965 15516 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:36.915148 15588 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:36.937330 22486 ts_tablet_manager.cc:933] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:36.995036 15516 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:36.996580 22486 tablet_copy_client.cc:323] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:07:37.008747 15527 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet bb9e1d3b1096451da3fea10491454092 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:07:37.010515 15527 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet bb9e1d3b1096451da3fea10491454092 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-bb9e1d3b1096451da3fea10491454092
I20260709 13:07:37.024104 15527 tablet_copy_source_session.cc:215] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:37.029112 22486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9e1d3b1096451da3fea10491454092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.048940 15588 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:07:37.054564 15482 consensus_peers.cc:597] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f91e9b24450f4bc88be5be6228d8587f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:37.055085 22426 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:37.061875 15340 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:37.073014 15434 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:37.075824 22426 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:37.098497 15438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
mode: GRACEFUL
new_leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:44656
I20260709 13:07:37.099318 15438 raft_consensus.cc:606] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Received request to transfer leadership to TS 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:37.102290 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:37.104501 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:37.131831 22486 tablet_copy_client.cc:806] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:37.132647 22486 tablet_copy_client.cc:670] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:37.146561 22486 tablet_copy_client.cc:538] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:37.162184 22493 ts_tablet_manager.cc:933] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:07:37.171499 22486 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:37.181996 22426 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:37.183635 15588 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:37.230659 15438 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:37.235791 15340 catalog_manager.cc:5697] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.254756 22493 tablet_copy_client.cc:323] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:07:37.262102 15453 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet a6c6411adf9842fc9281582ab8b1842c from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:07:37.262837 15453 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet a6c6411adf9842fc9281582ab8b1842c from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-a6c6411adf9842fc9281582ab8b1842c
I20260709 13:07:37.275490 15442 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:37.294320 15453 tablet_copy_source_session.cc:215] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:07:37.309813 15407 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f8c57ead024481e8882a1b97814f799. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:37.312701 22493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c6411adf9842fc9281582ab8b1842c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.347241 15516 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:37.348680 15588 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:37.350754 22475 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:37.367566 22476 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:37.411741 22475 raft_consensus.cc:993] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: : Instructing follower 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:37.412366 22475 raft_consensus.cc:1081] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Signalling peer 8a55534dc8864943937d5b6ec0e6aaf9 to start an election
I20260709 13:07:37.422837 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
 from {username='slave'} at 127.0.0.1:40676
I20260709 13:07:37.423573 15513 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.407337 22493 tablet_copy_client.cc:806] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:37.424069 15513 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.426751 22349 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:37.456713 22493 tablet_copy_client.cc:670] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:37.457404 15583 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:37.474274 15513 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:37.490069 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:37.490875 15589 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.489516 15513 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:37.508314 15589 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:37.516788 15482 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:37.517294 22493 tablet_copy_client.cc:538] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:37.518021 22479 raft_consensus.cc:2804] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:37.518622 22479 raft_consensus.cc:697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:37.519657 22479 consensus_queue.cc:237] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:37.526499 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 154752us
I20260709 13:07:37.530992 15340 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 17 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.580199 15434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bd8cd50304a9e89be009f16906be3" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
I20260709 13:07:37.581043 15434 raft_consensus.cc:3055] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:37.581449 15434 raft_consensus.cc:740] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:37.592947 15434 consensus_queue.cc:260] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:37.605451 22503 ts_tablet_manager.cc:933] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:37.609268 15434 raft_consensus.cc:3060] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.622653 15513 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:37.636904 22493 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:37.626566 15340 catalog_manager.cc:5697] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 19 to 20, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 20 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.692554 22503 tablet_copy_client.cc:323] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:07:37.722672 15434 raft_consensus.cc:2468] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:37.730783 15527 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet f91e9b24450f4bc88be5be6228d8587f from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:07:37.731762 15527 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet f91e9b24450f4bc88be5be6228d8587f from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-f91e9b24450f4bc88be5be6228d8587f
I20260709 13:07:37.776811 22486 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:37.777981 22486 tablet_bootstrap.cc:492] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:37.797384 15527 tablet_copy_source_session.cc:215] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:37.797602 22486 ts_tablet_manager.cc:1403] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.626s	user 0.044s	sys 0.019s
I20260709 13:07:37.818410 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91e9b24450f4bc88be5be6228d8587f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.831928 22486 raft_consensus.cc:359] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:37.833129 22486 raft_consensus.cc:740] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:37.868062 22486 consensus_queue.cc:260] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:37.893270 22486 ts_tablet_manager.cc:1434] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.000s
I20260709 13:07:37.895190 15527 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-bb9e1d3b1096451da3fea10491454092 received from {username='slave'} at 127.0.0.1:34302
I20260709 13:07:37.895730 15527 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-bb9e1d3b1096451da3fea10491454092 on tablet bb9e1d3b1096451da3fea10491454092 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:37.924032 22486 ts_tablet_manager.cc:933] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757)
I20260709 13:07:37.930074 22493 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:37.935642 22503 tablet_copy_client.cc:806] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:37.941642 22503 tablet_copy_client.cc:670] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:37.945662 22493 tablet_bootstrap.cc:492] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:37.946748 22493 ts_tablet_manager.cc:1403] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.310s	user 0.064s	sys 0.016s
I20260709 13:07:37.948895 22503 tablet_copy_client.cc:538] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:37.964141 22493 raft_consensus.cc:359] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:37.969403 22503 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:37.969616 22493 raft_consensus.cc:740] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:37.971240 22493 consensus_queue.cc:260] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:37.976692 22493 ts_tablet_manager.cc:1434] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:07:37.984195 15453 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-a6c6411adf9842fc9281582ab8b1842c received from {username='slave'} at 127.0.0.1:47420
I20260709 13:07:37.984745 15453 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-a6c6411adf9842fc9281582ab8b1842c on tablet a6c6411adf9842fc9281582ab8b1842c with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:37.991742 22486 tablet_copy_client.cc:323] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.65:36757
I20260709 13:07:37.993686 15453 tablet_copy_service.cc:140] P 5ccb2e30f44f40c2b22339e1d4c74a83: Received BeginTabletCopySession request for tablet 4f8c57ead024481e8882a1b97814f799 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:47420)
I20260709 13:07:37.994256 15453 tablet_copy_service.cc:161] P 5ccb2e30f44f40c2b22339e1d4c74a83: Beginning new tablet copy session on tablet 4f8c57ead024481e8882a1b97814f799 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:47420: session id = 6ff41728dec842afad5b53c20446a5a0-4f8c57ead024481e8882a1b97814f799
I20260709 13:07:38.006879 15453 tablet_copy_source_session.cc:215] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:38.016103 22486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8c57ead024481e8882a1b97814f799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.041244 15439 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:38.043819 22479 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:38.131953 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:38.208986 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 64421.9us
I20260709 13:07:38.209138 22486 tablet_copy_client.cc:806] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:38.210258 22486 tablet_copy_client.cc:670] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:38.236738 15583 raft_consensus.cc:1275] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:07:38.279063 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 122322us
W20260709 13:07:38.305408 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 71310.6us
I20260709 13:07:38.319770 16182 raft_consensus.cc:1217] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
W20260709 13:07:38.323021 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 69264.7us
W20260709 13:07:38.361598 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 105215us
W20260709 13:07:38.427889 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 45714.4us
W20260709 13:07:38.444377 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 71000.3us
W20260709 13:07:38.458072 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 97140.4us
I20260709 13:07:38.465643 22486 tablet_copy_client.cc:538] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:38.496501 22486 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:38.497303 16174 raft_consensus.cc:1217] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.12->[16.13-16.13]   Dedup: 16.13->[]
W20260709 13:07:38.527691 22503 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:07:38.529868 22503 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:38.531198 22503 tablet_bootstrap.cc:492] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:38.546641 22503 ts_tablet_manager.cc:1403] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.578s	user 0.054s	sys 0.014s
I20260709 13:07:38.552403 22469 consensus_queue.cc:1048] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:38.611378 22503 raft_consensus.cc:359] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:38.618042 22503 raft_consensus.cc:740] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:38.628065 22503 consensus_queue.cc:260] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:38.649025 22503 ts_tablet_manager.cc:1434] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.085s	user 0.002s	sys 0.005s
I20260709 13:07:38.653350 15527 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-f91e9b24450f4bc88be5be6228d8587f received from {username='slave'} at 127.0.0.1:34302
I20260709 13:07:38.653867 15527 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-f91e9b24450f4bc88be5be6228d8587f on tablet f91e9b24450f4bc88be5be6228d8587f with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:38.663455 16174 raft_consensus.cc:1217] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
W20260709 13:07:38.723367 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 52055.5us
I20260709 13:07:38.801301 22486 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:38.802501 22486 tablet_bootstrap.cc:492] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:38.803313 22486 ts_tablet_manager.cc:1403] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.307s	user 0.038s	sys 0.018s
I20260709 13:07:38.826474 22512 raft_consensus.cc:1064] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:38.831399 22512 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:38.837842 22486 raft_consensus.cc:359] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:38.841801 22469 raft_consensus.cc:1064] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:38.858373 22486 raft_consensus.cc:740] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:38.859618 22486 consensus_queue.cc:260] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:38.857291 22469 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:38.908663 16182 raft_consensus.cc:1217] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:07:38.967288 22486 ts_tablet_manager.cc:1434] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.164s	user 0.008s	sys 0.000s
I20260709 13:07:38.969617 15453 tablet_copy_service.cc:342] P 5ccb2e30f44f40c2b22339e1d4c74a83: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-4f8c57ead024481e8882a1b97814f799 received from {username='slave'} at 127.0.0.1:47420
I20260709 13:07:38.970191 15453 tablet_copy_service.cc:434] P 5ccb2e30f44f40c2b22339e1d4c74a83: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-4f8c57ead024481e8882a1b97814f799 on tablet 4f8c57ead024481e8882a1b97814f799 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:38.987087 16182 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:38.988449 15583 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:38.999598 22525 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:07:39.005439 22524 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:39.043084 15436 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:39.045888 15589 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:39.048569 22426 raft_consensus.cc:1064] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:39.056638 22479 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:39.059938 22455 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:39.054896 22426 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:39.112450 15509 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:39.149665 22349 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:39.154376 16174 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:39.163144 22512 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:39.174404 22349 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.195175 15509 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.215643 22469 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:39.232026 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 83463.3us
I20260709 13:07:39.241662 15589 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:39.245733 16182 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.256162 16179 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:39.300482 15340 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.307231 15583 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.332449 16182 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.335871 15434 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:39.370240 22426 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:39.376287 22524 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:39.402666 15434 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:39.418541 16182 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:39.430115 22469 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:39.430663 15336 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 13 to 14, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.435848 22512 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:39.449456 15589 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:39.456396 22349 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.460506 15590 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.462112 15434 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.468032 16174 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.486024 22455 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:39.510876 15583 raft_consensus.cc:2955] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.521899 22519 raft_consensus.cc:1064] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:39.528939 22519 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:39.542829 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6c6411adf9842fc9281582ab8b1842c with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:39.555219 15339 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 15 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:39.606577 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:39.648181 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 72369.1us
I20260709 13:07:39.659060 15586 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:39.660132 16182 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEARNER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:39.663378 15515 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:39.667048 22512 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:07:39.670681 22455 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:39.707623 22514 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 13:07:39.722384 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 123065us
I20260709 13:07:39.744310 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet a6c6411adf9842fc9281582ab8b1842c with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:58996
W20260709 13:07:39.807137 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 62192.3us
I20260709 13:07:39.811715 22553 tablet_replica.cc:333] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:39.816587 22426 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:39.828351 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 94123.1us
I20260709 13:07:39.866637 22553 raft_consensus.cc:2243] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.866833 15516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9178296553b44a3f82267d1278be3746"
dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
mode: GRACEFUL
new_leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:37880
I20260709 13:07:39.867504 15516 raft_consensus.cc:606] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Received request to transfer leadership to TS 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:39.868042 22553 raft_consensus.cc:2272] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.885099 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:39.888229 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:39.906543 15513 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:39.917415 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 103705us
I20260709 13:07:39.921162 15436 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.039683 22349 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:40.048260 22552 log.cc:927] Time spent T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
W20260709 13:07:40.077140 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 128755us
W20260709 13:07:40.069819 22537 log.cc:927] Time spent T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:07:40.107321 15406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 56791.7us
I20260709 13:07:40.169771 22553 ts_tablet_manager.cc:1916] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:40.191880 15586 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:07:40.199193 15339 catalog_manager.cc:5697] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:40.164933 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 126840us
I20260709 13:07:40.180284 15514 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.227794 16174 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.210484 15586 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.265708 16179 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:07:40.265314 16182 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.273989 15590 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.335079 22469 raft_consensus.cc:993] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: : Instructing follower 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:07:40.338441 22469 raft_consensus.cc:1081] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Signalling peer 5ccb2e30f44f40c2b22339e1d4c74a83 to start an election
I20260709 13:07:40.347599 22469 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:40.402405 15440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9178296553b44a3f82267d1278be3746"
dest_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83"
 from {username='slave'} at 127.0.0.1:46600
I20260709 13:07:40.404484 15440 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.405054 15440 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:40.417179 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 76736.3us
W20260709 13:07:40.431847 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 69041us
I20260709 13:07:40.433207 22561 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:40.433240 15440 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:40.436347 15440 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:40.438946 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 68015.1us
I20260709 13:07:40.442203 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:40.443809 15514 raft_consensus.cc:3055] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:40.444183 15514 raft_consensus.cc:740] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:40.446924 15514 consensus_queue.cc:260] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:40.449138 15514 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:40.472424 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:40.473296 15585 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:40.473421 22553 ts_tablet_manager.cc:1929] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:07:40.474834 22553 log.cc:1199] T a6c6411adf9842fc9281582ab8b1842c P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/a6c6411adf9842fc9281582ab8b1842c
W20260709 13:07:40.477403 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47257.6us
W20260709 13:07:40.477471 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 46827.5us
I20260709 13:07:40.486901 15585 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:40.489342 15407 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:40.490970 22568 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:40.491662 22568 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Becoming Leader. State: Replica: 5ccb2e30f44f40c2b22339e1d4c74a83, State: Running, Role: LEADER
I20260709 13:07:40.493139 22568 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:40.494154 22469 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.497841 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet a6c6411adf9842fc9281582ab8b1842c (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:40.503741 15590 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.505090 15336 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: config changed from index 11 to 12, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.506069 15514 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb2e30f44f40c2b22339e1d4c74a83 in term 14.
I20260709 13:07:40.513031 15514 consensus_queue.cc:237] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:40.521898 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb9e1d3b1096451da3fea10491454092 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:40.530462 15440 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:40.532423 22469 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:40.538636 15440 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:40.548758 22426 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.552064 15340 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: config changed from index 14 to 15, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.559044 15590 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:40.560012 16179 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:07:40.560736 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 68929.7us
I20260709 13:07:40.561306 15436 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.566316 22512 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:40.571432 22568 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:40.576488 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f91e9b24450f4bc88be5be6228d8587f with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:40.579097 15339 catalog_manager.cc:5697] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 reported cstate change: term changed from 13 to 14, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65). New cstate: current_term: 14 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.580799 22512 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.595773 16179 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.604188 15427 tablet_service.cc:1558] Processing DeleteTablet for tablet bb9e1d3b1096451da3fea10491454092 with delete_type TABLET_DATA_TOMBSTONED (TS 5ccb2e30f44f40c2b22339e1d4c74a83 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:56808
I20260709 13:07:40.610502 15590 raft_consensus.cc:2955] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.667197 16182 raft_consensus.cc:1275] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:40.691802 22585 tablet_replica.cc:333] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:40.697588 15326 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f8c57ead024481e8882a1b97814f799 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:40.703469 22566 consensus_queue.cc:1048] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:40.723197 16174 raft_consensus.cc:2955] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.737762 15340 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: config changed from index 12 to 13, VOTER 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) evicted. New cstate: current_term: 17 leader_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.752053 22585 raft_consensus.cc:2243] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.761150 22585 raft_consensus.cc:2272] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.748184 15336 catalog_manager.cc:5697] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 12 to 13, VOTER d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67) evicted. New cstate: current_term: 16 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.770896 22585 ts_tablet_manager.cc:1916] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:40.805245 15580 tablet_service.cc:1558] Processing DeleteTablet for tablet f91e9b24450f4bc88be5be6228d8587f with delete_type TABLET_DATA_TOMBSTONED (TS d225833a2cbf4a5995fdbbb1292d1918 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:48416
I20260709 13:07:40.807312 15500 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f8c57ead024481e8882a1b97814f799 with delete_type TABLET_DATA_TOMBSTONED (TS 8a55534dc8864943937d5b6ec0e6aaf9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:58996
I20260709 13:07:40.808418 22553 tablet_replica.cc:333] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:40.809559 22553 raft_consensus.cc:2243] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.810648 22553 raft_consensus.cc:2272] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.830765 22553 ts_tablet_manager.cc:1916] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:40.845124 16179 raft_consensus.cc:2955] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:40.847713 22587 tablet_replica.cc:333] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:07:40.852533 22587 raft_consensus.cc:2243] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.853745 22587 raft_consensus.cc:2272] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.866654 22587 ts_tablet_manager.cc:1916] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:40.925997 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:40.992586 15514 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:40.996672 22573 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:41.031231 22587 ts_tablet_manager.cc:1929] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:07:41.035698 22587 log.cc:1199] T f91e9b24450f4bc88be5be6228d8587f P d225833a2cbf4a5995fdbbb1292d1918: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/wals/f91e9b24450f4bc88be5be6228d8587f
I20260709 13:07:41.037732 15326 catalog_manager.cc:5028] TS d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): tablet f91e9b24450f4bc88be5be6228d8587f (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:41.035116 22585 ts_tablet_manager.cc:1929] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.14
I20260709 13:07:41.055567 22585 log.cc:1199] T bb9e1d3b1096451da3fea10491454092 P 5ccb2e30f44f40c2b22339e1d4c74a83: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/wals/bb9e1d3b1096451da3fea10491454092
I20260709 13:07:41.058563 22553 ts_tablet_manager.cc:1929] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:07:41.067878 15326 catalog_manager.cc:5028] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): tablet bb9e1d3b1096451da3fea10491454092 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
I20260709 13:07:41.070677 22553 log.cc:1199] T 4f8c57ead024481e8882a1b97814f799 P 8a55534dc8864943937d5b6ec0e6aaf9: Deleting WAL directory at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/wals/4f8c57ead024481e8882a1b97814f799
I20260709 13:07:41.072606 15325 catalog_manager.cc:5028] TS 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): tablet 4f8c57ead024481e8882a1b97814f799 (table test-workload [id=e108959ab6644de9910456c8ef215ab5]) successfully deleted
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:07:41.138499 14293 tablet_server.cc:179] TabletServer@127.13.245.65:0 shutting down...
W20260709 13:07:41.209252 15407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 79857us
I20260709 13:07:41.212248 15586 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Refusing update from remote peer 5ccb2e30f44f40c2b22339e1d4c74a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:07:41.239158 15482 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 28 similar messages]
W20260709 13:07:41.321789 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 82702.3us
W20260709 13:07:41.338168 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 87244us
I20260709 13:07:41.369189 22594 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:41.418778 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.439810 15482 consensus_peers.cc:597] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.450119 15482 consensus_peers.cc:597] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.455279 15482 consensus_peers.cc:597] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.522818 15482 consensus_peers.cc:597] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.523555 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 66916.4us
W20260709 13:07:41.524439 15482 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.525164 15482 consensus_peers.cc:597] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.566051 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 106328us
W20260709 13:07:41.582952 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.583750 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.588097 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.594543 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.601759 15482 consensus_peers.cc:597] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.638298 15482 consensus_peers.cc:597] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.638944 15482 consensus_peers.cc:597] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.639566 15482 consensus_peers.cc:597] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.644906 15482 consensus_peers.cc:597] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.649030 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.652012 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.652586 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.653085 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.692148 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.692859 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.693423 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.693979 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.694430 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 100359us
W20260709 13:07:41.706110 15482 consensus_peers.cc:597] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.707536 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.710386 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.716575 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.727098 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.727699 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.744400 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.745963 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.767814 15482 consensus_peers.cc:597] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.876248 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:41.877804 14293 tablet_replica.cc:333] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:41.882341 14293 raft_consensus.cc:2243] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.883651 14293 raft_consensus.cc:2272] T 567ba2de2d424a60ae555fb26b4de59b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.886675 14293 tablet_replica.cc:333] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:41.887686 14293 raft_consensus.cc:2243] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.888957 14293 raft_consensus.cc:2272] T badc8a91586140ab8a3903619efbd8c9 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.922940 14293 tablet_replica.cc:333] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:41.924008 14293 raft_consensus.cc:2243] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.924710 14293 raft_consensus.cc:2272] T a2e2091b55004aafb70a88703ef6fbfc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.982697 14293 tablet_replica.cc:333] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:41.983741 14293 raft_consensus.cc:2243] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.984807 14293 raft_consensus.cc:2272] T f012dbeed0364c8195192ae55ff12fef P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.987697 14293 tablet_replica.cc:333] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:41.988585 14293 raft_consensus.cc:2243] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.989388 14293 raft_consensus.cc:2272] T b48cca7667444b8c8bb999a280076795 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.015882 14293 tablet_replica.cc:333] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.016801 14293 raft_consensus.cc:2243] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.018576 14293 raft_consensus.cc:2272] T 41cabc9d5f694971847d85f82e81df84 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.050515 14293 tablet_replica.cc:333] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.051491 14293 raft_consensus.cc:2243] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.052755 14293 raft_consensus.cc:2272] T 82533161d7894b3db9b0230e076936b2 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.092000 14293 tablet_replica.cc:333] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.093381 14293 raft_consensus.cc:2243] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.094225 14293 raft_consensus.cc:2272] T 222e5d29fb564b08bdca15f666c0c986 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.117231 14293 tablet_replica.cc:333] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.124538 14293 raft_consensus.cc:2243] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.125228 14293 raft_consensus.cc:2272] T 1fcd0644c7dd431aa808e206e7ea031e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.128444 14293 tablet_replica.cc:333] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.129052 22594 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:42.129333 14293 raft_consensus.cc:2243] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.130064 14293 raft_consensus.cc:2272] T 08f534c2cc884d65b268a74636da80eb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.129798 22594 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.134605 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.139238 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653fb1b09eaf49f98c8993fbea783b3d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.142352 15406 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:42.143356 22573 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:42.144560 22594 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.162817 22594 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:42.163517 22594 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.169154 14293 tablet_replica.cc:333] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.170503 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.170140 14293 raft_consensus.cc:2243] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.172397 22594 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.174214 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.204896 14293 raft_consensus.cc:2272] T 8dc152f2e639487986baac02b0324f06 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.205042 15407 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.206560 22594 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:42.209636 14293 tablet_replica.cc:333] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.214623 22594 raft_consensus.cc:493] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:42.215305 22594 raft_consensus.cc:515] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.214887 14293 raft_consensus.cc:2243] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.216665 14293 raft_consensus.cc:2272] T 0af1111c429c4e6fad608ff1eeac116b P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.217742 22594 leader_election.cc:290] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.219664 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.220067 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b019444ffb4533ac4eb7baefd96ae7" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.222031 15407 leader_election.cc:304] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.223181 22558 raft_consensus.cc:2749] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:42.227727 14293 tablet_replica.cc:333] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.228891 14293 raft_consensus.cc:2243] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.236356 14293 raft_consensus.cc:2272] T f8071c427f08433d8ffd6bd0809b1076 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.239645 14293 tablet_replica.cc:333] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.245539 22594 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:42.249673 22594 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.249007 14293 raft_consensus.cc:2243] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.251607 14293 raft_consensus.cc:2272] T 562c25b8842b442a928630e10d13e618 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.252101 22594 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.253810 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.258342 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.259960 14293 tablet_replica.cc:333] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.260946 14293 raft_consensus.cc:2243] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.261662 14293 raft_consensus.cc:2272] T a42725e017f142629708ff226f2d53e1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.267519 15516 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:42.267418 14293 tablet_replica.cc:333] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.272454 14293 raft_consensus.cc:2243] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.273128 14293 raft_consensus.cc:2272] T 66d8364b020b43deb510a118a19d076a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.261708 15407 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.276631 22594 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:42.277890 22594 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:42.278474 22594 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.276044 14293 tablet_replica.cc:333] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.280053 14293 raft_consensus.cc:2243] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.280834 22594 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.286230 14293 raft_consensus.cc:2272] T e3f17bb405a44393bd7aacc1097a7a13 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.281929 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.289139 14293 tablet_replica.cc:333] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.282966 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adf54c918c8432f819a78622c9d46bc" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.294413 14293 raft_consensus.cc:2243] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.295591 15406 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.297093 14293 raft_consensus.cc:2272] T 9178296553b44a3f82267d1278be3746 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.297164 22573 raft_consensus.cc:493] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:42.308759 22573 raft_consensus.cc:515] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.298005 22558 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:42.311329 22573 leader_election.cc:290] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.313535 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.313535 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b48413efda34be880a83df9e239fb3c" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.317786 14293 tablet_replica.cc:333] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.318776 14293 raft_consensus.cc:2243] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.320132 15406 leader_election.cc:304] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:42.321045 22573 raft_consensus.cc:2749] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:42.323056 14293 raft_consensus.cc:2272] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.324131 22573 raft_consensus.cc:493] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:42.324671 22573 raft_consensus.cc:515] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.326090 14293 tablet_replica.cc:333] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.326903 22573 leader_election.cc:290] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.327083 14293 raft_consensus.cc:2243] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.328905 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.329449 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6555b0b9d1524fdcbea2216e3e879bba" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.332454 15406 leader_election.cc:304] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.333326 22573 raft_consensus.cc:2749] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:42.335835 14293 raft_consensus.cc:2272] T d40d294abeec453098d547799a79f7c5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:42.346247 15482 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 423df90a9f55438bbe1c32ab906c6e10. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.346839 15585 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:42.348729 22566 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:42.351914 15482 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.367522 22573 raft_consensus.cc:493] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:42.368237 22573 raft_consensus.cc:515] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.370929 22573 leader_election.cc:290] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.371780 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.372157 14293 tablet_replica.cc:333] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.372660 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894134e9e1614272b87adbf47e180cdb" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.373139 14293 raft_consensus.cc:2243] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.372579 15583 raft_consensus.cc:2955] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:42.373857 14293 raft_consensus.cc:2272] T 423df90a9f55438bbe1c32ab906c6e10 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.376881 14293 tablet_replica.cc:333] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.381973 15407 leader_election.cc:304] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.386554 22573 raft_consensus.cc:2749] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:42.371842 22469 raft_consensus.cc:2955] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:42.399479 14293 raft_consensus.cc:2243] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.400810 14293 raft_consensus.cc:2272] T 4f8c57ead024481e8882a1b97814f799 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.404354 22558 raft_consensus.cc:493] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:42.404978 22558 raft_consensus.cc:515] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.406883 22594 raft_consensus.cc:493] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:42.407526 22594 raft_consensus.cc:515] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } }
I20260709 13:07:42.408823 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.409781 22594 leader_election.cc:290] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:42.411887 14293 tablet_replica.cc:333] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.411849 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.414400 14293 raft_consensus.cc:2243] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.407251 22558 leader_election.cc:290] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.418916 15590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3782fb71a4794032bbb7124248fc9b05" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.421411 14293 raft_consensus.cc:2272] T 327bd8cd50304a9e89be009f16906be3 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.421723 22558 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:42.419078 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5602b415c44c2486bba85d5cbf2ec5" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.422366 22558 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.419639 22573 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:42.423352 22573 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.425701 22573 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.426201 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.428504 22558 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.419759 22594 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:42.419600 15516 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:42.429509 22594 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.434391 14293 tablet_replica.cc:333] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.435981 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.436338 14293 raft_consensus.cc:2243] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.436995 14293 raft_consensus.cc:2272] T bee09de23aee40d689e3f0426ed38fc1 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.440917 22594 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.444643 15339 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 9, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 15 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.444042 14293 tablet_replica.cc:333] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.464184 14293 raft_consensus.cc:2243] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.499866 15583 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:07:42.499886 15482 consensus_peers.cc:597] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07d5db06e4ec455f8b7755416957114a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.501657 22469 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:42.504488 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.504890 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927b236d9342309d9e8c7a6a9b2f95" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.507351 15407 leader_election.cc:304] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.507751 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1915fdd81d344a749443e48f07a1fef8" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.508632 15407 leader_election.cc:304] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.509316 22594 raft_consensus.cc:2706] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Received pre-election callback for term 16 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:07:42.509812 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.516018 14293 raft_consensus.cc:2272] T 3782fb71a4794032bbb7124248fc9b05 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.518091 15407 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:42.520933 22558 raft_consensus.cc:493] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:42.521391 22609 raft_consensus.cc:2749] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:42.521510 22558 raft_consensus.cc:515] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.524813 22558 leader_election.cc:290] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.529771 22558 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:42.530333 15407 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:42.531037 15482 consensus_peers.cc:597] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.531929 15407 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.532193 14293 tablet_replica.cc:333] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.532336 22558 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:42.532712 22594 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:42.535259 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.535146 14293 raft_consensus.cc:2243] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.543161 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496a555ec7cc49798fc4d775f6d151ed" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.553756 15583 raft_consensus.cc:2955] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:42.553627 22594 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:42.556159 22594 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.556072 22566 raft_consensus.cc:2955] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:42.558552 22594 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.561486 22609 raft_consensus.cc:493] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ff41728dec842afad5b53c20446a5a0)
I20260709 13:07:42.562057 22609 raft_consensus.cc:515] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.566745 22594 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:42.566871 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.567345 22594 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:42.572392 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.575109 22609 leader_election.cc:290] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.576164 22594 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:42.582012 14293 raft_consensus.cc:2272] T 6555b0b9d1524fdcbea2216e3e879bba P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.584159 15583 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:42.588761 22594 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:42.590071 22594 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.592294 22594 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.593811 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.616207 14293 tablet_replica.cc:333] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.617364 14293 raft_consensus.cc:2243] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.620447 14293 raft_consensus.cc:2272] T c098e199a9c74c79bc225b7ce9d73ff4 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.626986 22615 raft_consensus.cc:493] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:42.627871 22615 raft_consensus.cc:515] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:42.632056 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:42.632678 14293 tablet_replica.cc:333] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.634030 14293 raft_consensus.cc:2243] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.642629 14293 raft_consensus.cc:2272] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:42.653302 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529): Couldn't send request to peer 6ff41728dec842afad5b53c20446a5a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2e2091b55004aafb70a88703ef6fbfc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.655638 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87e12456fed4de1b2d723da6cc14d3a" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.657713 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:42.658278 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91e9b24450f4bc88be5be6228d8587f" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.655519 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3252dd04824c9ca1c0b6dfd9c7c387" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.660048 15407 leader_election.cc:304] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:42.661125 22594 raft_consensus.cc:2749] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:42.662000 15407 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.663028 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b97fcd3d908482fadc6fa54e513304d" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:42.663275 15407 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:42.664690 15513 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:42.664985 15407 leader_election.cc:304] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:42.664004 22609 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:42.667856 22573 raft_consensus.cc:2749] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:42.665747 22558 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:42.670917 22580 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:07:42.677496 15407 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.678783 14293 tablet_replica.cc:333] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.679827 14293 raft_consensus.cc:2243] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.678414 22609 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.680593 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8042e01976403089e7b30f1a5b5740" candidate_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:42.686698 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.666785 22615 leader_election.cc:290] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:42.690485 15407 leader_election.cc:304] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb2e30f44f40c2b22339e1d4c74a83; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:42.691824 14293 raft_consensus.cc:2272] T 1915fdd81d344a749443e48f07a1fef8 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.692196 22615 raft_consensus.cc:2749] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:42.699303 14293 tablet_replica.cc:333] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.700469 14293 raft_consensus.cc:2243] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.701542 14293 raft_consensus.cc:2272] T 5b97fcd3d908482fadc6fa54e513304d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.705838 14293 tablet_replica.cc:333] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.706820 14293 raft_consensus.cc:2243] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.707566 14293 raft_consensus.cc:2272] T 3b48413efda34be880a83df9e239fb3c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.698778 22601 raft_consensus.cc:2955] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:42.710779 14293 tablet_replica.cc:333] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.711886 14293 raft_consensus.cc:2243] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.712543 14293 raft_consensus.cc:2272] T 07d5db06e4ec455f8b7755416957114a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.717512 15513 raft_consensus.cc:2955] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:42.719316 14293 tablet_replica.cc:333] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.720598 14293 raft_consensus.cc:2243] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.720690 15341 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 14, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 21 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.722026 14293 raft_consensus.cc:2272] T a6c6411adf9842fc9281582ab8b1842c P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.725167 14293 tablet_replica.cc:333] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.726045 14293 raft_consensus.cc:2243] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.726691 14293 raft_consensus.cc:2272] T 4a8042e01976403089e7b30f1a5b5740 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:42.742825 15389 auto_rebalancer.cc:629] Failed to schedule move for tablet 9178296553b44a3f82267d1278be3746: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:42.758289 14293 tablet_replica.cc:333] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.759322 14293 raft_consensus.cc:2243] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.760311 14293 raft_consensus.cc:2272] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.763134 14293 tablet_replica.cc:333] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.773514 14293 raft_consensus.cc:2243] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.769541 15341 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index -1 to 14, NON_VOTER 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) added. New cstate: current_term: 21 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } } }
I20260709 13:07:42.775190 14293 raft_consensus.cc:2272] T 4adf54c918c8432f819a78622c9d46bc P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.778307 14293 tablet_replica.cc:333] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.784013 14293 raft_consensus.cc:2243] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.784665 14293 raft_consensus.cc:2272] T ae531d3e35db41bc9f66769323b94372 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.788133 14293 tablet_replica.cc:333] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.789125 14293 raft_consensus.cc:2243] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.789762 14293 raft_consensus.cc:2272] T 894134e9e1614272b87adbf47e180cdb P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.792560 14293 tablet_replica.cc:333] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.807188 14293 raft_consensus.cc:2243] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.808604 14293 raft_consensus.cc:2272] T ff30e083feaf42a3aca56510e7fe367a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.813153 14293 tablet_replica.cc:333] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.814694 14293 raft_consensus.cc:2243] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.820428 14293 raft_consensus.cc:2272] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.851933 14293 tablet_replica.cc:333] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.853408 22621 ts_tablet_manager.cc:933] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:42.858101 14293 raft_consensus.cc:2243] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.877626 22621 tablet_copy_client.cc:323] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:07:42.877861 14293 raft_consensus.cc:2272] T f2b019444ffb4533ac4eb7baefd96ae7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.880103 15527 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet 423df90a9f55438bbe1c32ab906c6e10 from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:07:42.880724 15527 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet 423df90a9f55438bbe1c32ab906c6e10 from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-423df90a9f55438bbe1c32ab906c6e10
I20260709 13:07:42.890811 15527 tablet_copy_source_session.cc:215] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:42.904455 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423df90a9f55438bbe1c32ab906c6e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.897629 14293 tablet_replica.cc:333] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.908382 14293 raft_consensus.cc:2243] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.910286 14293 raft_consensus.cc:2272] T 534703c18f76440380b33b80bf77802e P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.917043 14293 tablet_replica.cc:333] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.917989 14293 raft_consensus.cc:2243] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.919066 14293 raft_consensus.cc:2272] T f91e9b24450f4bc88be5be6228d8587f P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.922349 14293 tablet_replica.cc:333] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.923615 14293 raft_consensus.cc:2243] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.928550 14293 raft_consensus.cc:2272] T 75927b236d9342309d9e8c7a6a9b2f95 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.931559 14293 tablet_replica.cc:333] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.932328 14293 raft_consensus.cc:2243] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.933046 14293 raft_consensus.cc:2272] T f87e12456fed4de1b2d723da6cc14d3a P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.936033 14293 tablet_replica.cc:333] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.936830 14293 raft_consensus.cc:2243] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.937506 14293 raft_consensus.cc:2272] T 496a555ec7cc49798fc4d775f6d151ed P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.940527 14293 tablet_replica.cc:333] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.946030 22621 tablet_copy_client.cc:806] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:42.946892 22621 tablet_copy_client.cc:670] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:42.952801 22621 tablet_copy_client.cc:538] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:42.941269 14293 raft_consensus.cc:2243] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.955879 14293 raft_consensus.cc:2272] T 653fb1b09eaf49f98c8993fbea783b3d P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.965067 14293 tablet_replica.cc:333] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.965888 14293 raft_consensus.cc:2243] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.967203 14293 raft_consensus.cc:2272] T 46abb05486504a60be4a4d104d3295f7 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.970420 14293 tablet_replica.cc:333] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83: stopping tablet replica
I20260709 13:07:42.971177 14293 raft_consensus.cc:2243] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.971885 14293 raft_consensus.cc:2272] T 8e5602b415c44c2486bba85d5cbf2ec5 P 5ccb2e30f44f40c2b22339e1d4c74a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.990815 22621 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:42.996968 22566 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:42.997709 22566 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.000056 22566 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:43.002120 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:43.010735 15482 leader_election.cc:336] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.011250 15482 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:43.024621 22566 raft_consensus.cc:2749] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:43.107743 22624 ts_tablet_manager.cc:933] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:43.122565 22624 tablet_copy_client.cc:323] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.67:37005
I20260709 13:07:43.131300 15602 tablet_copy_service.cc:140] P d225833a2cbf4a5995fdbbb1292d1918: Received BeginTabletCopySession request for tablet a2e2091b55004aafb70a88703ef6fbfc from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:51310)
I20260709 13:07:43.132047 15602 tablet_copy_service.cc:161] P d225833a2cbf4a5995fdbbb1292d1918: Beginning new tablet copy session on tablet a2e2091b55004aafb70a88703ef6fbfc from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:51310: session id = 6ff41728dec842afad5b53c20446a5a0-a2e2091b55004aafb70a88703ef6fbfc
I20260709 13:07:43.150399 15602 tablet_copy_source_session.cc:215] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:43.163443 22624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e2091b55004aafb70a88703ef6fbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:43.201628 22621 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=3 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.224650 22621 tablet_bootstrap.cc:492] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:43.225596 22621 ts_tablet_manager.cc:1403] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.235s	user 0.035s	sys 0.011s
I20260709 13:07:43.245175 22621 raft_consensus.cc:359] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:43.246181 22621 raft_consensus.cc:740] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:43.246990 22621 consensus_queue.cc:260] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:43.262487 22621 ts_tablet_manager.cc:1434] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:07:43.267117 15527 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-423df90a9f55438bbe1c32ab906c6e10 received from {username='slave'} at 127.0.0.1:34302
I20260709 13:07:43.267700 15527 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-423df90a9f55438bbe1c32ab906c6e10 on tablet 423df90a9f55438bbe1c32ab906c6e10 with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:43.273666 22601 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.274360 22601 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.276820 22601 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:43.285238 15556 leader_election.cc:336] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.271934 22614 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.286314 22614 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.288492 22614 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:43.298625 22621 ts_tablet_manager.cc:933] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:43.301199 15556 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.303158 16179 raft_consensus.cc:1217] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:07:43.325383 22624 tablet_copy_client.cc:806] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:43.326220 22614 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.326853 22614 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.329340 22614 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:43.333406 15556 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.334869 22624 tablet_copy_client.cc:670] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:43.340327 22624 tablet_copy_client.cc:538] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:43.377664 22624 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:43.386788 22591 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.387465 22591 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.390514 22591 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:43.421521 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:43.422298 15583 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:43.432286 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:43.435578 22591 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:43.436075 22591 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.436475 22591 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:43.458199 22591 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.468120 22598 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.478456 22598 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:43.480077 22591 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:43.481567 22598 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:43.476048 15482 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:43.491735 15482 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.482167 22591 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.492690 22591 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:43.503309 15482 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.508802 22591 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:43.540370 22591 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.541124 22591 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:43.547158 15482 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.548625 22591 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:43.559857 22598 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.560737 22598 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:43.563482 22598 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:43.603132 22591 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.603888 22591 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.606783 22591 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:43.611340 15482 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:43.634469 15482 consensus_peers.cc:597] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.637048 22591 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.637882 22591 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:43.646206 15482 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.648854 22591 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:43.652123 22469 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.652818 22469 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.655287 22469 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:43.660836 15482 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.678525 22598 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.679306 22598 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:43.683640 22598 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:43.734681 15482 consensus_peers.cc:597] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
==================
WARNING: ThreadSanitizer: data race (pid=14293)
  Write of size 4 at 0x7b40001304d8 by main thread:
    #0 kudu::DiagnosticSocket::Close() /apache/dev/git/kudu/src/kudu/util/net/diagnostic_socket.cc:96:7 (libkudu_util.so+0x49fe03)
    #1 kudu::rpc::AcceptorPool::Shutdown() /apache/dev/git/kudu/src/kudu/rpc/acceptor_pool.cc:212:3 (libkrpc.so+0x12ad33)
    #2 kudu::rpc::Messenger::ShutdownInternal(kudu::rpc::Messenger::ShutdownMode) /apache/dev/git/kudu/src/kudu/rpc/messenger.cc:239:8 (libkrpc.so+0x16d257)
    #3 kudu::rpc::Messenger::Shutdown() /apache/dev/git/kudu/src/kudu/rpc/messenger.cc:206:3 (libkrpc.so+0x16d80b)
    #4 kudu::kserver::KuduServer::Shutdown() /apache/dev/git/kudu/src/kudu/kserver/kserver.cc:192:17 (libkserver.so+0x13865)
    #5 kudu::tserver::TabletServer::ShutdownImpl() /apache/dev/git/kudu/src/kudu/tserver/tablet_server.cc:195:17 (libtserver.so+0x25c2ca)
    #6 kudu::tserver::TabletServer::Shutdown() /apache/dev/git/kudu/src/kudu/tserver/tablet_server.h:67:5 (libtserver.so+0x261a79)
    #7 kudu::tserver::MiniTabletServer::Shutdown() /apache/dev/git/kudu/src/kudu/tserver/mini_tablet_server.cc:124:14 (libtserver.so+0x31c692)
    #8 kudu::cluster::InternalMiniCluster::ShutdownNodes(kudu::cluster::ClusterNodes) /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:242:22 (libmini_cluster.so+0xd7a87)
    #9 kudu::cluster::MiniCluster::Shutdown() /apache/dev/git/kudu/src/kudu/mini-cluster/mini_cluster.h:84:5 (auto_leader_rebalancer-test+0x37c6a4)
    #10 kudu::master::LeaderRebalancerTest::TearDown() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:116:17 (auto_leader_rebalancer-test+0x368432)
    #11 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e0f)
    #12 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e0f)
    #13 testing::Test::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2682:3 (libgtest.so.1.12.1+0x42a82)
    #14 testing::TestInfo::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43d28)
    #15 testing::TestSuite::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d04)
    #16 testing::internal::UnitTestImpl::RunAllTests() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x597f4)
    #17 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65ccf)
    #18 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65ccf)
    #19 testing::UnitTest::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58dac)
    #20 RUN_ALL_TESTS() /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x38f0bb)
    #21 main /apache/dev/git/kudu/src/kudu/util/test_main.cc:115:10 (auto_leader_rebalancer-test+0x38dcbc)

  Previous read of size 4 at 0x7b40001304d8 by thread T264 (mutexes: write M571529580092768176):
    #0 kudu::DiagnosticSocket::ReceiveResponse(std::__1::vector<kudu::DiagnosticSocket::TcpSocketInfo, std::__1::allocator<kudu::DiagnosticSocket::TcpSocketInfo> >*) const /apache/dev/git/kudu/src/kudu/util/net/diagnostic_socket.cc:264:3 (libkudu_util.so+0x4a08e1)
    #1 kudu::DiagnosticSocket::Query(kudu::Socket const&, kudu::DiagnosticSocket::TcpSocketInfo*) const /apache/dev/git/kudu/src/kudu/util/net/diagnostic_socket.cc:134:3 (libkudu_util.so+0x4a1274)
    #2 kudu::rpc::AcceptorPool::GetPendingConnectionsNum(unsigned int*) const /apache/dev/git/kudu/src/kudu/rpc/acceptor_pool.cc:241:3 (libkrpc.so+0x12b653)
    #3 kudu::rpc::Messenger::GetPendingConnectionsNum() /apache/dev/git/kudu/src/kudu/rpc/messenger.cc:193:21 (libkrpc.so+0x16d4b1)
    #4 kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1::operator()() const /apache/dev/git/kudu/src/kudu/rpc/messenger.cc:299:51 (libkrpc.so+0x171bb1)
    #5 decltype(std::__1::forward<kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1&>(fp)()) std::__1::__invoke<kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1&>(kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1&) /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/type_traits:3905:1 (libkrpc.so+0x171b69)
    #6 int std::__1::__invoke_void_return_wrapper<int>::__call<kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1&>(kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1&) /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/__functional_base:317:16 (libkrpc.so+0x171af9)
    #7 std::__1::__function::__alloc_func<kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1, std::__1::allocator<kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1>, int ()>::operator()() /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:1557:16 (libkrpc.so+0x171ab1)
    #8 std::__1::__function::__func<kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1, std::__1::allocator<kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*)::$_1>, int ()>::operator()() /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:1731:12 (libkrpc.so+0x170dad)
    #9 std::__1::__function::__value_func<int ()>::operator()() const /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:1884:16 (libmaster.so+0x4d3c74)
    #10 std::__1::function<int ()>::operator()() const /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:2556:12 (libmaster.so+0x4d3c19)
    #11 kudu::FunctionGauge<int>::value() const /apache/dev/git/kudu/src/kudu/util/metrics.h:1319:12 (libmaster.so+0x4d3b4a)
    #12 kudu::FunctionGauge<int>::WriteValue(kudu::JsonWriter*) const /apache/dev/git/kudu/src/kudu/util/metrics.h:1323:19 (libmaster.so+0x4d3830)
    #13 kudu::Gauge::WriteAsJson(kudu::JsonWriter*, kudu::MetricJsonOptions const&) const /apache/dev/git/kudu/src/kudu/util/metrics.cc:856:3 (libkudu_util.so+0x380112)
    #14 void kudu::WriteMetricsToJson<std::__1::unordered_map<kudu::MetricPrototype const*, scoped_refptr<kudu::Metric>, std::__1::hash<kudu::MetricPrototype const*>, std::__1::equal_to<kudu::MetricPrototype const*>, std::__1::allocator<std::__1::pair<kudu::MetricPrototype const* const, scoped_refptr<kudu::Metric> > > > >(kudu::JsonWriter*, std::__1::unordered_map<kudu::MetricPrototype const*, scoped_refptr<kudu::Metric>, std::__1::hash<kudu::MetricPrototype const*>, std::__1::equal_to<kudu::MetricPrototype const*>, std::__1::allocator<std::__1::pair<kudu::MetricPrototype const* const, scoped_refptr<kudu::Metric> > > > const&, kudu::MetricJsonOptions const&) /apache/dev/git/kudu/src/kudu/util/metrics.cc:79:7 (libkudu_util.so+0x3851d0)
    #15 kudu::MetricEntity::WriteAsJson(kudu::JsonWriter*, kudu::MetricJsonOptions const&) const /apache/dev/git/kudu/src/kudu/util/metrics.cc:414:3 (libkudu_util.so+0x37d847)
    #16 kudu::MetricRegistry::WriteAsJson(kudu::JsonWriter*, kudu::MetricJsonOptions const&) const /apache/dev/git/kudu/src/kudu/util/metrics.cc:586:7 (libkudu_util.so+0x37eacc)
    #17 kudu::server::DiagnosticsLog::LogMetrics() /apache/dev/git/kudu/src/kudu/server/diagnostics_log.cc:348:3 (libserver_process.so+0x11db17)
    #18 kudu::server::DiagnosticsLog::RunThread() /apache/dev/git/kudu/src/kudu/server/diagnostics_log.cc:228:7 (libserver_process.so+0x11d7f6)
    #19 kudu::server::DiagnosticsLog::Start()::$_0::operator()() const /apache/dev/git/kudu/src/kudu/server/diagnostics_log.cc:145:46 (libserver_process.so+0x11f381)
    #20 decltype(std::__1::forward<kudu::server::DiagnosticsLog::Start()::$_0&>(fp)()) std::__1::__invoke<kudu::server::DiagnosticsLog::Start()::$_0&>(kudu::server::DiagnosticsLog::Start()::$_0&) /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/type_traits:3905:1 (libserver_process.so+0x11f339)
    #21 void std::__1::__invoke_void_return_wrapper<void>::__call<kudu::server::DiagnosticsLog::Start()::$_0&>(kudu::server::DiagnosticsLog::Start()::$_0&) /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/__functional_base:348:9 (libserver_process.so+0x11f2c9)
    #22 std::__1::__function::__alloc_func<kudu::server::DiagnosticsLog::Start()::$_0, std::__1::allocator<kudu::server::DiagnosticsLog::Start()::$_0>, void ()>::operator()() /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:1557:16 (libserver_process.so+0x11f291)
    #23 std::__1::__function::__func<kudu::server::DiagnosticsLog::Start()::$_0, std::__1::allocator<kudu::server::DiagnosticsLog::Start()::$_0>, void ()>::operator()() /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:1731:12 (libserver_process.so+0x11e58d)
    #24 std::__1::__function::__value_func<void ()>::operator()() const /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:1884:16 (auto_leader_rebalancer-test+0x38f354)
    #25 std::__1::function<void ()>::operator()() const /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:2556:12 (auto_leader_rebalancer-test+0x38f199)
    #26 kudu::Thread::SuperviseThread(void*) /apache/dev/git/kudu/src/kudu/util/thread.cc:694:3 (libkudu_util.so+0x40e83a)

  Location is heap block of size 248 at 0x7b4000130400 allocated by main thread:
    #0 operator new(unsigned long) /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_new_delete.cpp:64 (auto_leader_rebalancer-test+0x357897)
    #1 std::__1::__libcpp_allocate(unsigned long, unsigned long) /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/new:253:10 (libkrpc.so+0x130946)
    #2 std::__1::allocator<std::__1::__shared_ptr_emplace<kudu::rpc::AcceptorPool, std::__1::allocator<kudu::rpc::AcceptorPool> > >::allocate(unsigned long) /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1789:34 (libkrpc.so+0x17a5e1)
    #3 std::__1::enable_if<!(is_array<kudu::rpc::AcceptorPool>::value), std::__1::shared_ptr<kudu::rpc::AcceptorPool> >::type std::__1::make_shared<kudu::rpc::AcceptorPool, kudu::rpc::Messenger*, kudu::Socket*, kudu::Sockaddr&, int const&>(kudu::rpc::Messenger*&&, kudu::Socket*&&, kudu::Sockaddr&, int const&) /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/memory:4290:45 (libkrpc.so+0x172a25)
    #4 kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*) /apache/dev/git/kudu/src/kudu/rpc/messenger.cc:288:34 (libkrpc.so+0x16da89)
    #5 kudu::RpcServer::Bind() /apache/dev/git/kudu/src/kudu/server/rpc_server.cc:262:5 (libserver_process.so+0x1393fb)
    #6 kudu::server::ServerBase::Init() /apache/dev/git/kudu/src/kudu/server/server_base.cc:1030:23 (libserver_process.so+0x149419)
    #7 kudu::kserver::KuduServer::Init() /apache/dev/git/kudu/src/kudu/kserver/kserver.cc:144:3 (libkserver.so+0x12e81)
    #8 kudu::tserver::TabletServer::Init() /apache/dev/git/kudu/src/kudu/tserver/tablet_server.cc:107:3 (libtserver.so+0x25c752)
    #9 kudu::tserver::MiniTabletServer::Start() /apache/dev/git/kudu/src/kudu/tserver/mini_tablet_server.cc:106:3 (libtserver.so+0x31c79b)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd7889)
    #11 kudu::cluster::InternalMiniCluster::AddTabletServer() /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd73a5)
    #12 kudu::cluster::InternalMiniCluster::Start() /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd663a)
    #13 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:104:22 (auto_leader_rebalancer-test+0x36536c)
    #14 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:376:3 (auto_leader_rebalancer-test+0x359dff)
    #15 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e0f)
    #16 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e0f)
    #17 testing::Test::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a11)
    #18 testing::TestInfo::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43d28)
    #19 testing::TestSuite::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d04)
    #20 testing::internal::UnitTestImpl::RunAllTests() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x597f4)
    #21 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65ccf)
    #22 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65ccf)
    #23 testing::UnitTest::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58dac)
    #24 RUN_ALL_TESTS() /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x38f0bb)
    #25 main /apache/dev/git/kudu/src/kudu/util/test_main.cc:115:10 (auto_leader_rebalancer-test+0x38dcbc)

  Mutex M571529580092768176 is already destroyed.

  Thread T264 'diag-logger-154' (tid=15464, running) created by main thread at:
    #0 pthread_create /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:966 (auto_leader_rebalancer-test+0x2dbea5)
    #1 kudu::Thread::StartThread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, unsigned long, scoped_refptr<kudu::Thread>*) /apache/dev/git/kudu/src/kudu/util/thread.cc:643:15 (libkudu_util.so+0x40e0d8)
    #2 kudu::Thread::Create(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, scoped_refptr<kudu::Thread>*) /apache/dev/git/kudu/src/kudu/util/thread.h:147:12 (libmaster.so+0x2e2ab9)
    #3 kudu::server::DiagnosticsLog::Start() /apache/dev/git/kudu/src/kudu/server/diagnostics_log.cc:144:14 (libserver_process.so+0x11d27d)
    #4 kudu::server::ServerBase::StartMetricsLogging() /apache/dev/git/kudu/src/kudu/server/server_base.cc:1212:3 (libserver_process.so+0x14b6c4)
    #5 kudu::server::ServerBase::Start() /apache/dev/git/kudu/src/kudu/server/server_base.cc:1352:3 (libserver_process.so+0x14bf64)
    #6 kudu::kserver::KuduServer::Start() /apache/dev/git/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13810)
    #7 kudu::tserver::TabletServer::Start() /apache/dev/git/kudu/src/kudu/tserver/tablet_server.cc:161:3 (libtserver.so+0x25cf97)
    #8 kudu::tserver::MiniTabletServer::Start() /apache/dev/git/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x31c7d9)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd7889)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer() /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd73a5)
    #11 kudu::cluster::InternalMiniCluster::Start() /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd663a)
    #12 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:104:22 (auto_leader_rebalancer-test+0x36536c)
    #13 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:376:3 (auto_leader_rebalancer-test+0x359dff)
    #14 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e0f)
    #15 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e0f)
    #16 testing::Test::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a11)
    #17 testing::TestInfo::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43d28)
    #18 testing::TestSuite::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d04)
    #19 testing::internal::UnitTestImpl::RunAllTests() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x597f4)
    #20 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65ccf)
    #21 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65ccf)
    #22 testing::UnitTest::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58dac)
    #23 RUN_ALL_TESTS() /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x38f0bb)
    #24 main /apache/dev/git/kudu/src/kudu/util/test_main.cc:115:10 (auto_leader_rebalancer-test+0x38dcbc)

SUMMARY: ThreadSanitizer: data race /apache/dev/git/kudu/src/kudu/util/net/diagnostic_socket.cc:96:7 in kudu::DiagnosticSocket::Close()
==================
==================
W20260709 13:07:43.795982 15482 consensus_peers.cc:597] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
WARNING: ThreadSanitizer: data race (pid=14293)
  Write of size 8 at 0x7ba0000004b0 by main thread:
    #0 close /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1679 (auto_leader_rebalancer-test+0x30aa53)
    #1 kudu::DiagnosticSocket::Close() /apache/dev/git/kudu/src/kudu/util/net/diagnostic_socket.cc:99:7 (libkudu_util.so+0x49fe1a)
    #2 kudu::rpc::AcceptorPool::Shutdown() /apache/dev/git/kudu/src/kudu/rpc/acceptor_pool.cc:212:3 (libkrpc.so+0x12ad33)
    #3 kudu::rpc::Messenger::ShutdownInternal(kudu::rpc::Messenger::ShutdownMode) /apache/dev/git/kudu/src/kudu/rpc/messenger.cc:239:8 (libkrpc.so+0x16d257)
    #4 kudu::rpc::Messenger::Shutdown() /apache/dev/git/kudu/src/kudu/rpc/messenger.cc:206:3 (libkrpc.so+0x16d80b)
    #5 kudu::kserver::KuduServer::Shutdown() /apache/dev/git/kudu/src/kudu/kserver/kserver.cc:192:17 (libkserver.so+0x13865)
    #6 kudu::tserver::TabletServer::ShutdownImpl() /apache/dev/git/kudu/src/kudu/tserver/tablet_server.cc:195:17 (libtserver.so+0x25c2ca)
    #7 kudu::tserver::TabletServer::Shutdown() /apache/dev/git/kudu/src/kudu/tserver/tablet_server.h:67:5 (libtserver.so+0x261a79)
    #8 kudu::tserver::MiniTabletServer::Shutdown() /apache/dev/git/kudu/src/kudu/tserver/mini_tablet_server.cc:124:14 (libtserver.so+0x31c692)
    #9 kudu::cluster::InternalMiniCluster::ShutdownNodes(kudu::cluster::ClusterNodes) /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:242:22 (libmini_cluster.so+0xd7a87)
    #10 kudu::cluster::MiniCluster::Shutdown() /apache/dev/git/kudu/src/kudu/mini-cluster/mini_cluster.h:84:5 (auto_leader_rebalancer-test+0x37c6a4)
    #11 kudu::master::LeaderRebalancerTest::TearDown() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:116:17 (auto_leader_rebalancer-test+0x368432)
    #12 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e0f)
    #13 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e0f)
    #14 testing::Test::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2682:3 (libgtest.so.1.12.1+0x42a82)
    #15 testing::TestInfo::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43d28)
    #16 testing::TestSuite::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d04)
    #17 testing::internal::UnitTestImpl::RunAllTests() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x597f4)
    #18 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65ccf)
    #19 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65ccf)
    #20 testing::UnitTest::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58dac)
    #21 RUN_ALL_TESTS() /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x38f0bb)
    #22 main /apache/dev/git/kudu/src/kudu/util/test_main.cc:115:10 (auto_leader_rebalancer-test+0x38dcbc)

  Previous read of size 8 at 0x7ba0000004b0 by thread T264:
    [failed to restore the stack]

  Location is file descriptor 75 created by main thread at:
    #0 socket /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1638 (auto_leader_rebalancer-test+0x30d7af)
    #1 kudu::DiagnosticSocket::Init() /apache/dev/git/kudu/src/kudu/util/net/diagnostic_socket.cc:80:13 (libkudu_util.so+0x49ff2f)
    #2 kudu::rpc::AcceptorPool::Start(int) /apache/dev/git/kudu/src/kudu/rpc/acceptor_pool.cc:167:3 (libkrpc.so+0x12b265)
    #3 kudu::RpcServer::Start() /apache/dev/git/kudu/src/kudu/server/rpc_server.cc:297:5 (libserver_process.so+0x1398d9)
    #4 kudu::server::ServerBase::Start() /apache/dev/git/kudu/src/kudu/server/server_base.cc:1361:3 (libserver_process.so+0x14bff5)
    #5 kudu::kserver::KuduServer::Start() /apache/dev/git/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13810)
    #6 kudu::tserver::TabletServer::Start() /apache/dev/git/kudu/src/kudu/tserver/tablet_server.cc:161:3 (libtserver.so+0x25cf97)
    #7 kudu::tserver::MiniTabletServer::Start() /apache/dev/git/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x31c7d9)
    #8 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd7889)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer() /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd73a5)
    #10 kudu::cluster::InternalMiniCluster::Start() /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd663a)
    #11 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:104:22 (auto_leader_rebalancer-test+0x36536c)
    #12 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:376:3 (auto_leader_rebalancer-test+0x359dff)
    #13 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e0f)
    #14 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e0f)
    #15 testing::Test::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a11)
    #16 testing::TestInfo::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43d28)
    #17 testing::TestSuite::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d04)
    #18 testing::internal::UnitTestImpl::RunAllTests() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x597f4)
    #19 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65ccf)
    #20 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65ccf)
    #21 testing::UnitTest::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58dac)
    #22 RUN_ALL_TESTS() /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x38f0bb)
    #23 main /apache/dev/git/kudu/src/kudu/util/test_main.cc:115:10 (auto_leader_rebalancer-test+0x38dcbc)

  Thread T264 'diag-logger-154' (tid=15464, running) created by main thread at:
    #0 pthread_create /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:966 (auto_leader_rebalancer-test+0x2dbea5)
    #1 kudu::Thread::StartThread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, unsigned long, scoped_refptr<kudu::Thread>*) /apache/dev/git/kudu/src/kudu/util/thread.cc:643:15 (libkudu_util.so+0x40e0d8)
I20260709 13:07:43.805918 22469 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
    #2 kudu::Thread::Create(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, scoped_refptr<kudu::Thread>*) /apache/dev/git/kudu/src/kudu/util/thread.h:147:12 (libmaster.so+0x2e2ab9)
    #3 kudu::server::DiagnosticsLog::Start() /apache/dev/git/kudu/src/kudu/server/diagnostics_log.cc:144:14 (libserver_process.so+0x11d27d)
    #4 kudu::server::ServerBase::StartMetricsLogging() /apache/dev/git/kudu/src/kudu/server/server_base.cc:1212:3 (libserver_process.so+0x14b6c4)
    #5 kudu::server::ServerBase::Start() /apache/dev/git/kudu/src/kudu/server/server_base.cc:1352:3 (libserver_process.so+0x14bf64)
    #6 kudu::kserver::KuduServer::Start() /apache/dev/git/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13810)
    #7 kudu::tserver::TabletServer::Start() /apache/dev/git/kudu/src/kudu/tserver/tablet_server.cc:161:3 (libtserver.so+0x25cf97)
    #8 kudu::tserver::MiniTabletServer::Start() /apache/dev/git/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x31c7d9)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd7889)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer() /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd73a5)
    #11 kudu::cluster::InternalMiniCluster::Start() /apache/dev/git/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd663a)
    #12 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:104:22 (auto_leader_rebalancer-test+0x36536c)
    #13 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:376:3 (auto_leader_rebalancer-test+0x359dff)
    #14 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e0f)
    #15 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e0f)
    #16 testing::Test::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a11)
    #17 testing::TestInfo::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43d28)
    #18 testing::TestSuite::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d04)
    #19 testing::internal::UnitTestImpl::RunAllTests() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x597f4)
    #20 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65ccf)
    #21 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65ccf)
    #22 testing::UnitTest::Run() /apache/dev/git/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58dac)
    #23 RUN_ALL_TESTS() /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x38f0bb)
    #24 main /apache/dev/git/kudu/src/kudu/util/test_main.cc:115:10 (auto_leader_rebalancer-test+0x38dcbc)

SUMMARY: ThreadSanitizer: data race /apache/dev/git/kudu/src/kudu/util/net/diagnostic_socket.cc:99:7 in kudu::DiagnosticSocket::Close()
==================
I20260709 13:07:43.806608 22469 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:43.809295 22469 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:43.862795 22629 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.867189 22629 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:43.869246 15555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.002s	sys 0.000s
I20260709 13:07:43.869647 22629 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:43.846890 22621 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.017s
W20260709 13:07:43.869681 15555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.002s	sys 0.000s
W20260709 13:07:43.879348 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 604675us
W20260709 13:07:43.874035 22621 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.012s	sys 0.017s
I20260709 13:07:43.880888 22621 tablet_copy_client.cc:323] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Beginning tablet copy session from remote peer at address 127.13.245.66:34291
I20260709 13:07:43.883077 15527 tablet_copy_service.cc:140] P 8a55534dc8864943937d5b6ec0e6aaf9: Received BeginTabletCopySession request for tablet 07d5db06e4ec455f8b7755416957114a from peer 6ff41728dec842afad5b53c20446a5a0 ({username='slave'} at 127.0.0.1:34302)
I20260709 13:07:43.883716 15527 tablet_copy_service.cc:161] P 8a55534dc8864943937d5b6ec0e6aaf9: Beginning new tablet copy session on tablet 07d5db06e4ec455f8b7755416957114a from peer 6ff41728dec842afad5b53c20446a5a0 at {username='slave'} at 127.0.0.1:34302: session id = 6ff41728dec842afad5b53c20446a5a0-07d5db06e4ec455f8b7755416957114a
I20260709 13:07:43.885696 22629 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.886363 22629 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.889407 22629 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:43.889904 22629 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.890429 22629 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:43.895707 22629 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:43.908743 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:43.909600 15513 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:43.913897 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:43.914968 15516 raft_consensus.cc:2393] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 21: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:07:43.911464 16146 connection.cc:769] client connection to 127.13.245.65:36757 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:07:43.915982 15556 connection.cc:769] client connection to 127.13.245.65:36757 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:07:43.918393 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:43.919382 15514 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 20.
I20260709 13:07:43.922792 15527 tablet_copy_source_session.cc:215] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:43.949977 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d5db06e4ec455f8b7755416957114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:43.924075 22601 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:43.981151 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:43.981288 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567ba2de2d424a60ae555fb26b4de59b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:43.982167 15583 raft_consensus.cc:3060] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:43.981969 15586 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 14.
W20260709 13:07:43.985822 15482 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.009224 22639 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.010054 22639 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.015817 15585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.016383 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.017287 15589 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
I20260709 13:07:44.020504 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.016639 15585 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:07:44.023517 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.024286 15587 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 19.
I20260709 13:07:43.969542 22636 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.028801 22636 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:43.997485 22633 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.036291 22633 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:44.035598 15482 consensus_peers.cc:597] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.037726 15482 consensus_peers.cc:597] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.038311 15482 consensus_peers.cc:597] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.041183 15482 consensus_peers.cc:597] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.967168 22601 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.038718 22633 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:44.041936 15482 consensus_peers.cc:597] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.031265 22636 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:44.067236 15588 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 22.
I20260709 13:07:44.068926 22601 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:44.072903 22566 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.073732 22566 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.076290 22566 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.077299 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.078999 22633 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.079669 22633 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.080467 22591 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:44.080909 22591 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.081279 22591 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.082048 22633 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:44.089883 22591 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.091964 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.099001 22639 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:44.108856 22469 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:44.108953 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.109423 22469 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.109783 22469 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:44.111572 22566 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:44.112082 22566 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.112577 22566 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.121688 22633 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.128342 22633 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.130666 22633 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:44.137856 22621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52910 (request call id 777) took 1014 ms. Trace:
I20260709 13:07:44.138373 22621 rpcz_store.cc:276] 0709 13:07:43.123001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.123135 (+   134us) service_pool.cc:224] Handling call
0709 13:07:43.299050 (+175915us) ts_tablet_manager.cc:934] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: Initiating tablet copy from peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
0709 13:07:43.946043 (+646993us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:44.083559 (+137516us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:44.083736 (+   177us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:44.137052 (+ 53316us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:44.137368 (+   316us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:44.137686 (+   318us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:44.137745 (+    59us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":260,"tablet-copy.queue_time_us":174952,"thread_start_us":598571,"threads_started":2}
I20260709 13:07:44.148358 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.148980 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:44.148056 15556 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.149642 15589 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:44.149025 15588 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 18.
I20260709 13:07:44.151723 22591 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.155227 22469 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.161149 15583 raft_consensus.cc:2468] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 21.
I20260709 13:07:44.154582 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:07:44.167882 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 59005.3us
I20260709 13:07:44.171317 22469 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.172134 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.172482 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:44.172906 15588 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 17.
I20260709 13:07:44.173924 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.176633 22601 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:44.174283 22633 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:44.191154 22639 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:44.193483 22639 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.193974 22639 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:44.190734 22633 raft_consensus.cc:493] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.194710 22633 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:44.199823 22621 tablet_copy_client.cc:806] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:44.189394 22644 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.195601 22566 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.202723 22566 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.200807 22644 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.209472 22644 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:44.212586 22639 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.217347 22630 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.218010 22630 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.220582 22630 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.221916 22630 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.222532 22630 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.224754 22639 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:44.225579 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 55508us
I20260709 13:07:44.224926 22630 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.226506 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.200839 22621 tablet_copy_client.cc:670] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:44.227489 22469 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:44.228034 22469 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.228489 22469 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.235460 22621 tablet_copy_client.cc:538] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:44.236955 22566 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.237605 22566 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.237887 22469 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.239955 22566 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.241158 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.243048 15482 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.243683 22566 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:44.244521 22566 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.245023 22566 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:44.251119 22624 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.251945 22647 raft_consensus.cc:2804] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:44.252610 22647 raft_consensus.cc:697] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:44.255206 22647 consensus_queue.cc:237] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:44.263944 15482 consensus_peers.cc:597] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.266561 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.267244 15583 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 10.
I20260709 13:07:44.268026 22469 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.270556 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.271144 15583 raft_consensus.cc:3060] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.274605 22621 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap starting.
I20260709 13:07:44.280862 22624 tablet_bootstrap.cc:492] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:44.281842 22624 ts_tablet_manager.cc:1403] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.905s	user 0.044s	sys 0.026s
I20260709 13:07:44.284548 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:44.285056 16146 leader_election.cc:336] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.285256 16179 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 17.
I20260709 13:07:44.285307 22624 raft_consensus.cc:359] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:44.286295 22624 raft_consensus.cc:740] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:44.292809 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.293478 15588 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 15.
I20260709 13:07:44.293756 15583 raft_consensus.cc:2468] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 15.
I20260709 13:07:44.296977 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.300412 15583 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 19.
I20260709 13:07:44.258597 22633 raft_consensus.cc:515] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.305604 22633 leader_election.cc:290] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:44.316756 16146 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.319190 22599 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.319787 22599 raft_consensus.cc:493] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.320326 22599 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.329761 22599 raft_consensus.cc:515] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.333742 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.334975 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.335645 15588 raft_consensus.cc:3060] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.336040 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.337721 22469 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.338315 22469 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.340390 22469 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.343457 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82533161d7894b3db9b0230e076936b2" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:44.343739 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9178296553b44a3f82267d1278be3746" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:44.344354 15516 raft_consensus.cc:2393] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 13: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:44.344652 15514 raft_consensus.cc:2393] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 15: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:44.345964 15588 raft_consensus.cc:2468] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 13.
I20260709 13:07:44.346488 15583 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 21: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:44.348394 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.350222 22646 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:44.350629 22646 raft_consensus.cc:493] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.350996 22646 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.356766 16146 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.357848 22630 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:44.333091 22599 leader_election.cc:290] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.358289 22630 raft_consensus.cc:493] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.357987 16146 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.358786 22630 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.359817 22598 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:44.360205 22598 raft_consensus.cc:493] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.360587 22598 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:44.366246 22566 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.368789 22598 raft_consensus.cc:515] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.370836 22646 raft_consensus.cc:515] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.371243 22633 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.380244 22633 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.382427 22633 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:44.384351 22646 leader_election.cc:290] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.373848 22598 leader_election.cc:290] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.376194 16146 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.367161 22630 raft_consensus.cc:515] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.387220 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:44.388018 16179 raft_consensus.cc:2393] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 18: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:44.388427 22630 leader_election.cc:290] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.388914 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:44.389784 15514 raft_consensus.cc:2393] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 23: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:44.390059 22598 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:44.390620 22598 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.391136 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:44.391052 15341 catalog_manager.cc:5697] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 20 to 21, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 21 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.391964 15514 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:44.392767 22598 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.394891 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:44.286985 22624 consensus_queue.cc:260] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:44.395702 15514 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 10.
I20260709 13:07:44.389070 22630 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:44.397293 22630 raft_consensus.cc:493] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.408008 22630 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.398922 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:44.404158 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.404609 16175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
W20260709 13:07:44.409834 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.406005 22566 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 23 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.406759 16178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:44.407253 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:44.414206 15514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:44.414848 16179 raft_consensus.cc:2393] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:44.414948 15514 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:44.407343 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:44.416144 16174 raft_consensus.cc:2393] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 16: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:44.398068 22624 ts_tablet_manager.cc:1434] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
I20260709 13:07:44.408736 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc8a91586140ab8a3903619efbd8c9" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
W20260709 13:07:44.410389 16146 leader_election.cc:336] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.410995 15516 raft_consensus.cc:2393] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 21: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:44.418721 15513 raft_consensus.cc:3060] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:44.411252 16175 raft_consensus.cc:2393] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 19: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:07:44.424015 16146 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.424814 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.413468 15583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdfe2cf7f6141b9b4378a2f1f915fc5" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:07:44.425343 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.425410 15583 raft_consensus.cc:3060] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.436226 15583 raft_consensus.cc:2468] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 20.
W20260709 13:07:44.417949 15556 leader_election.cc:336] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.437321 15556 leader_election.cc:336] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.437458 15513 raft_consensus.cc:2468] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
W20260709 13:07:44.437880 15556 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.438390 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.439559 15556 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.440482 15556 leader_election.cc:336] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.443401 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.444047 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.444634 15556 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.445184 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.445672 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.447060 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.448086 15556 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.457293 15588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "562c25b8842b442a928630e10d13e618" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.479370 15588 raft_consensus.cc:3060] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.481084 22645 raft_consensus.cc:1064] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:44.481006 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:44.459899 15589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6411adf9842fc9281582ab8b1842c" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.483872 15589 raft_consensus.cc:3060] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:44.483742 22645 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.461596 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc152f2e639487986baac02b0324f06" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.487102 15586 raft_consensus.cc:3060] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.465145 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.465457 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8071c427f08433d8ffd6bd0809b1076" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.465921 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0fd3f0f29d4b4abb27cd04e5ce1113" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.465838 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c57ead024481e8882a1b97814f799" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
W20260709 13:07:44.488430 15556 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.488766 15592 raft_consensus.cc:3060] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.470373 15602 tablet_copy_service.cc:342] P d225833a2cbf4a5995fdbbb1292d1918: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-a2e2091b55004aafb70a88703ef6fbfc received from {username='slave'} at 127.0.0.1:51310
I20260709 13:07:44.483325 22601 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.488111 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:44.488246 15587 raft_consensus.cc:3060] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:44.489677 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.492465 16146 leader_election.cc:336] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.493137 16146 leader_election.cc:336] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.493341 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.488999 15556 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:44.488055 15591 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 16.
I20260709 13:07:44.496636 15589 raft_consensus.cc:2468] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
I20260709 13:07:44.498312 15602 tablet_copy_service.cc:434] P d225833a2cbf4a5995fdbbb1292d1918: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-a2e2091b55004aafb70a88703ef6fbfc on tablet a2e2091b55004aafb70a88703ef6fbfc with peer 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:44.498819 15586 raft_consensus.cc:2468] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 19.
I20260709 13:07:44.498960 22639 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.500612 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.502471 15556 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:44.502993 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.503755 22601 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.504186 22601 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.504556 22601 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.507807 22566 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:44.508239 22566 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.508584 22566 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.510504 15588 raft_consensus.cc:2468] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 17.
I20260709 13:07:44.513054 15592 raft_consensus.cc:2468] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 18.
I20260709 13:07:44.512494 22641 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:44.513056 15587 raft_consensus.cc:2468] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 23.
I20260709 13:07:44.514875 22641 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.515115 22639 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:44.515334 22641 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.518694 22644 raft_consensus.cc:2749] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:44.518951 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.527915 22469 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:44.528275 22469 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.528596 22469 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.530439 16146 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.530326 15482 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.533371 15556 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:44.536652 22591 raft_consensus.cc:2804] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:44.538686 22636 raft_consensus.cc:2749] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:44.540071 15556 leader_election.cc:304] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:44.540524 22598 raft_consensus.cc:2804] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:44.540838 22639 raft_consensus.cc:2749] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.541143 22598 raft_consensus.cc:697] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:44.542328 22598 consensus_queue.cc:237] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.533591 15482 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.534794 16146 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.547761 15556 leader_election.cc:304] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:44.547032 16146 leader_election.cc:304] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.550604 22638 raft_consensus.cc:2749] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:44.551708 15556 leader_election.cc:336] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.551290 16146 leader_election.cc:304] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.526875 22566 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:44.560623 15556 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.562491 15556 leader_election.cc:336] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.562562 22469 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.550653 22646 raft_consensus.cc:2804] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:44.580507 22655 raft_consensus.cc:2804] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:44.583665 22469 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.561451 22599 raft_consensus.cc:2804] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:44.561048 22591 raft_consensus.cc:697] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:07:44.622519 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 71299.5us
W20260709 13:07:44.627151 16146 leader_election.cc:336] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.631040 16146 leader_election.cc:336] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.631889 16146 leader_election.cc:336] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.632740 16146 leader_election.cc:336] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.628981 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 95470.1us
I20260709 13:07:44.613664 22646 raft_consensus.cc:697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 19 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
W20260709 13:07:44.633519 16146 leader_election.cc:336] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.616040 22655 raft_consensus.cc:697] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:44.636081 15482 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.620579 22599 raft_consensus.cc:697] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:44.636911 22469 raft_consensus.cc:2804] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:44.636375 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:44.640614 22649 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.639684 22621 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.641520 22469 raft_consensus.cc:697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
W20260709 13:07:44.643188 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.646646 22630 raft_consensus.cc:515] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.651877 22469 consensus_queue.cc:237] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.652978 22599 consensus_queue.cc:237] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.654246 22601 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.633991 22657 raft_consensus.cc:2804] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:44.657644 16178 raft_consensus.cc:2393] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 20: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
W20260709 13:07:44.660584 15556 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.661229 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.672456 22621 tablet_bootstrap.cc:492] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: Bootstrap complete.
I20260709 13:07:44.673633 22621 ts_tablet_manager.cc:1403] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: Time spent bootstrapping tablet: real 0.399s	user 0.044s	sys 0.011s
I20260709 13:07:44.676705 22657 raft_consensus.cc:697] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:44.678546 22646 consensus_queue.cc:237] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.645783 22591 consensus_queue.cc:237] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.694494 22630 leader_election.cc:290] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.683739 22621 raft_consensus.cc:359] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:07:44.699831 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.700050 22621 raft_consensus.cc:740] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Initialized, Role: LEARNER
I20260709 13:07:44.700958 22621 consensus_queue.cc:260] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
I20260709 13:07:44.680687 22566 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:44.716526 22657 consensus_queue.cc:237] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.719985 22601 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:44.678589 22655 consensus_queue.cc:237] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.703176 22641 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.734337 22641 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:44.737078 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.738399 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.742209 15556 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.749776 15556 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.763844 15339 catalog_manager.cc:5697] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 15 to 16, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 16 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.785420 22645 raft_consensus.cc:493] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:44.786180 22645 raft_consensus.cc:515] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.788833 22645 leader_election.cc:290] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.797009 22621 ts_tablet_manager.cc:1434] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: Time spent starting tablet: real 0.123s	user 0.009s	sys 0.000s
I20260709 13:07:44.799468 15527 tablet_copy_service.cc:342] P 8a55534dc8864943937d5b6ec0e6aaf9: Request end of tablet copy session 6ff41728dec842afad5b53c20446a5a0-07d5db06e4ec455f8b7755416957114a received from {username='slave'} at 127.0.0.1:34302
I20260709 13:07:44.800078 15527 tablet_copy_service.cc:434] P 8a55534dc8864943937d5b6ec0e6aaf9: ending tablet copy session 6ff41728dec842afad5b53c20446a5a0-07d5db06e4ec455f8b7755416957114a on tablet 07d5db06e4ec455f8b7755416957114a with peer 6ff41728dec842afad5b53c20446a5a0
W20260709 13:07:44.808446 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 170574us
I20260709 13:07:44.809617 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.814311 22656 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.815974 22656 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.816356 22656 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.817420 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff30e083feaf42a3aca56510e7fe367a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.818185 15587 raft_consensus.cc:3060] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.825049 15556 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 6ff41728dec842afad5b53c20446a5a0
I20260709 13:07:44.827962 15587 raft_consensus.cc:2468] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 20.
I20260709 13:07:44.823421 15482 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.830569 16146 leader_election.cc:304] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:44.833683 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.834679 22662 raft_consensus.cc:2749] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:44.835063 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:44.835480 22662 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:07:44.836303 16146 leader_election.cc:336] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.836799 22662 raft_consensus.cc:493] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ccb2e30f44f40c2b22339e1d4c74a83)
I20260709 13:07:44.838405 22662 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:44.838992 15482 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.839836 15482 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.836625 22641 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:07:44.840830 15482 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.835647 22657 raft_consensus.cc:2804] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:44.830920 22667 raft_consensus.cc:2804] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:44.842176 22657 raft_consensus.cc:697] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 20 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:44.842584 22667 raft_consensus.cc:697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:44.842176 15555 leader_election.cc:304] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:44.843240 22657 consensus_queue.cc:237] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:44.844041 22641 raft_consensus.cc:2804] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:44.843684 22667 consensus_queue.cc:237] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.844548 22641 raft_consensus.cc:697] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:44.845486 22641 consensus_queue.cc:237] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.841199 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:44.850104 15482 consensus_peers.cc:597] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.850639 15482 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.851049 15484 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.851383 15482 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.851850 15482 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
W20260709 13:07:44.855006 15482 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:44.856153 22645 raft_consensus.cc:2749] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:44.878561 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c098e199a9c74c79bc225b7ce9d73ff4" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:44.879356 16174 raft_consensus.cc:3060] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.883984 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:44.884240 16178 raft_consensus.cc:1217] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
I20260709 13:07:44.884395 15584 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:44.885831 16175 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:44.888459 22662 raft_consensus.cc:515] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:44.890534 15592 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 11: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:07:44.891395 15483 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.854776 22655 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:44.898954 15584 raft_consensus.cc:1275] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:07:44.898804 16174 raft_consensus.cc:2468] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 18.
I20260709 13:07:44.900840 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af1111c429c4e6fad608ff1eeac116b" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:44.914667 22656 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:44.923776 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.928633 22656 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:44.940850 22662 leader_election.cc:290] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:44.944855 16174 raft_consensus.cc:1217] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
I20260709 13:07:44.948763 15509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:44.949975 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:44.950493 15509 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
I20260709 13:07:44.950760 15513 raft_consensus.cc:2393] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 11: Already voted for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in this term.
W20260709 13:07:44.958274 15556 leader_election.cc:336] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.965617 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.973374 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46abb05486504a60be4a4d104d3295f7" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:44.974046 15513 raft_consensus.cc:3060] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:44.977813 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.987530 15513 raft_consensus.cc:2468] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 22.
W20260709 13:07:44.972167 15482 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:44.997521 15482 consensus_peers.cc:597] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.997973 15482 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:45.020490 15587 raft_consensus.cc:1275] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:45.022643 22646 consensus_queue.cc:1048] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:45.042631 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:45.043604 15592 raft_consensus.cc:2393] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a55534dc8864943937d5b6ec0e6aaf9 in current term 17: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
I20260709 13:07:45.045858 15341 catalog_manager.cc:5697] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 14 to 15, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 15 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.048866 15340 catalog_manager.cc:5697] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 20 to 21, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 21 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.051945 15341 catalog_manager.cc:5697] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 22 to 23, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 23 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.053589 15341 catalog_manager.cc:5697] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 12 to 13, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 13 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.054858 15341 catalog_manager.cc:5697] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 19 to 20, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 20 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.060534 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:45.064373 22644 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:45.064414 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:45.067684 22601 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.074723 15584 raft_consensus.cc:1275] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:07:45.074826 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.079349 22646 consensus_queue.cc:1048] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:07:45.081194 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.107630 22667 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:45.111492 15482 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 
I20260709 13:07:45.114341 22655 raft_consensus.cc:2804] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:45.115710 22655 raft_consensus.cc:697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:45.119055 22655 consensus_queue.cc:237] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:45.139467 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.151005 15339 catalog_manager.cc:5697] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 17 to 18, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 18 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.153403 15555 leader_election.cc:304] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:45.153806 15339 catalog_manager.cc:5697] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 18 to 19, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 19 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:45.154579 15482 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:45.155158 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:45.155732 15339 catalog_manager.cc:5697] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 16 to 17, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 17 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.160384 22601 raft_consensus.cc:2804] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:45.160519 22645 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.160002 15339 catalog_manager.cc:5697] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 19 to 20, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 20 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.161077 22601 raft_consensus.cc:697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
W20260709 13:07:45.163743 15482 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:45.144163 22656 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:07:45.171931 14293 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15464)
I20260709 13:07:45.180848 15587 raft_consensus.cc:1275] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:45.149659 22667 consensus_queue.cc:1048] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:07:45.197044 15587 raft_consensus.cc:1275] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:45.199591 22601 consensus_queue.cc:237] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:45.240017 15482 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.240558 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 58786us
W20260709 13:07:45.241045 15482 leader_election.cc:336] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:45.241453 15482 leader_election.cc:304] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:45.243868 22658 consensus_queue.cc:1048] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:45.244753 22667 raft_consensus.cc:2749] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:45.246584 22599 consensus_queue.cc:1048] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:45.255002 15587 raft_consensus.cc:1275] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:45.263314 15336 catalog_manager.cc:5697] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 21 to 22, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 22 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.269917 15341 catalog_manager.cc:5697] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 17 to 18, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 18 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:45.290942 15482 consensus_peers.cc:597] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.291610 15482 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:45.292054 15482 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:45.295483 15588 raft_consensus.cc:1275] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:45.314327 22667 raft_consensus.cc:2749] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:45.332201 22658 consensus_queue.cc:1048] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:07:45.349824 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.363796 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:45.386981 22644 raft_consensus.cc:1064] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:45.390543 22644 consensus_queue.cc:237] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:45.396045 22655 consensus_queue.cc:1048] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:45.410655 15556 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.416443 15592 raft_consensus.cc:1275] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:07:45.438493 15584 raft_consensus.cc:1275] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:45.445621 15584 raft_consensus.cc:1275] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:45.454982 16174 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 LEARNER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:45.465328 22644 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
W20260709 13:07:45.473785 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.485577 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.646588 15515 raft_consensus.cc:1275] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:45.647233 15509 raft_consensus.cc:1275] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:45.656639 15516 raft_consensus.cc:1275] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:45.660336 22591 raft_consensus.cc:2955] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:45.691973 15482 consensus_peers.cc:597] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.692838 15482 consensus_peers.cc:597] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.708244 15556 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.717248 16178 raft_consensus.cc:1275] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:45.721386 15341 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 9 to 10, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.727525 16179 raft_consensus.cc:2955] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:45.729573 22644 consensus_queue.cc:1048] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:45.736467 22694 consensus_queue.cc:1048] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:07:45.737783 22645 consensus_queue.cc:1048] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:45.731514 22644 consensus_queue.cc:1048] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:07:45.760686 22645 consensus_queue.cc:1048] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:45.771298 15482 consensus_peers.cc:597] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.825266 15482 consensus_peers.cc:597] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.826812 15586 raft_consensus.cc:2955] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } attrs { replace: true } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:45.837182 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 108533us
I20260709 13:07:45.841674 22633 consensus_queue.cc:1048] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:45.852063 15482 consensus_peers.cc:597] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:45.860759 22656 raft_consensus.cc:1064] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: attempting to promote NON_VOTER 6ff41728dec842afad5b53c20446a5a0 to VOTER
I20260709 13:07:45.833575 22645 consensus_queue.cc:1048] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
W20260709 13:07:45.877439 15482 consensus_peers.cc:597] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.916637 15515 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:45.952047 22656 consensus_queue.cc:237] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:46.150110 22601 raft_consensus.cc:2955] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:46.176754 15509 raft_consensus.cc:2955] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:46.184286 14293 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15464)
W20260709 13:07:46.177569 22704 log.cc:927] Time spent T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 13:07:46.265029 16181 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:46.291093 16146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111) [suppressed 359 similar messages]
I20260709 13:07:46.320422 15589 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:46.356019 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 54510.1us
W20260709 13:07:46.367650 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 48317.2us
I20260709 13:07:46.371995 16179 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 LEARNER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:07:46.419749 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 106808us
W20260709 13:07:46.492738 22726 log.cc:927] Time spent T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:46.561905 22707 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.540114 22716 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:46.562630 22707 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:46.595633 22707 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:46.596748 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 71047.7us
I20260709 13:07:46.617990 15341 catalog_manager.cc:5697] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 14 to 15, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:46.634003 22723 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:46.636632 22723 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:07:46.656555 15482 consensus_peers.cc:597] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.662961 15587 raft_consensus.cc:1275] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:07:46.676512 15482 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:46.701658 16182 raft_consensus.cc:2955] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:46.748576 22722 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.772871 22722 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:46.819394 16145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 112362us
W20260709 13:07:46.830250 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 91663us
I20260709 13:07:46.842206 15584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:46.754856 22656 raft_consensus.cc:2955] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:46.846140 15584 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 21.
W20260709 13:07:46.900614 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 463390us
W20260709 13:07:46.934955 22750 log.cc:927] Time spent T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:07:46.945420 22757 log.cc:927] Time spent T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:07:46.931373 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 48800.2us
W20260709 13:07:46.961258 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.962328 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.974642 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:46.978974 22722 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:46.981364 22754 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: Append to log took a long time: real 0.199s	user 0.002s	sys 0.003s
W20260709 13:07:46.987092 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.987917 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.988605 22745 log.cc:927] Time spent T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
W20260709 13:07:47.009961 22758 log.cc:927] Time spent T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.226s	user 0.003s	sys 0.000s
W20260709 13:07:47.021003 22742 log.cc:927] Time spent T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
W20260709 13:07:47.026134 22756 log.cc:927] Time spent T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:07:47.043524 22698 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.044729 22698 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:47.055840 22730 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:07:47.056586 15482 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:47.057071 22730 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: NON_VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: true } }
W20260709 13:07:47.060781 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.066491 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:47.067569 15587 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 11.
I20260709 13:07:47.077661 22730 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:47.081522 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.082212 22698 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:47.094293 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.096628 15556 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:47.112229 22656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58996 (request call id 11) took 1204 ms. Trace:
I20260709 13:07:47.113271 22656 rpcz_store.cc:276] 0709 13:07:45.907949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.908115 (+   166us) service_pool.cc:224] Handling call
0709 13:07:45.928103 (+ 19988us) log.cc:844] Serialized 501 byte log entry
0709 13:07:46.173570 (+245467us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b4c0021ac80. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf7a023a20 00007fcf7a034a29 00007fcf7a03513f 00007fcf79ff92ab 00007fcf7a026f3c 00007fcf7a0273fe 00007fcf7a2b450b 00007fcf7bcb3381 00007fcf7bcb126b 00007fcf7bcb7d53 00007fcf7bcb7cd9
0709 13:07:46.190260 (+ 16690us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b1800034780. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:07:47.111951 (+921691us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36199,"raft.queue_time_us":117102,"raft.run_cpu_time_us":3211,"raft.run_wall_time_us":168431,"spinlock_wait_cycles":20334336,"thread_start_us":155285,"threads_started":1}
I20260709 13:07:47.150336 22708 raft_consensus.cc:493] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:07:47.151129 22708 raft_consensus.cc:515] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:47.153760 22708 leader_election.cc:290] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:47.157289 16174 raft_consensus.cc:2955] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
W20260709 13:07:47.164275 15556 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:47.159235 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.169166 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.185997 14293 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15464)
W20260709 13:07:47.199824 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.205539 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.206317 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.236380 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:47.250053 22760 consensus_queue.cc:1048] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:47.253834 15516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" is_pre_election: true
I20260709 13:07:47.254715 15516 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 17.
I20260709 13:07:47.249431 15341 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 10 to 11, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New cstate: current_term: 15 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:47.282500 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.306982 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.312441 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
W20260709 13:07:47.313988 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.325152 22693 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:47.325734 22693 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.326121 22693 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:47.334574 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:47.335635 22708 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:47.336073 22708 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.336428 22708 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.375954 15325 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 423df90a9f55438bbe1c32ab906c6e10 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:07:47.388361 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.392344 22708 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:47.398351 22693 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:47.400681 22693 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:47.395337 22708 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:47.419909 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae531d3e35db41bc9f66769323b94372" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:47.425881 15587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f17bb405a44393bd7aacc1097a7a13" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:47.426630 15587 raft_consensus.cc:3060] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:47.427886 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534703c18f76440380b33b80bf77802e" candidate_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:47.428543 15592 raft_consensus.cc:3060] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.426288 15584 raft_consensus.cc:2955] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:47.456291 15587 raft_consensus.cc:2468] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 22.
I20260709 13:07:47.459080 15555 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:47.467231 15482 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:47.472333 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:47.484385 22759 raft_consensus.cc:2804] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:47.485049 22759 raft_consensus.cc:697] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:47.486114 22759 consensus_queue.cc:237] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:47.487133 15326 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 57730.5us
I20260709 13:07:47.466485 22698 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:47.506240 15592 raft_consensus.cc:2468] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a55534dc8864943937d5b6ec0e6aaf9 in term 12.
I20260709 13:07:47.507997 22737 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:47.509703 22737 raft_consensus.cc:493] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.520222 15482 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:47.520817 15482 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:47.521377 15482 consensus_peers.cc:597] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.517014 22737 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:47.547881 15326 catalog_manager.cc:4755] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 423df90a9f55438bbe1c32ab906c6e10: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:47.634516 15482 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:47.635519 22722 raft_consensus.cc:2804] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:47.636117 22722 raft_consensus.cc:697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Becoming Leader. State: Replica: 8a55534dc8864943937d5b6ec0e6aaf9, State: Running, Role: LEADER
I20260709 13:07:47.637264 22722 consensus_queue.cc:237] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:47.678133 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:47.683023 22656 raft_consensus.cc:2955] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:47.627039 22737 raft_consensus.cc:515] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:47.689677 15482 consensus_peers.cc:597] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.694823 15482 consensus_peers.cc:597] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.698666 15482 leader_election.cc:336] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:47.699277 15482 leader_election.cc:304] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:47.703807 22769 raft_consensus.cc:2749] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:47.721031 22737 leader_election.cc:290] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Requested vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:47.721604 15556 leader_election.cc:336] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:47.758615 15588 raft_consensus.cc:2955] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:47.786449 15336 catalog_manager.cc:5697] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 20 to 22, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 22 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.793416 15513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9ed1641e04cbfb3dfb6d3b9c4fd5f" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8a55534dc8864943937d5b6ec0e6aaf9"
I20260709 13:07:47.794220 15513 raft_consensus.cc:3060] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:47.805917 15513 raft_consensus.cc:2468] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 18.
I20260709 13:07:47.820201 15336 catalog_manager.cc:5697] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: config changed from index 14 to 15, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.829097 16174 raft_consensus.cc:2955] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } } }
I20260709 13:07:47.822543 15336 catalog_manager.cc:5697] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 reported cstate change: term changed from 10 to 12, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66). New cstate: current_term: 12 leader_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.869045 15555 leader_election.cc:304] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83
I20260709 13:07:47.870466 22725 raft_consensus.cc:2804] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:47.871340 22725 raft_consensus.cc:697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:47.872493 22725 consensus_queue.cc:237] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:47.879431 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.897357 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:47.924315 15336 catalog_manager.cc:5697] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 16 to 18, leader changed from 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 18 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:47.929986 15482 consensus_peers.cc:597] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.930680 15482 consensus_peers.cc:597] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.931228 15482 consensus_peers.cc:597] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.939658 15482 consensus_peers.cc:597] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.939018 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.993155 15482 consensus_peers.cc:597] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:48.031677 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.163724 15482 consensus_peers.cc:597] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.164467 15482 consensus_peers.cc:597] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:48.186617 14293 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15464)
W20260709 13:07:48.202466 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:48.211019 15482 consensus_peers.cc:597] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:48.212435 15584 raft_consensus.cc:1275] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:07:48.215715 15482 consensus_peers.cc:597] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:48.245873 15556 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:48.260475 15592 raft_consensus.cc:1275] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Refusing update from remote peer 8a55534dc8864943937d5b6ec0e6aaf9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:07:48.255475 15482 consensus_peers.cc:597] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:48.265811 15482 consensus_peers.cc:597] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:48.266345 15482 consensus_peers.cc:597] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.274379 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:48.297281 22771 consensus_queue.cc:1048] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:48.306804 22771 consensus_queue.cc:1048] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:48.510182 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:37005, user_credentials={real_user=slave}} blocked reactor thread for 47224.7us
W20260709 13:07:48.514185 15556 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:48.538727 15555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:34291, user_credentials={real_user=slave}} blocked reactor thread for 63691.3us
I20260709 13:07:48.584774 15509 raft_consensus.cc:1275] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:07:48.596405 15556 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:48.619702 22795 consensus_queue.cc:1048] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:07:48.672330 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 59722.7us
W20260709 13:07:48.673194 15482 consensus_peers.cc:597] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.730100 15482 consensus_peers.cc:597] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.917294 15326 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 70385.6us
W20260709 13:07:48.939774 15326 catalog_manager.cc:4755] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 423df90a9f55438bbe1c32ab906c6e10: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:48.977934 15482 consensus_peers.cc:597] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.978672 15482 consensus_peers.cc:597] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.992880 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:49.011574 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.171315 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.224578 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.266944 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.439095 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.497442 15482 consensus_peers.cc:597] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:49.587193 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.615322 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.700731 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.792514 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.815979 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:49.870069 14293 tablet_server.cc:196] TabletServer@127.13.245.65:0 shutdown complete.
W20260709 13:07:49.876181 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.010223 15326 catalog_manager.cc:4755] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 423df90a9f55438bbe1c32ab906c6e10: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:50.017323 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:50.078406 14293 tablet_server.cc:179] TabletServer@127.13.245.66:0 shutting down...
W20260709 13:07:50.093330 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.101112 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.117152 16145 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.182106 16145 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.182855 16145 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.190266 15482 consensus_peers.cc:597] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.190157 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.210505 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.244629 15556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 49375us
W20260709 13:07:50.257026 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.276783 15482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:33529, user_credentials={real_user=slave}} blocked reactor thread for 72728.7us
W20260709 13:07:50.280797 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.306991 16145 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.336879 16145 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.341885 16145 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.358304 15482 consensus_peers.cc:597] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.361195 15482 consensus_peers.cc:597] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.361825 15482 consensus_peers.cc:597] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.377154 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:50.389458 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:07:50.398463 15482 consensus_peers.cc:597] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.399267 15482 consensus_peers.cc:597] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.400507 15482 consensus_peers.cc:597] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.401178 15482 consensus_peers.cc:597] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.408522 15555 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.409613 15555 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.410811 15555 consensus_peers.cc:597] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:50.392230 14293 tablet_replica.cc:333] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.417030 14293 raft_consensus.cc:2243] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.426129 14293 raft_consensus.cc:2272] T a2e2091b55004aafb70a88703ef6fbfc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:50.427872 16145 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.434480 15555 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.439446 15555 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.444945 16145 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:50.452543 14293 tablet_replica.cc:333] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.453725 14293 raft_consensus.cc:2243] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.471143 14293 raft_consensus.cc:2272] T f012dbeed0364c8195192ae55ff12fef P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.477116 14293 tablet_replica.cc:333] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.484584 14293 raft_consensus.cc:2243] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:07:50.485561 15555 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.487329 15555 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:50.486331 14293 raft_consensus.cc:2272] T 567ba2de2d424a60ae555fb26b4de59b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.490742 14293 tablet_replica.cc:333] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
W20260709 13:07:50.496806 16145 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:50.503981 14293 raft_consensus.cc:2243] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:50.510567 15555 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:50.527333 14293 raft_consensus.cc:2272] T badc8a91586140ab8a3903619efbd8c9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:50.527266 15555 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.532196 15555 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.532891 15555 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.533447 15555 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.534030 15555 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:50.519881 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:50.537729 14293 tablet_replica.cc:333] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.539003 14293 raft_consensus.cc:2243] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:50.539275 16145 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:50.539724 14293 raft_consensus.cc:2272] T d8f193cb849d4553a3e9a29aa592583a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.542758 14293 tablet_replica.cc:333] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.543761 14293 raft_consensus.cc:2243] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.544414 14293 raft_consensus.cc:2272] T 46abb05486504a60be4a4d104d3295f7 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.547616 14293 tablet_replica.cc:333] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.548864 14293 raft_consensus.cc:2243] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.550725 14293 raft_consensus.cc:2272] T bb9e1d3b1096451da3fea10491454092 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:50.555668 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.558689 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.561738 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:50.563584 14293 tablet_replica.cc:333] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.564744 14293 raft_consensus.cc:2243] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.565687 14293 raft_consensus.cc:2272] T 3782fb71a4794032bbb7124248fc9b05 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.573428 14293 tablet_replica.cc:333] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.574414 14293 raft_consensus.cc:2243] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.575727 14293 raft_consensus.cc:2272] T bee09de23aee40d689e3f0426ed38fc1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.579043 14293 tablet_replica.cc:333] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.584807 14293 raft_consensus.cc:2243] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.585857 14293 raft_consensus.cc:2272] T 58702c00fb4641ec8337a916d4579ec9 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.588999 14293 tablet_replica.cc:333] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.590561 14293 raft_consensus.cc:2243] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.592042 14293 raft_consensus.cc:2272] T 82533161d7894b3db9b0230e076936b2 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.595082 14293 tablet_replica.cc:333] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.596102 14293 raft_consensus.cc:2243] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.597620 14293 raft_consensus.cc:2272] T 222e5d29fb564b08bdca15f666c0c986 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.601061 14293 tablet_replica.cc:333] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.602119 14293 raft_consensus.cc:2243] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.602880 14293 raft_consensus.cc:2272] T 0af1111c429c4e6fad608ff1eeac116b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.606070 14293 tablet_replica.cc:333] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.607090 14293 raft_consensus.cc:2243] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.608592 14293 raft_consensus.cc:2272] T 08f534c2cc884d65b268a74636da80eb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.611931 14293 tablet_replica.cc:333] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.612902 14293 raft_consensus.cc:2243] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.614079 14293 raft_consensus.cc:2272] T 1fcd0644c7dd431aa808e206e7ea031e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.617336 14293 tablet_replica.cc:333] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.618412 14293 raft_consensus.cc:2243] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.619854 14293 raft_consensus.cc:2272] T 9178296553b44a3f82267d1278be3746 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:50.621888 16145 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:50.623026 14293 tablet_replica.cc:333] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.624236 14293 raft_consensus.cc:2243] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.626197 14293 raft_consensus.cc:2272] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:50.629518 16145 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:50.629684 14293 tablet_replica.cc:333] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.630820 14293 raft_consensus.cc:2243] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.632196 14293 raft_consensus.cc:2272] T d40d294abeec453098d547799a79f7c5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.635890 14293 tablet_replica.cc:333] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.636896 14293 raft_consensus.cc:2243] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.638026 14293 raft_consensus.cc:2272] T 952f15e68b0745e5a8ca26a3b527cab0 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.647323 14293 tablet_replica.cc:333] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.648518 14293 raft_consensus.cc:2243] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.649441 14293 raft_consensus.cc:2272] T a42725e017f142629708ff226f2d53e1 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.652774 14293 tablet_replica.cc:333] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.653793 14293 raft_consensus.cc:2243] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.654565 14293 raft_consensus.cc:2272] T 66d8364b020b43deb510a118a19d076a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.658152 14293 tablet_replica.cc:333] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.659193 14293 raft_consensus.cc:2243] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.660279 14293 raft_consensus.cc:2272] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.673457 14293 tablet_replica.cc:333] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.674553 14293 raft_consensus.cc:2243] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.675833 14293 raft_consensus.cc:2272] T 423df90a9f55438bbe1c32ab906c6e10 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.680207 14293 tablet_replica.cc:333] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.681243 14293 raft_consensus.cc:2243] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.684559 14293 raft_consensus.cc:2272] T 327bd8cd50304a9e89be009f16906be3 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.687774 14293 tablet_replica.cc:333] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.693125 14293 raft_consensus.cc:2243] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.697242 14293 raft_consensus.cc:2272] T dc4f3caf80c04c18bd2d225b9e630e92 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.704859 14293 tablet_replica.cc:333] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.712677 14293 raft_consensus.cc:2243] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.714762 14293 raft_consensus.cc:2272] T 1915fdd81d344a749443e48f07a1fef8 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.735014 14293 tablet_replica.cc:333] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
W20260709 13:07:50.745613 15482 consensus_peers.cc:597] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:50.747116 14293 raft_consensus.cc:2243] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.747874 14293 raft_consensus.cc:2272] T 3b48413efda34be880a83df9e239fb3c P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.750887 14293 tablet_replica.cc:333] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.751928 14293 raft_consensus.cc:2243] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.763986 14293 raft_consensus.cc:2272] T 77b747e7ea77471f95bf6fbb4eb03bab P 8a55534dc8864943937d5b6ec0e6aaf9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.767923 14293 tablet_replica.cc:333] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
W20260709 13:07:50.778992 15482 consensus_peers.cc:597] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.779582 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:50.788594 14293 raft_consensus.cc:2243] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.798691 14293 raft_consensus.cc:2272] T 07d5db06e4ec455f8b7755416957114a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.810423 14293 tablet_replica.cc:333] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.811462 14293 raft_consensus.cc:2243] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.814082 14293 raft_consensus.cc:2272] T 6555b0b9d1524fdcbea2216e3e879bba P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.817361 14293 tablet_replica.cc:333] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.823652 14293 raft_consensus.cc:2243] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.829888 14293 raft_consensus.cc:2272] T c098e199a9c74c79bc225b7ce9d73ff4 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.837241 14293 tablet_replica.cc:333] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.844794 14293 raft_consensus.cc:2243] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.852488 14293 raft_consensus.cc:2272] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.866730 14293 tablet_replica.cc:333] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.872304 14293 raft_consensus.cc:2243] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.873301 14293 raft_consensus.cc:2272] T 4a8042e01976403089e7b30f1a5b5740 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.876327 14293 tablet_replica.cc:333] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.884178 14293 raft_consensus.cc:2243] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.891309 14293 raft_consensus.cc:2272] T 27b4902277e34c9f97dd7889ac3f8375 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.894382 14293 tablet_replica.cc:333] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.896924 14293 raft_consensus.cc:2243] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.908192 14293 raft_consensus.cc:2272] T 65c950883b754dd6bb39c54f8c8134aa P 8a55534dc8864943937d5b6ec0e6aaf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.911424 14293 tablet_replica.cc:333] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.915153 14293 raft_consensus.cc:2243] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:07:50.920070 15556 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:50.927735 14293 raft_consensus.cc:2272] T e3f17bb405a44393bd7aacc1097a7a13 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.940532 14293 tablet_replica.cc:333] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.941576 14293 raft_consensus.cc:2243] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.942757 14293 raft_consensus.cc:2272] T 4152881cdccb4731a3bd4a47c960307b P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.945690 14293 tablet_replica.cc:333] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.953239 14293 raft_consensus.cc:2243] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.954207 14293 raft_consensus.cc:2272] T 496a555ec7cc49798fc4d775f6d151ed P 8a55534dc8864943937d5b6ec0e6aaf9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.961936 14293 tablet_replica.cc:333] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.967056 14293 raft_consensus.cc:2243] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.973999 14293 raft_consensus.cc:2272] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.983579 14293 tablet_replica.cc:333] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:50.992197 14293 raft_consensus.cc:2243] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:50.993489 14293 raft_consensus.cc:2272] T 4adf54c918c8432f819a78622c9d46bc P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.009888 14293 tablet_replica.cc:333] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:51.019704 14293 raft_consensus.cc:2243] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:51.020781 14293 raft_consensus.cc:2272] T ae531d3e35db41bc9f66769323b94372 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.023715 14293 tablet_replica.cc:333] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:51.036316 14293 raft_consensus.cc:2243] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:51.037593 14293 raft_consensus.cc:2272] T 894134e9e1614272b87adbf47e180cdb P 8a55534dc8864943937d5b6ec0e6aaf9 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:51.041379 15556 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:51.042203 14293 tablet_replica.cc:333] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:51.051240 14293 raft_consensus.cc:2243] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:07:51.060703 14293 raft_consensus.cc:2272] T f87e12456fed4de1b2d723da6cc14d3a P 8a55534dc8864943937d5b6ec0e6aaf9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.073952 14293 tablet_replica.cc:333] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:51.075250 14293 raft_consensus.cc:2243] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:51.079322 14293 raft_consensus.cc:2272] T 790046238f9f42cfa9d478a7ed4f2e21 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.091215 14293 tablet_replica.cc:333] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:51.097612 14293 raft_consensus.cc:2243] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:51.099056 14293 raft_consensus.cc:2272] T 653fb1b09eaf49f98c8993fbea783b3d P 8a55534dc8864943937d5b6ec0e6aaf9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.102665 14293 tablet_replica.cc:333] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:51.114945 14293 raft_consensus.cc:2243] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:51.119704 14293 raft_consensus.cc:2272] T 8e5602b415c44c2486bba85d5cbf2ec5 P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.122731 14293 tablet_replica.cc:333] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:51.140027 14293 raft_consensus.cc:2243] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:51.141471 14293 raft_consensus.cc:2272] T f91e9b24450f4bc88be5be6228d8587f P 8a55534dc8864943937d5b6ec0e6aaf9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.144788 14293 tablet_replica.cc:333] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9: stopping tablet replica
I20260709 13:07:51.145653 14293 raft_consensus.cc:2243] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:07:51.147497 14293 raft_consensus.cc:2272] T 534703c18f76440380b33b80bf77802e P 8a55534dc8864943937d5b6ec0e6aaf9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:51.293089 15556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111) [suppressed 503 similar messages]
W20260709 13:07:51.309309 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:51.328890 15556 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:51.610278 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.612098 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:51.704559 22785 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.717327 22812 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.718050 22812 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:51.720718 22812 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:51.710585 22785 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:51.738619 22785 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:51.741074 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.758309 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.761624 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.760882 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:51.765074 15556 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:51.767407 15556 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:51.773833 22785 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:51.770515 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:51.791808 15556 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:51.792791 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:51.793771 22785 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:51.831512 22806 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.832276 22806 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:51.837354 22773 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.837940 22773 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:51.841894 22799 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.842196 22806 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:51.842528 22799 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:51.843168 16145 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:51.845580 22799 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:51.847941 22785 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.848522 22785 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:51.850860 22785 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:51.852841 22812 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.853349 22812 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:51.854243 22773 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:51.855799 22812 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:51.857432 16145 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:51.864845 22785 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.865731 22785 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:51.868382 22785 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:51.884456 22816 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.885075 22816 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:51.888485 22816 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:51.891458 15555 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:51.905527 22816 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.906279 22816 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:51.908689 22815 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.909343 22815 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:51.909816 15556 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:51.911674 22815 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:51.913331 22816 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:51.913929 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:51.915287 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:51.914472 15556 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:51.918459 15556 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:51.919984 22815 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:07:51.920699 15555 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:51.922700 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:51.923467 22815 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:51.924619 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:51.928354 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:51.929354 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:51.930804 16179 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:51.933861 22816 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:51.930063 16146 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:51.934880 16146 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:51.935715 22799 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:51.937050 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:51.937741 15592 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 16.
W20260709 13:07:51.927847 15556 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:51.939568 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.947832 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:51.955142 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:51.955848 22799 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.958786 22799 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:51.961117 22799 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:51.962127 22815 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:51.953310 15556 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:51.969266 16145 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:51.969759 15556 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:51.976227 22785 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.976797 22785 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:51.978943 22785 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:51.985126 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:51.990317 22799 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.991161 22799 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:51.993436 22799 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:51.994246 16146 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:51.995144 22816 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:51.998044 22816 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:51.998476 22816 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:52.000792 16145 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.008267 22816 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:52.026572 22816 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:52.014721 22806 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:52.037075 22806 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.037528 22806 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.022807 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:52.012717 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.029091 22807 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.045818 22807 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:52.048314 22807 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:52.052269 15555 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.053246 22812 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:52.054525 15555 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.035991 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
W20260709 13:07:52.054744 16145 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.058723 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.059682 22812 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:52.030493 15556 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.077927 22806 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:52.083102 22812 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.109812 22812 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:52.112514 22812 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:52.087690 22785 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.113301 22785 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:52.115828 22785 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:52.089001 22816 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.116699 22816 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:52.121215 22816 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:52.095798 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.108919 22815 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.128916 22815 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:52.130687 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:52.132903 16145 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:52.091882 16146 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.123870 16179 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d225833a2cbf4a5995fdbbb1292d1918 in current term 17: Already voted for candidate 6ff41728dec842afad5b53c20446a5a0 in this term.
I20260709 13:07:52.136616 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.137537 22807 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:52.138652 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 46801.7us
I20260709 13:07:52.145921 22815 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:52.148620 22785 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.152902 22785 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:52.155331 22785 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:52.149857 22806 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:52.146857 22816 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.163146 22785 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.164680 22785 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:52.167563 22785 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:52.176843 16146 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:52.182957 22817 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:52.189450 15555 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.189618 22817 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.191579 22817 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:52.194078 15326 catalog_manager.cc:4755] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 423df90a9f55438bbe1c32ab906c6e10: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:52.206571 16145 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.212944 22817 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:07:52.222100 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.224207 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:52.227346 15592 raft_consensus.cc:2393] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ff41728dec842afad5b53c20446a5a0 in current term 17: Already voted for candidate d225833a2cbf4a5995fdbbb1292d1918 in this term.
W20260709 13:07:52.230453 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:52.234773 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:52.251715 15556 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.254784 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:52.256094 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:52.261238 16179 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
I20260709 13:07:52.261303 16181 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 15.
W20260709 13:07:52.260315 16146 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.262776 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.263422 15556 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:52.272969 15556 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.278611 15556 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.275053 22806 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.273623 22816 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:52.295200 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:52.296016 15592 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 21.
I20260709 13:07:52.297513 22816 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:52.299007 15556 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.302434 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:52.289068 15555 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:52.305783 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.307411 22816 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:52.309830 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:52.310267 15556 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.314157 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.312449 16146 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:52.316402 22806 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.317291 22816 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:52.339330 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:52.347213 15556 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 6ff41728dec842afad5b53c20446a5a0, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.355297 22816 raft_consensus.cc:2749] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.358860 22806 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.359513 22806 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:52.361809 22806 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:52.366186 15556 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:52.367599 16145 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.373144 22816 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:52.373575 22816 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.373989 22816 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:52.380704 15556 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.381258 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:52.384541 16146 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.385104 16146 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.385897 22806 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:52.391582 22806 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.392156 22806 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:52.394398 22806 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:52.398605 22785 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:52.399138 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.402794 16145 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.403462 22816 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:52.405706 22816 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:52.409890 22785 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.410411 22785 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:52.417273 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.417900 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:52.423252 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
W20260709 13:07:52.431644 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.420184 15555 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.420734 22785 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:52.446578 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:52.447926 15555 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:52.449625 16146 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:07:52.452920 22806 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:52.454757 16146 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.457638 16146 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.469261 22806 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:52.472380 15556 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.473073 15556 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.473927 22815 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.483559 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423df90a9f55438bbe1c32ab906c6e10" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:52.484364 16179 raft_consensus.cc:3060] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.494028 16179 raft_consensus.cc:2468] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 16.
I20260709 13:07:52.496047 22806 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:07:52.501135 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:52.505081 22806 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:52.515511 16145 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.513365 22806 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:52.518174 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.523352 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:52.528405 15556 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.529297 22815 raft_consensus.cc:2804] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:52.529861 22815 raft_consensus.cc:697] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:52.530814 22815 consensus_queue.cc:237] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:52.555516 15555 consensus_peers.cc:597] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.557965 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:52.578166 15341 catalog_manager.cc:5697] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 15 to 16, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 16 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.585883 22785 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.586594 22785 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:52.587836 15555 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:52.592253 22785 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:52.594141 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.597854 15555 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:52.604245 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.604840 16146 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:52.605283 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.606195 22799 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.614045 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:52.620445 16174 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 22.
I20260709 13:07:52.622530 15556 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.625576 22785 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:52.626056 22785 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:52.626731 22785 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:52.651116 22785 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:52.660794 15555 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:52.671943 22785 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
I20260709 13:07:52.676641 16179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790046238f9f42cfa9d478a7ed4f2e21" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0"
I20260709 13:07:52.677377 16179 raft_consensus.cc:3060] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:52.684670 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.688752 15555 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:52.692603 16179 raft_consensus.cc:2468] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 23.
I20260709 13:07:52.694085 15556 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:52.695065 22815 raft_consensus.cc:2804] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:52.695688 22815 raft_consensus.cc:697] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 LEADER]: Becoming Leader. State: Replica: d225833a2cbf4a5995fdbbb1292d1918, State: Running, Role: LEADER
I20260709 13:07:52.696693 22815 consensus_queue.cc:237] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:52.708617 14293 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15539)
W20260709 13:07:52.723006 16145 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.740178 16145 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:52.765748 15341 catalog_manager.cc:5697] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 reported cstate change: term changed from 22 to 23, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67). New cstate: current_term: 23 leader_uuid: "d225833a2cbf4a5995fdbbb1292d1918" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:52.802106 15555 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.839145 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.846771 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.860702 16145 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.867344 16145 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.868268 16145 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.902529 15555 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.914824 15555 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.918001 15555 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.939412 15555 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.949847 15555 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:52.952099 16145 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.018101 16145 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.022140 16145 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.028260 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:53.028491 15555 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:53.055168 16145 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.058110 16145 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:53.091136 16179 raft_consensus.cc:1275] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:53.093020 22785 consensus_queue.cc:1048] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:07:53.109180 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:53.114925 15555 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.142194 16145 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.153877 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:53.154631 16179 raft_consensus.cc:1275] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Refusing update from remote peer d225833a2cbf4a5995fdbbb1292d1918: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:07:53.157462 22816 consensus_queue.cc:1048] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:07:53.200330 15555 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.209959 15555 consensus_peers.cc:597] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:53.256999 15556 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:53.279459 15555 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.349972 16145 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:53.376094 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:53.422842 22836 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.423534 22836 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:53.425836 22836 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:53.432715 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:53.437608 15556 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:53.438091 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.438882 22836 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:53.508785 22836 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.509429 22836 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:53.511935 22836 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:53.522851 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:53.523896 15556 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:53.524381 15556 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.525343 22836 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:53.576819 15556 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:53.578408 22836 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.578970 22836 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:53.582259 22836 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:53.585960 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:53.611716 15556 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:53.612303 15556 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.613477 22835 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:53.689575 22836 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.690210 22836 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:53.692642 22836 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:53.704800 15555 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:53.709218 14293 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15539)
W20260709 13:07:53.722826 15556 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:53.723436 15556 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.724458 22785 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:53.753666 22785 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.754436 22815 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.755084 22815 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:53.757472 22815 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:53.754272 22785 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:53.759577 22785 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:53.759833 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:53.775990 15556 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:53.783696 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:53.784268 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:53.785140 15556 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:53.786171 22785 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:53.787191 15555 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:53.787648 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.788393 22785 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:53.796802 22799 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.797488 22799 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:53.804723 22799 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:53.811622 16145 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:53.811851 22785 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.812508 22785 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:53.814674 22785 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:53.816166 16146 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:53.816717 16146 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.817480 22799 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:53.827740 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:53.829457 15556 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:53.829932 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.830724 22785 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:53.851902 22799 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.852629 22799 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:53.857404 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:53.858156 15586 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 17.
I20260709 13:07:53.860074 16146 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 
I20260709 13:07:53.861068 22807 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:53.861500 22807 raft_consensus.cc:493] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.861884 22807 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:53.863363 16145 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:53.864324 22799 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:53.870863 22807 raft_consensus.cc:515] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:53.878265 15586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9e1d3b1096451da3fea10491454092" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918"
I20260709 13:07:53.878933 15586 raft_consensus.cc:3060] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:53.882320 16145 leader_election.cc:336] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:53.889887 22807 leader_election.cc:290] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: Requested vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:53.891352 15586 raft_consensus.cc:2468] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 18.
I20260709 13:07:53.892930 16146 leader_election.cc:304] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.896534 22807 raft_consensus.cc:2804] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:53.899165 22807 raft_consensus.cc:697] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Becoming Leader. State: Replica: 6ff41728dec842afad5b53c20446a5a0, State: Running, Role: LEADER
I20260709 13:07:53.900285 22807 consensus_queue.cc:237] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:53.937162 22815 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:53.937754 22815 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:53.942099 22815 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:53.944526 15556 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:53.950320 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:53.950842 15555 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:53.951663 22785 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:53.956058 15341 catalog_manager.cc:5697] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 reported cstate change: term changed from 16 to 18, leader changed from 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66) to 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68). New cstate: current_term: 18 leader_uuid: "6ff41728dec842afad5b53c20446a5a0" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:54.007874 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.037272 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.093991 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:54.096058 22807 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.101305 22807 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:54.119594 22807 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.122745 16145 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:54.140429 15556 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:54.155045 16146 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:54.156016 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.160141 22807 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:54.167178 22815 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.167886 22815 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:54.169034 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:54.170622 22815 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:54.175196 22807 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.177835 22807 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:54.180796 22807 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.176327 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:54.189179 15556 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:54.190203 15556 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:54.190771 16145 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.191313 22785 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:54.193472 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.209609 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:54.238457 22785 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.239027 22785 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:54.246417 15556 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:54.248380 22785 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.258000 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.258538 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.262992 22836 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.264554 22836 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:07:54.264937 16146 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:54.265061 22836 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:54.265497 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.266333 22807 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.267395 22836 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.273018 15556 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:54.276389 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.276919 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.277833 22836 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:54.291029 16145 consensus_peers.cc:597] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.310024 22807 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.310688 22807 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:54.312929 22807 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.319074 16146 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:54.319985 16145 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.321244 15586 raft_consensus.cc:1275] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Refusing update from remote peer 6ff41728dec842afad5b53c20446a5a0: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:07:54.320420 16145 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.322999 22807 consensus_queue.cc:1048] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:54.325418 22807 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:54.343298 22807 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.344120 22807 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:54.351193 16146 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:54.365789 22807 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:54.367841 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:54.368737 15592 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 21.
W20260709 13:07:54.371328 16145 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.372768 16145 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.374349 22807 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:54.423794 22785 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.424544 22785 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:54.427304 22785 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.441083 15556 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:54.443328 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.443938 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.446164 22785 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:54.452883 22844 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.453692 22844 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:07:54.466117 16146 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:54.466890 22844 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.472591 16145 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.473148 16145 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.474537 22807 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:54.513284 22785 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.513953 22785 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:54.518028 22785 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.543054 15556 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:54.551580 22785 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:54.552233 22785 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:54.554314 22785 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:54.561503 15556 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:54.565949 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.568562 15555 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.575835 22836 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:54.580078 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:54.583345 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:54.584900 22836 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:54.621078 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.658892 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.709769 14293 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15539)
W20260709 13:07:54.824265 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:54.837873 15555 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:54.964133 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.971729 15555 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:54.993960 16145 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.011431 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.018411 16145 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.040164 15555 consensus_peers.cc:597] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.047833 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.055804 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.075299 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.132580 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.151474 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.176121 16145 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.222419 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.249262 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.267444 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.288767 15555 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.291414 15555 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.338732 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.357257 15555 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:55.410101 22849 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:55.410763 22849 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:55.413266 22849 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:55.418164 15555 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.435700 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:55.438571 15556 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:55.439102 15556 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:55.440469 22849 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:55.444761 15555 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:55.479193 22849 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:55.479998 22849 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:55.484880 22849 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:55.497270 15556 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:55.500164 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.500996 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:55.501732 15555 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:55.503583 22849 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:55.560570 15555 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:55.569672 22807 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:55.570343 22807 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:55.572798 22807 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:55.578915 16146 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:55.579945 15556 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:55.639612 22849 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:55.640285 22849 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:55.642724 22849 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:55.657617 15555 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:55.671387 15556 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:55.672021 15556 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:55.673018 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.675710 15555 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.676316 15555 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:55.677649 22849 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:55.710399 14293 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15539)
W20260709 13:07:55.738055 15555 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.789284 15555 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:55.804095 15555 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:55.820148 15555 consensus_peers.cc:597] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:55.821048 22836 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:55.821702 22836 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:55.824087 22836 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:55.828331 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.843513 15556 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:55.845978 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:55.846434 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:55.855794 22836 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:55.865456 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:55.902279 22799 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:55.902906 22799 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:55.905097 22799 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:55.920790 16146 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:55.978011 22799 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:55.978626 22799 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:55.980954 22799 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:55.991566 16146 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:56.003139 22836 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.003937 22836 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:56.022311 15556 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:56.024185 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.024617 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.026543 22836 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:56.028337 22849 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:56.049285 22807 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.049957 22807 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:56.052976 22807 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:56.083655 16146 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:56.097172 22849 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.097798 22849 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:56.100751 22849 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:56.103808 15556 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:56.114629 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:56.129642 15556 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:56.130192 15556 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.133635 22849 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:56.230746 16145 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:56.231705 16145 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:56.232219 16145 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:56.232762 16145 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:56.233309 16145 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:56.236471 16145 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.236928 16145 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.237738 22807 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:56.238763 16145 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:56.238857 22850 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
W20260709 13:07:56.239359 16145 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:56.239807 16145 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.239473 22850 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:56.240178 16145 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.241971 22850 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:56.251752 22807 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:56.254714 16145 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.256994 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:56.258253 16145 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.258380 22799 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:56.258665 16145 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.259428 22799 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:56.260198 15555 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:56.263096 15556 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:56.264122 16145 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:56.265386 15556 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.266717 22850 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:56.289865 22850 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.290485 22850 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:56.297847 15555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111) [suppressed 647 similar messages]
I20260709 13:07:56.307339 22850 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:56.304875 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.314591 22849 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.315223 22849 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:56.317898 22849 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:56.322010 22850 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.326699 22850 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:56.329282 22850 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:56.322669 15556 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:56.330549 15556 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.333071 22849 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:56.329869 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:56.350422 15556 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:56.353876 15326 catalog_manager.cc:4755] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 423df90a9f55438bbe1c32ab906c6e10: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:56.356146 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.359615 15556 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:56.360646 15556 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:56.360738 22850 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.361138 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.361836 22850 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:56.413219 22799 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.413806 22799 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:56.422673 22799 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:07:56.425065 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "6ff41728dec842afad5b53c20446a5a0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d225833a2cbf4a5995fdbbb1292d1918" is_pre_election: true
I20260709 13:07:56.430675 15592 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff41728dec842afad5b53c20446a5a0 in term 21.
W20260709 13:07:56.428987 16146 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:56.438962 16145 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:56.444574 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.445272 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:56.445989 16145 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.447649 22799 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:56.588896 16145 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:56.658200 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.663988 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.664608 15556 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:56.710987 14293 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15539)
W20260709 13:07:56.715250 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:56.728711 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:56.763029 22799 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.763677 22799 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:56.765782 22799 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:07:56.769578 22850 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.770169 22850 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:56.772228 22850 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:56.778053 16145 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:56.778812 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.778836 16146 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:56.780531 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.781291 22799 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:56.788270 15556 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:56.789225 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.789669 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.790953 22850 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:56.814749 22850 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:56.815366 22850 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:56.822515 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:56.823294 22850 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:56.834726 15556 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:56.839064 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:56.842104 22849 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:57.023624 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.059674 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.101984 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:57.186336 22854 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:57.187634 22854 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:57.190871 22854 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:57.205691 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:57.206785 15556 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:57.207304 15556 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:57.208253 22854 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:57.264564 22854 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:57.265797 22854 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:57.290380 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:57.291352 22854 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:57.312096 15556 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:57.312676 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:57.321552 22849 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:57.354957 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:57.379653 22849 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:57.380610 22849 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:57.393776 16145 consensus_peers.cc:597] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:57.384757 22849 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:57.402705 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:57.416576 15556 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:57.417661 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:57.428278 22849 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:57.431340 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.489857 15555 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:57.548934 15555 consensus_peers.cc:597] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:57.554512 22854 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:57.555336 22854 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:57.557945 22854 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:57.578141 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.581527 15556 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:57.597020 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:57.597611 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:07:57.612011 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:57.614521 22849 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:57.618381 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.658699 15555 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:57.659708 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.689349 15555 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:57.712340 14293 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15539)
W20260709 13:07:57.713248 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.722186 15555 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:57.738487 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.747310 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.782861 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.882151 15555 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:57.905735 16145 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:57.916873 15555 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:57.935002 15555 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.034386 16145 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.130790 15555 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.143996 15555 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.150574 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.156343 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:58.230182 16145 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.246135 15555 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.263970 16145 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.264639 16145 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.279299 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.337702 15555 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.340482 15555 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.342208 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.420843 15555 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:58.454839 15556 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:58.489462 16145 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:58.520628 22807 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:58.521536 22807 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:58.524165 22807 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:58.548542 16145 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:58.549559 16146 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:58.550020 16146 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:58.553485 22855 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:58.573309 22849 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:58.574151 22849 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:58.577451 22849 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:07:58.589527 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:58.602600 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:07:58.603832 16181 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
W20260709 13:07:58.610241 15556 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:58.612793 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:58.619563 22854 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:58.644088 16145 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:58.688023 22849 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:58.688733 22849 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:58.690933 22849 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:58.705884 15555 consensus_peers.cc:597] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:58.706494 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:58.708207 16145 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.712957 14293 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 15539)
W20260709 13:07:58.711992 15556 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.731679 16145 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.779992 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:58.771163 16145 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:58.804602 15556 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:58.805235 15556 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:58.818384 22849 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:58.889882 22849 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:58.890686 22849 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:58.892998 22849 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:58.898088 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:58.905944 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:58.974774 15556 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:58.978173 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:58.981745 22858 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:58.999220 16145 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:59.031877 15556 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:59.042318 16145 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:59.051004 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.131776 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.149019 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.181268 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.268554 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:59.342350 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:59.423683 22862 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:59.424432 22862 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:59.426787 22862 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:59.441365 15556 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:59.451952 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:59.453306 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:59.456277 22862 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:59.464362 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:59.584519 22862 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:59.585246 22862 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:07:59.587509 22862 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:59.604852 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:59.605979 15556 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:59.606477 15556 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:59.608481 22858 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:59.627998 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.631805 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:59.693668 22855 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:59.694648 22855 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:59.697669 22855 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:59.712090 16146 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:07:59.717680 14293 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 15539)
W20260709 13:07:59.719653 16145 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:07:59.721772 16145 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:59.725864 22859 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:59.797151 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:59.849406 22859 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:59.850169 22859 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:07:59.852694 22859 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:07:59.870030 16145 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:07:59.871209 16146 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:07:59.872689 16146 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:07:59.884141 22859 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:59.944252 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:59.978914 22862 raft_consensus.cc:493] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:07:59.979925 22862 raft_consensus.cc:515] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:07:59.990618 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.997388 15556 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:00.005293 22862 leader_election.cc:290] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:00.018911 16145 consensus_peers.cc:597] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:00.020527 22849 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:00.021281 22849 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:00.024067 22849 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:00.036820 15556 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:00.097400 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.144080 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.144753 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:00.243986 22858 raft_consensus.cc:493] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:00.244729 22858 raft_consensus.cc:515] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:08:00.253110 15556 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:00.256318 22855 raft_consensus.cc:493] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:00.257926 22855 raft_consensus.cc:515] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:00.263093 22862 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:00.264278 22862 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:08:00.266160 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:00.268013 22858 leader_election.cc:290] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:08:00.271071 22855 leader_election.cc:290] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:00.274490 16145 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:00.267232 22862 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:00.276705 16146 leader_election.cc:336] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:00.280300 16146 leader_election.cc:304] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:00.281262 22855 raft_consensus.cc:2749] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:00.288242 15556 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:00.320142 16145 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.358771 16145 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.372593 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.426800 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.491346 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:00.499781 22864 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:00.500566 22864 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:08:00.516049 16145 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:00.519039 22864 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:00.519779 16146 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:00.521664 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:00.523937 22864 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:00.608889 16145 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.713853 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:00.718894 14293 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 15539)
W20260709 13:08:00.731276 16145 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.741299 15555 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.767279 15555 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.768154 15555 leader_election.cc:336] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:00.769418 15555 leader_election.cc:304] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:00.772018 22858 raft_consensus.cc:2749] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:00.772226 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:00.772822 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:00.773619 22858 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:00.773959 15555 consensus_peers.cc:597] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.779146 15555 leader_election.cc:336] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:00.780735 15555 leader_election.cc:304] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:00.786262 22858 raft_consensus.cc:2749] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:00.787480 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:00.788020 15555 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:00.788863 22858 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:00.815446 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:00.847805 15555 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.893721 15555 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.905130 15555 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:00.905428 22862 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:00.906343 22862 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:00.909252 22862 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:00.916374 15556 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:00.918841 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:00.919778 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:00.920789 22862 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:08:00.932695 16145 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:00.975381 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:01.013134 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.169660 16145 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.182730 15556 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:01.204298 16145 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.238363 15555 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.253237 16145 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.257323 15556 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.285442 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.288712 15555 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.308347 15556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111) [suppressed 585 similar messages]
W20260709 13:08:01.316411 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.344152 15555 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:01.370975 22858 raft_consensus.cc:493] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:01.371964 22858 raft_consensus.cc:515] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:01.378394 22858 leader_election.cc:290] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:01.379940 15556 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:01.380848 15555 leader_election.cc:336] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:01.381258 15555 leader_election.cc:304] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:01.382030 22858 raft_consensus.cc:2749] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:01.389294 15556 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.404888 15555 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:01.411026 22858 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:01.411731 22858 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:01.414927 22858 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:01.421875 15556 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:01.429725 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:01.430851 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:01.432047 22862 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:01.445258 22858 raft_consensus.cc:493] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:01.446082 22858 raft_consensus.cc:515] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } attrs { replace: true } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:08:01.447228 16145 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.459920 15556 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:01.460870 22858 leader_election.cc:290] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), 6ff41728dec842afad5b53c20446a5a0 (127.13.245.68:33529)
W20260709 13:08:01.492534 16145 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:01.507229 16174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d5db06e4ec455f8b7755416957114a" candidate_uuid: "d225833a2cbf4a5995fdbbb1292d1918" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6ff41728dec842afad5b53c20446a5a0" is_pre_election: true
I20260709 13:08:01.508096 16174 raft_consensus.cc:2468] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d225833a2cbf4a5995fdbbb1292d1918 in term 21.
W20260709 13:08:01.517428 16145 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.525487 15555 leader_election.cc:336] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:01.530879 15556 leader_election.cc:304] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0, d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:01.532248 22858 raft_consensus.cc:2749] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:01.545248 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:01.565928 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.565928 15555 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:01.568279 22858 raft_consensus.cc:493] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:01.568945 22858 raft_consensus.cc:515] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:01.573378 22858 leader_election.cc:290] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:01.578060 15555 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:01.579764 15556 leader_election.cc:336] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:01.580925 15556 leader_election.cc:304] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:01.582677 22862 raft_consensus.cc:2749] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:01.601344 15555 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:01.621256 22858 raft_consensus.cc:493] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:01.622430 22858 raft_consensus.cc:515] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:01.625378 22858 leader_election.cc:290] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:01.630214 15555 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:01.661163 15556 leader_election.cc:336] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:01.661739 15556 leader_election.cc:304] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:01.663467 22858 raft_consensus.cc:2749] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:01.683386 15555 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.695421 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.720269 14293 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 15539)
W20260709 13:08:01.721118 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.732960 16145 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.749596 15555 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:01.792359 15555 consensus_peers.cc:597] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:01.819835 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:01.819291 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:01.830354 22855 raft_consensus.cc:493] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:01.831090 22855 raft_consensus.cc:515] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:08:01.835052 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.842557 16146 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:01.843659 22855 leader_election.cc:290] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:01.843762 16145 leader_election.cc:336] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:01.844345 16145 leader_election.cc:304] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:01.845448 22855 raft_consensus.cc:2749] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:01.954917 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:01.985380 22858 raft_consensus.cc:493] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:01.986096 22858 raft_consensus.cc:515] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:08:01.995221 15556 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:01.997107 22858 leader_election.cc:290] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:02.009824 15555 leader_election.cc:336] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:02.011518 15555 leader_election.cc:304] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:02.017364 22858 raft_consensus.cc:2749] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:02.255362 22862 raft_consensus.cc:493] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:02.256026 22862 raft_consensus.cc:515] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:08:02.269609 15555 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:02.270902 15556 leader_election.cc:336] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:02.272536 15556 leader_election.cc:304] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:02.273972 22858 raft_consensus.cc:2749] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:02.272014 22862 leader_election.cc:290] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:02.294602 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.344497 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.401955 15556 consensus_peers.cc:597] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.404352 16145 consensus_peers.cc:597] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:02.427490 22868 raft_consensus.cc:493] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:02.428158 22868 raft_consensus.cc:515] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:02.430902 22868 leader_election.cc:290] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:02.436650 15555 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:02.440457 15556 leader_election.cc:336] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:02.441128 15556 leader_election.cc:304] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:02.442181 22862 raft_consensus.cc:2749] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:02.496610 22862 raft_consensus.cc:493] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:02.497189 22862 raft_consensus.cc:515] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:02.499354 22862 leader_election.cc:290] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:02.513816 15556 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:02.522182 15555 leader_election.cc:336] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:02.522847 15555 leader_election.cc:304] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:02.524875 22862 raft_consensus.cc:2749] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:08:02.548954 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.549695 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.661338 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:02.720883 14293 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 15539)
W20260709 13:08:02.759294 16145 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:02.843672 15555 consensus_peers.cc:597] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:02.869714 15556 consensus_peers.cc:597] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.871182 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:02.942260 22862 raft_consensus.cc:493] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:02.942938 22862 raft_consensus.cc:515] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:02.945883 22862 leader_election.cc:290] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:02.951800 15555 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:02.980288 16145 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.007081 15555 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.031715 15556 leader_election.cc:336] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:03.034984 15556 leader_election.cc:304] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:03.038753 22862 raft_consensus.cc:2749] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:03.040529 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:03.065364 16145 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.106356 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:03.194962 15556 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:03.213521 15556 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:03.266816 22858 raft_consensus.cc:493] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:03.391126 22858 raft_consensus.cc:515] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:03.394243 22858 leader_election.cc:290] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:03.500765 15556 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:03.527568 22862 raft_consensus.cc:493] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:03.528455 22862 raft_consensus.cc:515] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
W20260709 13:08:03.533795 15555 leader_election.cc:336] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:03.537415 15555 leader_election.cc:304] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:03.541445 22871 raft_consensus.cc:2749] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:03.531312 22862 leader_election.cc:290] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:03.563024 15556 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:03.564591 15555 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.569315 15555 leader_election.cc:336] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:03.570549 15555 leader_election.cc:304] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
W20260709 13:08:03.572561 15555 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:03.573119 22878 raft_consensus.cc:2749] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:03.597885 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.598580 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:03.599822 16145 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.610719 16145 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.664335 15555 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.681599 15555 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.698127 15556 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:03.745846 15555 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.756763 15555 consensus_peers.cc:597] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.938283 15555 consensus_peers.cc:597] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:03.960165 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.992151 15556 consensus_peers.cc:597] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.995000 16145 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:03.998996 15555 consensus_peers.cc:597] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.000406 16145 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.018565 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:04.022792 16145 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.031968 15556 consensus_peers.cc:597] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.062582 16145 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.090354 15556 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.091125 15556 consensus_peers.cc:597] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:04.097852 15555 consensus_peers.cc:597] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.120021 16145 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.154987 16145 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.165571 15555 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.178249 15556 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:04.207698 15555 consensus_peers.cc:597] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.225483 15372 debug-util.cc:398] Leaking SignalData structure 0x7b0800376020 after lost signal to thread 14296
W20260709 13:08:04.227028 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2a60 after lost signal to thread 15375
W20260709 13:08:04.228628 15372 debug-util.cc:398] Leaking SignalData structure 0x7b080012dd60 after lost signal to thread 15616
W20260709 13:08:04.230075 15372 debug-util.cc:398] Leaking SignalData structure 0x7b08002cc2e0 after lost signal to thread 16206
I20260709 13:08:04.271723 14293 tablet_server.cc:196] TabletServer@127.13.245.66:0 shutdown complete.
W20260709 13:08:04.336066 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:04.380015 15556 consensus_peers.cc:597] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.456499 15556 consensus_peers.cc:597] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.544137 15555 consensus_peers.cc:597] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.570369 16145 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:04.622610 15556 consensus_peers.cc:597] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.652087 15555 consensus_peers.cc:597] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:04.659112 16146 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:04.675427 22868 raft_consensus.cc:493] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:04.676119 22868 raft_consensus.cc:515] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:04.678700 22868 leader_election.cc:290] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:04.688921 15556 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:04.703634 15555 leader_election.cc:336] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:04.706038 15555 leader_election.cc:304] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:04.706969 22868 raft_consensus.cc:2749] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:04.711809 15326 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 61555.9us
W20260709 13:08:04.715376 15326 catalog_manager.cc:4755] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 423df90a9f55438bbe1c32ab906c6e10: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:04.735095 14293 tablet_server.cc:179] TabletServer@127.13.245.67:0 shutting down...
W20260709 13:08:04.765908 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:04.791738 16146 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:04.819380 15556 consensus_peers.cc:597] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.865721 15556 consensus_peers.cc:597] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.867587 16146 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.902164 22870 raft_consensus.cc:493] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:04.902894 22870 raft_consensus.cc:515] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } }
I20260709 13:08:04.904379 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:04.908128 14293 tablet_replica.cc:333] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:08:04.911859 15556 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:04.912684 14293 raft_consensus.cc:2243] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.913784 14293 raft_consensus.cc:2272] T d8f193cb849d4553a3e9a29aa592583a P d225833a2cbf4a5995fdbbb1292d1918 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:04.914510 15555 leader_election.cc:336] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:04.915009 15555 leader_election.cc:304] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d225833a2cbf4a5995fdbbb1292d1918; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:04.915902 22886 raft_consensus.cc:2749] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:04.916265 22870 leader_election.cc:290] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:08:04.921070 14293 tablet_replica.cc:333] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:04.927882 14293 raft_consensus.cc:2243] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.928714 14293 raft_consensus.cc:2272] T 567ba2de2d424a60ae555fb26b4de59b P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:04.932446 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.943657 14293 tablet_replica.cc:333] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:04.945068 14293 raft_consensus.cc:2243] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.947413 14293 raft_consensus.cc:2272] T badc8a91586140ab8a3903619efbd8c9 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.952181 14293 tablet_replica.cc:333] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:04.953259 14293 raft_consensus.cc:2243] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.955404 14293 raft_consensus.cc:2272] T a2e2091b55004aafb70a88703ef6fbfc P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.962566 14293 tablet_replica.cc:333] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:08:04.964231 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.969507 14293 raft_consensus.cc:2243] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.971031 14293 raft_consensus.cc:2272] T b48cca7667444b8c8bb999a280076795 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:04.971691 16146 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.976094 14293 tablet_replica.cc:333] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:08:04.976663 16146 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.992587 14293 raft_consensus.cc:2243] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.995950 14293 raft_consensus.cc:2272] T 41cabc9d5f694971847d85f82e81df84 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:04.997259 16146 consensus_peers.cc:597] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.001284 14293 tablet_replica.cc:333] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.002532 14293 raft_consensus.cc:2243] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.003649 14293 raft_consensus.cc:2272] T 58702c00fb4641ec8337a916d4579ec9 P d225833a2cbf4a5995fdbbb1292d1918 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.003711 16146 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.007470 14293 tablet_replica.cc:333] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.013971 14293 raft_consensus.cc:2243] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.015991 14293 raft_consensus.cc:2272] T 6555b0b9d1524fdcbea2216e3e879bba P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.022485 14293 tablet_replica.cc:333] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.026476 14293 raft_consensus.cc:2243] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.027350 14293 raft_consensus.cc:2272] T 82533161d7894b3db9b0230e076936b2 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.036149 16146 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.037947 14293 tablet_replica.cc:333] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.046156 14293 raft_consensus.cc:2243] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.047098 14293 raft_consensus.cc:2272] T 222e5d29fb564b08bdca15f666c0c986 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.051189 14293 tablet_replica.cc:333] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.054279 14293 raft_consensus.cc:2243] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:08:05.055197 15556 consensus_peers.cc:597] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:05.055744 14293 raft_consensus.cc:2272] T 1fcd0644c7dd431aa808e206e7ea031e P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.065542 14293 tablet_replica.cc:333] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.066648 14293 raft_consensus.cc:2243] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:05.067066 16146 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.069898 14293 raft_consensus.cc:2272] T 8dc152f2e639487986baac02b0324f06 P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.081671 14293 tablet_replica.cc:333] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.088173 14293 raft_consensus.cc:2243] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.091394 14293 raft_consensus.cc:2272] T 0af1111c429c4e6fad608ff1eeac116b P d225833a2cbf4a5995fdbbb1292d1918 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.094784 14293 tablet_replica.cc:333] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:08:05.102985 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.106086 14293 raft_consensus.cc:2243] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.107126 14293 raft_consensus.cc:2272] T 9178296553b44a3f82267d1278be3746 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.110129 14293 tablet_replica.cc:333] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.110988 14293 raft_consensus.cc:2243] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.111932 14293 raft_consensus.cc:2272] T 4e0fd3f0f29d4b4abb27cd04e5ce1113 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.114817 14293 tablet_replica.cc:333] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.118559 14293 raft_consensus.cc:2243] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.119679 14293 raft_consensus.cc:2272] T d40d294abeec453098d547799a79f7c5 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.122598 14293 tablet_replica.cc:333] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.123489 14293 raft_consensus.cc:2243] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.124161 14293 raft_consensus.cc:2272] T 952f15e68b0745e5a8ca26a3b527cab0 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.129868 14293 tablet_replica.cc:333] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.130788 14293 raft_consensus.cc:2243] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.131443 14293 raft_consensus.cc:2272] T 562c25b8842b442a928630e10d13e618 P d225833a2cbf4a5995fdbbb1292d1918 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.134765 14293 tablet_replica.cc:333] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:08:05.140479 16146 consensus_peers.cc:597] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:05.141893 14293 raft_consensus.cc:2243] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.143159 22882 raft_consensus.cc:493] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:05.143458 14293 raft_consensus.cc:2272] T 35e9ed1641e04cbfb3dfb6d3b9c4fd5f P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.143858 22882 raft_consensus.cc:515] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:05.146785 22882 leader_election.cc:290] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:05.163968 16146 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:05.174527 16145 leader_election.cc:336] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:05.175076 16145 leader_election.cc:304] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:05.177302 22882 raft_consensus.cc:2749] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:05.176082 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.191876 16146 consensus_peers.cc:597] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.194583 14293 tablet_replica.cc:333] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.195650 14293 raft_consensus.cc:2243] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.196866 14293 raft_consensus.cc:2272] T 08f534c2cc884d65b268a74636da80eb P d225833a2cbf4a5995fdbbb1292d1918 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.210505 14293 tablet_replica.cc:333] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:08:05.230286 16146 consensus_peers.cc:597] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:05.234877 14293 raft_consensus.cc:2243] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.242695 14293 raft_consensus.cc:2272] T 327bd8cd50304a9e89be009f16906be3 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.246210 14293 tablet_replica.cc:333] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.247263 14293 raft_consensus.cc:2243] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.248054 14293 raft_consensus.cc:2272] T e3f17bb405a44393bd7aacc1097a7a13 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.251225 14293 tablet_replica.cc:333] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.252259 14293 raft_consensus.cc:2243] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.253314 14293 raft_consensus.cc:2272] T 4152881cdccb4731a3bd4a47c960307b P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.265602 16146 consensus_peers.cc:597] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 -> Peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Couldn't send request to peer d225833a2cbf4a5995fdbbb1292d1918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.266904 16145 consensus_peers.cc:597] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:05.294557 14293 tablet_replica.cc:333] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.296900 14293 raft_consensus.cc:2243] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.299118 14293 raft_consensus.cc:2272] T 4f8c57ead024481e8882a1b97814f799 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.324716 14293 tablet_replica.cc:333] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.375850 14293 raft_consensus.cc:2243] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.399924 14293 raft_consensus.cc:2272] T 423df90a9f55438bbe1c32ab906c6e10 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.403304 14293 tablet_replica.cc:333] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.412295 14293 raft_consensus.cc:2243] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.413836 14293 raft_consensus.cc:2272] T 5b97fcd3d908482fadc6fa54e513304d P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.417130 14293 tablet_replica.cc:333] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.418103 14293 raft_consensus.cc:2243] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.418975 14293 raft_consensus.cc:2272] T f87e12456fed4de1b2d723da6cc14d3a P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.419220 15556 consensus_peers.cc:597] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.464241 16145 consensus_peers.cc:597] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:05.469686 14293 tablet_replica.cc:333] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.470705 14293 raft_consensus.cc:2243] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.472118 14293 raft_consensus.cc:2272] T 75927b236d9342309d9e8c7a6a9b2f95 P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.475062 14293 tablet_replica.cc:333] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.496026 14293 raft_consensus.cc:2243] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.504709 14293 raft_consensus.cc:2272] T f8071c427f08433d8ffd6bd0809b1076 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.508134 14293 tablet_replica.cc:333] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.509145 14293 raft_consensus.cc:2243] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.510200 14293 raft_consensus.cc:2272] T bee09de23aee40d689e3f0426ed38fc1 P d225833a2cbf4a5995fdbbb1292d1918 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.513310 14293 tablet_replica.cc:333] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.526521 22887 raft_consensus.cc:493] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:05.532418 14293 raft_consensus.cc:2243] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.533057 22887 raft_consensus.cc:515] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:05.533967 14293 raft_consensus.cc:2272] T 3782fb71a4794032bbb7124248fc9b05 P d225833a2cbf4a5995fdbbb1292d1918 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.537253 14293 tablet_replica.cc:333] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.538137 14293 raft_consensus.cc:2243] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.538698 14293 raft_consensus.cc:2272] T 1fdfe2cf7f6141b9b4378a2f1f915fc5 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.540761 16145 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
I20260709 13:08:05.543735 22887 leader_election.cc:290] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
W20260709 13:08:05.548257 16146 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:05.557619 14293 tablet_replica.cc:333] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.558651 14293 raft_consensus.cc:2243] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.559890 14293 raft_consensus.cc:2272] T 77b747e7ea77471f95bf6fbb4eb03bab P d225833a2cbf4a5995fdbbb1292d1918 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.563624 14293 tablet_replica.cc:333] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:08:05.578186 15555 consensus_peers.cc:597] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:05.580291 14293 raft_consensus.cc:2243] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.581488 14293 raft_consensus.cc:2272] T 07d5db06e4ec455f8b7755416957114a P d225833a2cbf4a5995fdbbb1292d1918 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.590294 14293 tablet_replica.cc:333] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.591256 14293 raft_consensus.cc:2243] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.591986 14293 raft_consensus.cc:2272] T dc4f3caf80c04c18bd2d225b9e630e92 P d225833a2cbf4a5995fdbbb1292d1918 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.594825 14293 tablet_replica.cc:333] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.604195 14293 raft_consensus.cc:2243] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.605281 14293 raft_consensus.cc:2272] T a6c6411adf9842fc9281582ab8b1842c P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.618700 14293 tablet_replica.cc:333] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.619741 14293 raft_consensus.cc:2243] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.628604 14293 raft_consensus.cc:2272] T 4a8042e01976403089e7b30f1a5b5740 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.631700 14293 tablet_replica.cc:333] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.632649 14293 raft_consensus.cc:2243] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.640498 14293 raft_consensus.cc:2272] T 27b4902277e34c9f97dd7889ac3f8375 P d225833a2cbf4a5995fdbbb1292d1918 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.643884 14293 tablet_replica.cc:333] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
W20260709 13:08:05.606894 16146 leader_election.cc:336] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:05.651888 16146 leader_election.cc:304] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:05.652933 22884 raft_consensus.cc:2749] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:05.654008 16146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:36757, user_credentials={real_user=slave}} blocked reactor thread for 47137.9us
I20260709 13:08:05.664072 14293 raft_consensus.cc:2243] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.672101 14293 raft_consensus.cc:2272] T 65c950883b754dd6bb39c54f8c8134aa P d225833a2cbf4a5995fdbbb1292d1918 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.675096 16146 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:05.728883 14293 tablet_replica.cc:333] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.730026 14293 raft_consensus.cc:2243] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.730834 14293 raft_consensus.cc:2272] T 534703c18f76440380b33b80bf77802e P d225833a2cbf4a5995fdbbb1292d1918 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.734216 14293 tablet_replica.cc:333] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.735203 14293 raft_consensus.cc:2243] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.736622 14293 raft_consensus.cc:2272] T 46abb05486504a60be4a4d104d3295f7 P d225833a2cbf4a5995fdbbb1292d1918 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.739403 14293 tablet_replica.cc:333] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.740350 14293 raft_consensus.cc:2243] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.741902 14293 raft_consensus.cc:2272] T bb9e1d3b1096451da3fea10491454092 P d225833a2cbf4a5995fdbbb1292d1918 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.744612 14293 tablet_replica.cc:333] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.745395 14293 raft_consensus.cc:2243] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.746580 14293 raft_consensus.cc:2272] T 8e5602b415c44c2486bba85d5cbf2ec5 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.749744 14293 tablet_replica.cc:333] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.750524 14293 raft_consensus.cc:2243] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.751287 14293 raft_consensus.cc:2272] T 4adf54c918c8432f819a78622c9d46bc P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.755164 14293 tablet_replica.cc:333] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.756011 14293 raft_consensus.cc:2243] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.757233 14293 raft_consensus.cc:2272] T ae531d3e35db41bc9f66769323b94372 P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.760444 14293 tablet_replica.cc:333] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.761333 14293 raft_consensus.cc:2243] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.762096 14293 raft_consensus.cc:2272] T ff30e083feaf42a3aca56510e7fe367a P d225833a2cbf4a5995fdbbb1292d1918 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.766928 14293 tablet_replica.cc:333] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.768807 14293 raft_consensus.cc:2243] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.770409 14293 raft_consensus.cc:2272] T 894134e9e1614272b87adbf47e180cdb P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.773388 14293 tablet_replica.cc:333] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.774353 14293 raft_consensus.cc:2243] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.774925 14293 raft_consensus.cc:2272] T f2b019444ffb4533ac4eb7baefd96ae7 P d225833a2cbf4a5995fdbbb1292d1918 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.777844 14293 tablet_replica.cc:333] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918: stopping tablet replica
I20260709 13:08:05.778486 14293 raft_consensus.cc:2243] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.780314 14293 raft_consensus.cc:2272] T 790046238f9f42cfa9d478a7ed4f2e21 P d225833a2cbf4a5995fdbbb1292d1918 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.798372 16145 consensus_peers.cc:597] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:05.802721 16145 consensus_peers.cc:597] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:05.816362 16145 consensus_peers.cc:597] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:06.008984 16145 consensus_peers.cc:597] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:06.062633 16146 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:06.074488 16146 consensus_peers.cc:597] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:06.305869 16145 consensus_peers.cc:597] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:06.316550 16146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111) [suppressed 560 similar messages]
W20260709 13:08:06.398967 16145 consensus_peers.cc:597] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:06.425691 22887 raft_consensus.cc:493] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:08:06.426348 22887 raft_consensus.cc:515] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:06.428611 22887 leader_election.cc:290] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
I20260709 13:08:06.435491 22884 raft_consensus.cc:493] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:08:06.436162 22884 raft_consensus.cc:515] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } attrs { replace: true } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
W20260709 13:08:06.438192 16146 leader_election.cc:336] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:06.438941 22884 leader_election.cc:290] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:08:06.439280 16146 leader_election.cc:336] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Network error: Client connection negotiation failed: client connection to 127.13.245.67:37005: connect: Connection refused (error 111)
I20260709 13:08:06.441706 16146 leader_election.cc:304] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:08:06.442451 22884 raft_consensus.cc:2749] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:06.446950 16146 consensus_peers.cc:597] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:06.446888 16145 leader_election.cc:336] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:06.451045 16146 leader_election.cc:336] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:06.451440 16146 leader_election.cc:304] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:06.452201 22884 raft_consensus.cc:2749] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:06.452256 16146 leader_election.cc:336] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Network error: Client connection negotiation failed: client connection to 127.13.245.67:37005: connect: Connection refused (error 111)
I20260709 13:08:06.473081 22887 raft_consensus.cc:493] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:08:06.473712 22887 raft_consensus.cc:515] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:06.476092 22887 leader_election.cc:290] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:08:06.482813 16146 leader_election.cc:336] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:06.483476 16146 leader_election.cc:336] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Network error: Client connection negotiation failed: client connection to 127.13.245.67:37005: connect: Connection refused (error 111)
I20260709 13:08:06.483876 16146 leader_election.cc:304] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:08:06.484643 22887 raft_consensus.cc:2749] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:06.498129 22887 raft_consensus.cc:493] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:08:06.498761 22887 raft_consensus.cc:515] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:06.500932 22887 leader_election.cc:290] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:08:06.507325 16145 consensus_peers.cc:597] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:06.511794 16145 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:06.513082 16146 leader_election.cc:336] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Network error: Client connection negotiation failed: client connection to 127.13.245.67:37005: connect: Connection refused (error 111)
I20260709 13:08:06.513510 16146 leader_election.cc:304] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:08:06.514349 22887 raft_consensus.cc:2749] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:06.563699 22887 raft_consensus.cc:493] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:08:06.564409 22887 raft_consensus.cc:515] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:06.566970 22887 leader_election.cc:290] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:08:06.572376 16146 leader_election.cc:336] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Network error: Client connection negotiation failed: client connection to 127.13.245.67:37005: connect: Connection refused (error 111)
W20260709 13:08:06.573130 16146 leader_election.cc:336] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:06.573591 16146 leader_election.cc:304] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:08:06.574347 22887 raft_consensus.cc:2749] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:06.575557 22887 raft_consensus.cc:493] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:08:06.576031 22887 raft_consensus.cc:515] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:06.578392 22887 leader_election.cc:290] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:08:06.584697 16146 leader_election.cc:336] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
W20260709 13:08:06.585444 16146 leader_election.cc:336] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Network error: Client connection negotiation failed: client connection to 127.13.245.67:37005: connect: Connection refused (error 111)
I20260709 13:08:06.586136 16146 leader_election.cc:304] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:08:06.586947 22884 raft_consensus.cc:2749] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:06.663221 16145 consensus_peers.cc:597] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:06.665805 16145 consensus_peers.cc:597] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:06.676597 22884 raft_consensus.cc:493] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8a55534dc8864943937d5b6ec0e6aaf9)
I20260709 13:08:06.677121 14293 tablet_server.cc:196] TabletServer@127.13.245.67:0 shutdown complete.
I20260709 13:08:06.677258 22884 raft_consensus.cc:515] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:06.678402 22887 raft_consensus.cc:493] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:08:06.679579 22884 leader_election.cc:290] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291)
I20260709 13:08:06.679077 22887 raft_consensus.cc:515] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ccb2e30f44f40c2b22339e1d4c74a83" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 36757 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:06.683136 22887 leader_election.cc:290] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:08:06.693248 16145 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:06.695264 16146 leader_election.cc:336] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Network error: Client connection negotiation failed: client connection to 127.13.245.67:37005: connect: Connection refused (error 111)
W20260709 13:08:06.696128 16146 leader_election.cc:336] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:06.696558 16146 leader_election.cc:304] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, 8a55534dc8864943937d5b6ec0e6aaf9
I20260709 13:08:06.697414 22887 raft_consensus.cc:2749] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:06.697577 16146 leader_election.cc:336] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:06.698186 16146 leader_election.cc:304] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 5ccb2e30f44f40c2b22339e1d4c74a83, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:08:06.698956 22887 raft_consensus.cc:2749] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:06.716991 16146 consensus_peers.cc:597] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): Couldn't send request to peer 5ccb2e30f44f40c2b22339e1d4c74a83. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:06.734359 16145 consensus_peers.cc:597] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 -> Peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Couldn't send request to peer 8a55534dc8864943937d5b6ec0e6aaf9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:06.757997 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08003999c0 after lost signal to thread 14296
W20260709 13:08:06.759464 16203 debug-util.cc:398] Leaking SignalData structure 0x7b0800104cc0 after lost signal to thread 15375
W20260709 13:08:06.760224 16203 debug-util.cc:398] Leaking SignalData structure 0x7b08003be800 after lost signal to thread 15616
W20260709 13:08:06.761651 16203 debug-util.cc:398] Leaking SignalData structure 0x7b0800222ce0 after lost signal to thread 16206
I20260709 13:08:06.804965 14293 tablet_server.cc:179] TabletServer@127.13.245.68:0 shutting down...
I20260709 13:08:06.829704 22887 raft_consensus.cc:493] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d225833a2cbf4a5995fdbbb1292d1918)
I20260709 13:08:06.830601 22887 raft_consensus.cc:515] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8a55534dc8864943937d5b6ec0e6aaf9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34291 } } peers { permanent_uuid: "d225833a2cbf4a5995fdbbb1292d1918" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 37005 } } peers { permanent_uuid: "6ff41728dec842afad5b53c20446a5a0" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 33529 } attrs { promote: false } }
I20260709 13:08:06.842620 22887 leader_election.cc:290] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291), d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005)
W20260709 13:08:06.848110 16145 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8a55534dc8864943937d5b6ec0e6aaf9 (127.13.245.66:34291): Network error: Client connection negotiation failed: client connection to 127.13.245.66:34291: connect: Connection refused (error 111)
W20260709 13:08:06.860221 16146 leader_election.cc:336] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d225833a2cbf4a5995fdbbb1292d1918 (127.13.245.67:37005): Network error: Client connection negotiation failed: client connection to 127.13.245.67:37005: connect: Connection refused (error 111)
I20260709 13:08:06.863210 16146 leader_election.cc:304] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff41728dec842afad5b53c20446a5a0; no voters: 8a55534dc8864943937d5b6ec0e6aaf9, d225833a2cbf4a5995fdbbb1292d1918
I20260709 13:08:06.867384 22892 raft_consensus.cc:2749] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:06.903296 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:06.904455 14293 tablet_replica.cc:333] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.905655 14293 raft_consensus.cc:2243] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.906548 14293 raft_consensus.cc:2272] T a2e2091b55004aafb70a88703ef6fbfc P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.910223 14293 tablet_replica.cc:333] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.911311 14293 raft_consensus.cc:2243] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.912258 14293 raft_consensus.cc:2272] T 423df90a9f55438bbe1c32ab906c6e10 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.915603 14293 tablet_replica.cc:333] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.916535 14293 raft_consensus.cc:2243] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.918190 14293 raft_consensus.cc:2272] T 4f8c57ead024481e8882a1b97814f799 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.921875 14293 tablet_replica.cc:333] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.922865 14293 raft_consensus.cc:2243] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.923664 14293 raft_consensus.cc:2272] T f91e9b24450f4bc88be5be6228d8587f P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.926934 14293 tablet_replica.cc:333] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.927919 14293 raft_consensus.cc:2243] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.929394 14293 raft_consensus.cc:2272] T bb9e1d3b1096451da3fea10491454092 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.932789 14293 tablet_replica.cc:333] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.933640 14293 raft_consensus.cc:2243] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.935003 14293 raft_consensus.cc:2272] T ff30e083feaf42a3aca56510e7fe367a P 6ff41728dec842afad5b53c20446a5a0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.938503 14293 tablet_replica.cc:333] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.939409 14293 raft_consensus.cc:2243] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.940114 14293 raft_consensus.cc:2272] T f012dbeed0364c8195192ae55ff12fef P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.943578 14293 tablet_replica.cc:333] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.944471 14293 raft_consensus.cc:2243] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.945212 14293 raft_consensus.cc:2272] T 75927b236d9342309d9e8c7a6a9b2f95 P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.948256 14293 tablet_replica.cc:333] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.949120 14293 raft_consensus.cc:2243] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.949823 14293 raft_consensus.cc:2272] T 5b97fcd3d908482fadc6fa54e513304d P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.953238 14293 tablet_replica.cc:333] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.954152 14293 raft_consensus.cc:2243] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.955320 14293 raft_consensus.cc:2272] T 952f15e68b0745e5a8ca26a3b527cab0 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.958505 14293 tablet_replica.cc:333] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.959393 14293 raft_consensus.cc:2243] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.960191 14293 raft_consensus.cc:2272] T 07d5db06e4ec455f8b7755416957114a P 6ff41728dec842afad5b53c20446a5a0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.963455 14293 tablet_replica.cc:333] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.964313 14293 raft_consensus.cc:2243] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.965481 14293 raft_consensus.cc:2272] T 77b747e7ea77471f95bf6fbb4eb03bab P 6ff41728dec842afad5b53c20446a5a0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.968493 14293 tablet_replica.cc:333] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.969322 14293 raft_consensus.cc:2243] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.970542 14293 raft_consensus.cc:2272] T 8dc152f2e639487986baac02b0324f06 P 6ff41728dec842afad5b53c20446a5a0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.973716 14293 tablet_replica.cc:333] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.974529 14293 raft_consensus.cc:2243] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.975194 14293 raft_consensus.cc:2272] T c098e199a9c74c79bc225b7ce9d73ff4 P 6ff41728dec842afad5b53c20446a5a0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.978404 14293 tablet_replica.cc:333] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.979206 14293 raft_consensus.cc:2243] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.979889 14293 raft_consensus.cc:2272] T 41cabc9d5f694971847d85f82e81df84 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.982867 14293 tablet_replica.cc:333] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.983755 14293 raft_consensus.cc:2243] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.984690 14293 raft_consensus.cc:2272] T 27b4902277e34c9f97dd7889ac3f8375 P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.988067 14293 tablet_replica.cc:333] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.989056 14293 raft_consensus.cc:2243] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.990166 14293 raft_consensus.cc:2272] T 65c950883b754dd6bb39c54f8c8134aa P 6ff41728dec842afad5b53c20446a5a0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.993074 14293 tablet_replica.cc:333] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.993804 14293 raft_consensus.cc:2243] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.994730 14293 raft_consensus.cc:2272] T 66d8364b020b43deb510a118a19d076a P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.997597 14293 tablet_replica.cc:333] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:06.998409 14293 raft_consensus.cc:2243] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:06.999718 14293 raft_consensus.cc:2272] T 562c25b8842b442a928630e10d13e618 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.003170 14293 tablet_replica.cc:333] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.004014 14293 raft_consensus.cc:2243] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.004616 14293 raft_consensus.cc:2272] T 653fb1b09eaf49f98c8993fbea783b3d P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.007714 14293 tablet_replica.cc:333] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.008572 14293 raft_consensus.cc:2243] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.009296 14293 raft_consensus.cc:2272] T b48cca7667444b8c8bb999a280076795 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.012307 14293 tablet_replica.cc:333] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.013062 14293 raft_consensus.cc:2243] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.014220 14293 raft_consensus.cc:2272] T dc4f3caf80c04c18bd2d225b9e630e92 P 6ff41728dec842afad5b53c20446a5a0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.017406 14293 tablet_replica.cc:333] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.018292 14293 raft_consensus.cc:2243] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.019418 14293 raft_consensus.cc:2272] T 3b48413efda34be880a83df9e239fb3c P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.052057 14293 tablet_replica.cc:333] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.055807 14293 raft_consensus.cc:2243] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.060235 14293 raft_consensus.cc:2272] T 1915fdd81d344a749443e48f07a1fef8 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.066159 14293 tablet_replica.cc:333] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.068215 14293 raft_consensus.cc:2243] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.071610 14293 raft_consensus.cc:2272] T 496a555ec7cc49798fc4d775f6d151ed P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.075798 14293 tablet_replica.cc:333] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.076978 14293 raft_consensus.cc:2243] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.079438 14293 raft_consensus.cc:2272] T a42725e017f142629708ff226f2d53e1 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.083652 14293 tablet_replica.cc:333] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.084390 14293 raft_consensus.cc:2243] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.087020 14293 raft_consensus.cc:2272] T 4152881cdccb4731a3bd4a47c960307b P 6ff41728dec842afad5b53c20446a5a0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.091259 14293 tablet_replica.cc:333] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.092507 14293 raft_consensus.cc:2243] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.093727 14293 raft_consensus.cc:2272] T 790046238f9f42cfa9d478a7ed4f2e21 P 6ff41728dec842afad5b53c20446a5a0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.099189 14293 tablet_replica.cc:333] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.100111 14293 raft_consensus.cc:2243] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.102041 14293 raft_consensus.cc:2272] T f2b019444ffb4533ac4eb7baefd96ae7 P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.104959 14293 tablet_replica.cc:333] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.106027 14293 raft_consensus.cc:2243] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.107501 14293 raft_consensus.cc:2272] T f8071c427f08433d8ffd6bd0809b1076 P 6ff41728dec842afad5b53c20446a5a0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.111491 14293 tablet_replica.cc:333] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.112448 14293 raft_consensus.cc:2243] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.114601 14293 raft_consensus.cc:2272] T d8f193cb849d4553a3e9a29aa592583a P 6ff41728dec842afad5b53c20446a5a0 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.118268 14293 tablet_replica.cc:333] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.119387 14293 raft_consensus.cc:2243] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.122454 14293 raft_consensus.cc:2272] T 58702c00fb4641ec8337a916d4579ec9 P 6ff41728dec842afad5b53c20446a5a0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.126349 14293 tablet_replica.cc:333] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.127128 14293 raft_consensus.cc:2243] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.130167 14293 raft_consensus.cc:2272] T a6c6411adf9842fc9281582ab8b1842c P 6ff41728dec842afad5b53c20446a5a0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.134773 14293 tablet_replica.cc:333] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0: stopping tablet replica
I20260709 13:08:07.135391 14293 raft_consensus.cc:2243] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.137372 14293 raft_consensus.cc:2272] T ba3252dd04824c9ca1c0b6dfd9c7c387 P 6ff41728dec842afad5b53c20446a5a0 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:08.242304 14293 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16203)
I20260709 13:08:08.464278 14293 tablet_server.cc:196] TabletServer@127.13.245.68:0 shutdown complete.
I20260709 13:08:08.566177 14293 master.cc:562] Master@127.13.245.126:46019 shutting down...
W20260709 13:08:08.611073 15389 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:08:08.611393 15389 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:08.611656 15389 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:21.122808 15326 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111) [suppressed 72 similar messages]
W20260709 13:08:21.126796 15326 catalog_manager.cc:4755] TS 5ccb2e30f44f40c2b22339e1d4c74a83 (127.13.245.65:36757): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 423df90a9f55438bbe1c32ab906c6e10: Network error: Client connection negotiation failed: client connection to 127.13.245.65:36757: connect: Connection refused (error 111)
I20260709 13:08:22.233076 14293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.234387 14293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.234858 14293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7478e1667cd24e1eb33dcbc8ac104877: stopping tablet replica
I20260709 13:08:22.447258 14293 master.cc:584] Master@127.13.245.126:46019 shutdown complete.
I20260709 13:08:22.512315 14293 test_util.cc:182] -----------------------------------------------
I20260709 13:08:22.512626 14293 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602214968311-14293-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (261081 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:08:22.516908 14293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.245.126:41123
I20260709 13:08:22.518241 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:22.524665 22898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.524919 22899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.526461 22901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.527498 14293 server_base.cc:1061] running on GCE node
I20260709 13:08:22.532022 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:22.532256 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:22.532447 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602502532430 us; error 0 us; skew 500 ppm
I20260709 13:08:22.533113 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:22.536072 14293 webserver.cc:533] Webserver started at http://127.13.245.126:42037/ using document root <none> and password file <none>
I20260709 13:08:22.536640 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:22.536849 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:22.537142 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:22.538849 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/master-0-root/instance:
uuid: "4aac5866e908499a855c1dc99c268744"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:22.544126 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:08:22.548072 22906 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.548897 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:08:22.549226 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/master-0-root
uuid: "4aac5866e908499a855c1dc99c268744"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:22.549538 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:22.569936 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:22.571419 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:22.618037 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.126:41123
I20260709 13:08:22.618139 22957 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.126:41123 every 8 connection(s)
I20260709 13:08:22.622891 22958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:22.635499 22958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744: Bootstrap starting.
I20260709 13:08:22.641304 22958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.646101 22958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744: No bootstrap required, opened a new log
I20260709 13:08:22.648670 22958 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aac5866e908499a855c1dc99c268744" member_type: VOTER }
I20260709 13:08:22.649153 22958 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.649335 22958 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aac5866e908499a855c1dc99c268744, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.649978 22958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aac5866e908499a855c1dc99c268744" member_type: VOTER }
I20260709 13:08:22.650450 22958 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:22.650665 22958 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:22.650892 22958 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.656582 22958 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aac5866e908499a855c1dc99c268744" member_type: VOTER }
I20260709 13:08:22.657120 22958 leader_election.cc:304] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aac5866e908499a855c1dc99c268744; no voters: 
I20260709 13:08:22.658288 22958 leader_election.cc:290] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:22.658787 22961 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.660410 22961 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 1 LEADER]: Becoming Leader. State: Replica: 4aac5866e908499a855c1dc99c268744, State: Running, Role: LEADER
I20260709 13:08:22.661087 22961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aac5866e908499a855c1dc99c268744" member_type: VOTER }
I20260709 13:08:22.661666 22958 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:22.669281 22963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aac5866e908499a855c1dc99c268744. Latest consensus state: current_term: 1 leader_uuid: "4aac5866e908499a855c1dc99c268744" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aac5866e908499a855c1dc99c268744" member_type: VOTER } }
I20260709 13:08:22.669445 22962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4aac5866e908499a855c1dc99c268744" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aac5866e908499a855c1dc99c268744" member_type: VOTER } }
I20260709 13:08:22.670253 22963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:22.670329 22962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:22.672381 22971 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:22.677640 22971 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:22.679101 14293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:22.687026 22971 catalog_manager.cc:1383] Generated new cluster ID: 448a17289648418680eb10ef4c18d8ae
I20260709 13:08:22.687326 22971 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:22.714181 22971 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:22.715751 22971 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:22.733814 22971 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744: Generated new TSK 0
I20260709 13:08:22.734552 22971 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:22.746891 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:22.754567 22979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.755571 22980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.758162 22982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.758735 14293 server_base.cc:1061] running on GCE node
I20260709 13:08:22.761102 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:22.761348 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:22.761565 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602502761531 us; error 0 us; skew 500 ppm
I20260709 13:08:22.762236 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:22.765413 14293 webserver.cc:533] Webserver started at http://127.13.245.65:34909/ using document root <none> and password file <none>
I20260709 13:08:22.766009 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:22.766219 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:22.766525 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:22.768018 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/instance:
uuid: "164704f999554466a68662962540809e"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:22.773474 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:08:22.777746 22987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.778605 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:22.778913 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "164704f999554466a68662962540809e"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:22.779273 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:22.797431 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:22.799024 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:22.800843 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:22.803642 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:22.803871 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.804149 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:22.804327 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.852643 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:41281
I20260709 13:08:22.852757 23049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:41281 every 8 connection(s)
I20260709 13:08:22.858687 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:22.866817 23054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.869346 23055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.870492 23057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.872611 14293 server_base.cc:1061] running on GCE node
I20260709 13:08:22.873030 23050 heartbeater.cc:344] Connected to a master server at 127.13.245.126:41123
I20260709 13:08:22.873494 23050 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:22.874609 23050 heartbeater.cc:507] Master 127.13.245.126:41123 requested a full tablet report, sending...
I20260709 13:08:22.876488 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:22.876748 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:22.876945 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602502876922 us; error 0 us; skew 500 ppm
I20260709 13:08:22.877439 22923 ts_manager.cc:194] Registered new tserver with Master: 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:22.877660 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:22.879904 22923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46872
I20260709 13:08:22.880921 14293 webserver.cc:533] Webserver started at http://127.13.245.66:38971/ using document root <none> and password file <none>
I20260709 13:08:22.881662 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:22.881932 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:22.882227 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:22.883811 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/instance:
uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:22.888640 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:08:22.892675 23062 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.893478 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:08:22.893810 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-1-root
uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:22.894111 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:22.906423 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:22.907903 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:22.909570 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:22.912168 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:22.912385 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.912676 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:22.912813 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.961865 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.66:44151
I20260709 13:08:22.962003 23124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.66:44151 every 8 connection(s)
I20260709 13:08:22.967834 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:22.976373 23128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.977484 23129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.980643 14293 server_base.cc:1061] running on GCE node
W20260709 13:08:22.981953 23131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.982856 23125 heartbeater.cc:344] Connected to a master server at 127.13.245.126:41123
I20260709 13:08:22.983215 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:08:22.983263 23125 heartbeater.cc:461] Registering TS with master...
W20260709 13:08:22.983647 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:22.983906 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602502983889 us; error 0 us; skew 500 ppm
I20260709 13:08:22.984411 23125 heartbeater.cc:507] Master 127.13.245.126:41123 requested a full tablet report, sending...
I20260709 13:08:22.984525 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:22.987046 22923 ts_manager.cc:194] Registered new tserver with Master: 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:22.987931 14293 webserver.cc:533] Webserver started at http://127.13.245.67:38235/ using document root <none> and password file <none>
I20260709 13:08:22.988672 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:22.988936 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:22.989272 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:22.989192 22923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46886
I20260709 13:08:22.991196 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/instance:
uuid: "bb8204df5095446cb973e600aa7696bf"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:22.996353 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:08:23.000499 23136 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:23.001332 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:08:23.001636 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-2-root
uuid: "bb8204df5095446cb973e600aa7696bf"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:23.001963 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:23.025810 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:23.027357 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:23.029166 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:23.031899 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:23.032151 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:23.032416 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:23.032639 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:23.083882 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.67:43419
I20260709 13:08:23.084014 23198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.67:43419 every 8 connection(s)
I20260709 13:08:23.089592 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:23.100116 23202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:23.100278 23203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:23.104549 14293 server_base.cc:1061] running on GCE node
I20260709 13:08:23.104562 23199 heartbeater.cc:344] Connected to a master server at 127.13.245.126:41123
I20260709 13:08:23.105278 23199 heartbeater.cc:461] Registering TS with master...
W20260709 13:08:23.105396 23206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:23.106395 23199 heartbeater.cc:507] Master 127.13.245.126:41123 requested a full tablet report, sending...
I20260709 13:08:23.106511 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:23.106979 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:23.107210 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602503107186 us; error 0 us; skew 500 ppm
I20260709 13:08:23.108053 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:23.108858 22923 ts_manager.cc:194] Registered new tserver with Master: bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:23.110422 22923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46900
I20260709 13:08:23.111274 14293 webserver.cc:533] Webserver started at http://127.13.245.68:34517/ using document root <none> and password file <none>
I20260709 13:08:23.111991 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:23.112217 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:23.112501 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:23.113883 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-3-root/instance:
uuid: "86f6c62fa9a94b679e852571485aa293"
format_stamp: "Formatted at 2026-07-09 13:08:23 on dist-test-slave-fc6v"
I20260709 13:08:23.118914 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:08:23.122691 23210 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:23.123728 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:08:23.124017 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-3-root
uuid: "86f6c62fa9a94b679e852571485aa293"
format_stamp: "Formatted at 2026-07-09 13:08:23 on dist-test-slave-fc6v"
I20260709 13:08:23.124290 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:23.163949 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:23.165428 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:23.166886 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:23.169752 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:23.169971 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:23.170277 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:23.170456 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:23.226819 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.68:44019
I20260709 13:08:23.226883 23272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.68:44019 every 8 connection(s)
I20260709 13:08:23.243786 23273 heartbeater.cc:344] Connected to a master server at 127.13.245.126:41123
I20260709 13:08:23.244273 23273 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:23.245167 23273 heartbeater.cc:507] Master 127.13.245.126:41123 requested a full tablet report, sending...
I20260709 13:08:23.247771 22923 ts_manager.cc:194] Registered new tserver with Master: 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:23.248723 14293 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017889254s
I20260709 13:08:23.249490 22923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46916
I20260709 13:08:23.279773 22923 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46922:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:08:23.549300 23015 tablet_service.cc:1511] Processing CreateTablet for tablet 7798deb16e0346c697b7b8e23415d63b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:23.551059 23015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7798deb16e0346c697b7b8e23415d63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.557601 23014 tablet_service.cc:1511] Processing CreateTablet for tablet 0056709a01f04a2da19e224ab0d378a1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:23.559370 23014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0056709a01f04a2da19e224ab0d378a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.559842 23013 tablet_service.cc:1511] Processing CreateTablet for tablet ca470edbc9134307a2189c750afa9f07 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:23.561372 23013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca470edbc9134307a2189c750afa9f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.562716 23238 tablet_service.cc:1511] Processing CreateTablet for tablet 7798deb16e0346c697b7b8e23415d63b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:23.563110 23237 tablet_service.cc:1511] Processing CreateTablet for tablet ca470edbc9134307a2189c750afa9f07 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:23.564327 23238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7798deb16e0346c697b7b8e23415d63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.571228 23236 tablet_service.cc:1511] Processing CreateTablet for tablet 56145698faa64689af33cb5ae7097cb1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:23.572929 23236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56145698faa64689af33cb5ae7097cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.576408 23235 tablet_service.cc:1511] Processing CreateTablet for tablet 217dc40b82664779b71b4261b1337e80 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:23.577920 23235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217dc40b82664779b71b4261b1337e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.579037 23011 tablet_service.cc:1511] Processing CreateTablet for tablet 217dc40b82664779b71b4261b1337e80 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:23.580809 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217dc40b82664779b71b4261b1337e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.581091 23012 tablet_service.cc:1511] Processing CreateTablet for tablet da902f60c2e24fd5806973f54afb6318 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:23.581285 23164 tablet_service.cc:1511] Processing CreateTablet for tablet 0056709a01f04a2da19e224ab0d378a1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:23.582695 23012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da902f60c2e24fd5806973f54afb6318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.583048 23164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0056709a01f04a2da19e224ab0d378a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.585290 23089 tablet_service.cc:1511] Processing CreateTablet for tablet 0056709a01f04a2da19e224ab0d378a1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:23.586941 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0056709a01f04a2da19e224ab0d378a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.589972 23163 tablet_service.cc:1511] Processing CreateTablet for tablet ca470edbc9134307a2189c750afa9f07 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:23.589987 23087 tablet_service.cc:1511] Processing CreateTablet for tablet da902f60c2e24fd5806973f54afb6318 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:23.591722 23163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca470edbc9134307a2189c750afa9f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.592093 23087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da902f60c2e24fd5806973f54afb6318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.567234 23090 tablet_service.cc:1511] Processing CreateTablet for tablet 7798deb16e0346c697b7b8e23415d63b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:23.597133 23090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7798deb16e0346c697b7b8e23415d63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.597839 23162 tablet_service.cc:1511] Processing CreateTablet for tablet 56145698faa64689af33cb5ae7097cb1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:23.599390 23162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56145698faa64689af33cb5ae7097cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.569166 23088 tablet_service.cc:1511] Processing CreateTablet for tablet 56145698faa64689af33cb5ae7097cb1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:23.600826 23088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56145698faa64689af33cb5ae7097cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.603685 23234 tablet_service.cc:1511] Processing CreateTablet for tablet d923431752a8412fb70574e65cdb555e (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:23.606719 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d923431752a8412fb70574e65cdb555e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.611701 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca470edbc9134307a2189c750afa9f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.611522 23161 tablet_service.cc:1511] Processing CreateTablet for tablet da902f60c2e24fd5806973f54afb6318 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:23.613054 23161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da902f60c2e24fd5806973f54afb6318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.610920 23086 tablet_service.cc:1511] Processing CreateTablet for tablet 217dc40b82664779b71b4261b1337e80 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:23.617527 23086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217dc40b82664779b71b4261b1337e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.617271 23010 tablet_service.cc:1511] Processing CreateTablet for tablet d923431752a8412fb70574e65cdb555e (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:23.617841 23160 tablet_service.cc:1511] Processing CreateTablet for tablet d923431752a8412fb70574e65cdb555e (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:23.624905 23010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d923431752a8412fb70574e65cdb555e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.625094 23160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d923431752a8412fb70574e65cdb555e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.686484 23294 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:23.690037 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb649bdf39d4f11b38e2a5246a82b28 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:23.692394 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb649bdf39d4f11b38e2a5246a82b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.698809 23293 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
W20260709 13:08:23.699839 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:23.702518 23159 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb649bdf39d4f11b38e2a5246a82b28 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:23.724782 23159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb649bdf39d4f11b38e2a5246a82b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.706928 23009 tablet_service.cc:1511] Processing CreateTablet for tablet b0c538e12e094914a765975898fe54e1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:23.728485 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c538e12e094914a765975898fe54e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.711270 23084 tablet_service.cc:1511] Processing CreateTablet for tablet b0c538e12e094914a765975898fe54e1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:23.730120 23084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c538e12e094914a765975898fe54e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.730842 23293 tablet_bootstrap.cc:654] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.715739 23158 tablet_service.cc:1511] Processing CreateTablet for tablet b0c538e12e094914a765975898fe54e1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:23.722074 23238 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb649bdf39d4f11b38e2a5246a82b28 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:23.733067 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c538e12e094914a765975898fe54e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.744577 23233 tablet_service.cc:1511] Processing CreateTablet for tablet 41361b7bb5d44f2ba006fb10f2c275d8 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:23.745779 23008 tablet_service.cc:1511] Processing CreateTablet for tablet 41361b7bb5d44f2ba006fb10f2c275d8 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:23.746263 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41361b7bb5d44f2ba006fb10f2c275d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.747313 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41361b7bb5d44f2ba006fb10f2c275d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.718860 23294 tablet_bootstrap.cc:654] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.785790 23083 tablet_service.cc:1511] Processing CreateTablet for tablet 41361b7bb5d44f2ba006fb10f2c275d8 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:23.787369 23083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41361b7bb5d44f2ba006fb10f2c275d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.788183 23160 tablet_service.cc:1511] Processing CreateTablet for tablet dadbc16bab774234818801bd6d29d63f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:23.789148 23238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb649bdf39d4f11b38e2a5246a82b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.789551 23160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadbc16bab774234818801bd6d29d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.803810 23296 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:23.812438 23296 tablet_bootstrap.cc:654] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.822489 23295 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:23.824151 23294 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:23.824076 23011 tablet_service.cc:1511] Processing CreateTablet for tablet dadbc16bab774234818801bd6d29d63f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:23.824877 23294 ts_tablet_manager.cc:1403] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.008s
I20260709 13:08:23.828634 23236 tablet_service.cc:1511] Processing CreateTablet for tablet dadbc16bab774234818801bd6d29d63f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:23.842358 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadbc16bab774234818801bd6d29d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.845230 23236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadbc16bab774234818801bd6d29d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.853945 23085 tablet_service.cc:1511] Processing CreateTablet for tablet ab6a41e225bf43a8a84737c4cedbbff9 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:23.855324 23161 tablet_service.cc:1511] Processing CreateTablet for tablet ab6a41e225bf43a8a84737c4cedbbff9 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:23.856019 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6a41e225bf43a8a84737c4cedbbff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.856776 23161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6a41e225bf43a8a84737c4cedbbff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.864420 23233 tablet_service.cc:1511] Processing CreateTablet for tablet ab6a41e225bf43a8a84737c4cedbbff9 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:23.866392 23159 tablet_service.cc:1511] Processing CreateTablet for tablet 9cddaae9615745fc941db7ae1a92044f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:23.869561 23159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cddaae9615745fc941db7ae1a92044f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.870419 23090 tablet_service.cc:1511] Processing CreateTablet for tablet 9cddaae9615745fc941db7ae1a92044f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:23.871942 23090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cddaae9615745fc941db7ae1a92044f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.879515 23237 tablet_service.cc:1511] Processing CreateTablet for tablet 31a6c80cc6f84dbbafe4921c5a9a2bd5 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:23.880174 23293 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:23.880465 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6a41e225bf43a8a84737c4cedbbff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.880816 23293 ts_tablet_manager.cc:1403] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.183s	user 0.010s	sys 0.016s
I20260709 13:08:23.881171 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a6c80cc6f84dbbafe4921c5a9a2bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.882241 23012 tablet_service.cc:1511] Processing CreateTablet for tablet 31a6c80cc6f84dbbafe4921c5a9a2bd5 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:23.883731 23012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a6c80cc6f84dbbafe4921c5a9a2bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.883672 23050 heartbeater.cc:499] Master 127.13.245.126:41123 was elected leader, sending a full tablet report...
I20260709 13:08:23.886096 23293 raft_consensus.cc:359] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:23.886922 23293 raft_consensus.cc:385] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.887243 23293 raft_consensus.cc:740] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.888710 23294 raft_consensus.cc:359] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:23.919111 23294 raft_consensus.cc:385] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.890437 23008 tablet_service.cc:1511] Processing CreateTablet for tablet 9cddaae9615745fc941db7ae1a92044f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:23.920439 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cddaae9615745fc941db7ae1a92044f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.899425 23295 tablet_bootstrap.cc:654] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.919482 23294 raft_consensus.cc:740] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.924592 23294 consensus_queue.cc:260] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:23.929966 23296 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:23.930627 23296 ts_tablet_manager.cc:1403] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.127s	user 0.008s	sys 0.012s
I20260709 13:08:23.913220 23161 tablet_service.cc:1511] Processing CreateTablet for tablet f02c6bae4c084ae98cc464607f90c24b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:23.914628 23234 tablet_service.cc:1511] Processing CreateTablet for tablet f02c6bae4c084ae98cc464607f90c24b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:23.934716 23161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02c6bae4c084ae98cc464607f90c24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.935062 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02c6bae4c084ae98cc464607f90c24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.900261 23088 tablet_service.cc:1511] Processing CreateTablet for tablet 31a6c80cc6f84dbbafe4921c5a9a2bd5 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:23.938107 23088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a6c80cc6f84dbbafe4921c5a9a2bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.937435 23293 consensus_queue.cc:260] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:23.953315 23273 heartbeater.cc:499] Master 127.13.245.126:41123 was elected leader, sending a full tablet report...
I20260709 13:08:23.954007 23295 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:23.954618 23295 ts_tablet_manager.cc:1403] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.003s
I20260709 13:08:23.956753 23089 tablet_service.cc:1511] Processing CreateTablet for tablet d5bb24234c374237ae3cfd67bca1c794 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:23.958309 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bb24234c374237ae3cfd67bca1c794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.959053 23158 tablet_service.cc:1511] Processing CreateTablet for tablet d5bb24234c374237ae3cfd67bca1c794 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:23.960743 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bb24234c374237ae3cfd67bca1c794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.960963 23293 ts_tablet_manager.cc:1434] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 13:08:23.962477 23293 tablet_bootstrap.cc:492] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:23.976827 23294 ts_tablet_manager.cc:1434] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.117s	user 0.014s	sys 0.001s
I20260709 13:08:23.977916 23294 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:23.978551 23296 raft_consensus.cc:359] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:23.978722 23295 raft_consensus.cc:359] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:23.979498 23295 raft_consensus.cc:385] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.979876 23295 raft_consensus.cc:740] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.980866 23009 tablet_service.cc:1511] Processing CreateTablet for tablet f02c6bae4c084ae98cc464607f90c24b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:23.980935 23295 consensus_queue.cc:260] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:23.979425 23296 raft_consensus.cc:385] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.982398 23296 raft_consensus.cc:740] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
W20260709 13:08:23.982525 23274 tablet.cc:2406] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:23.990103 23233 tablet_service.cc:1511] Processing CreateTablet for tablet d5bb24234c374237ae3cfd67bca1c794 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:24.006778 23125 heartbeater.cc:499] Master 127.13.245.126:41123 was elected leader, sending a full tablet report...
I20260709 13:08:24.008303 23294 tablet_bootstrap.cc:654] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.991691 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bb24234c374237ae3cfd67bca1c794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.991533 23295 ts_tablet_manager.cc:1434] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.013s
I20260709 13:08:24.013023 23295 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:23.998929 23296 consensus_queue.cc:260] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.020202 23293 tablet_bootstrap.cc:654] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.999742 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02c6bae4c084ae98cc464607f90c24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.028503 23011 tablet_service.cc:1511] Processing CreateTablet for tablet 43a804057f5f4d50bb94ce2f719a663a (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:24.030347 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a804057f5f4d50bb94ce2f719a663a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.030625 23295 tablet_bootstrap.cc:654] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.047037 23089 tablet_service.cc:1511] Processing CreateTablet for tablet 43a804057f5f4d50bb94ce2f719a663a (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:24.049031 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a804057f5f4d50bb94ce2f719a663a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.053071 23199 heartbeater.cc:499] Master 127.13.245.126:41123 was elected leader, sending a full tablet report...
I20260709 13:08:24.053403 23296 ts_tablet_manager.cc:1434] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.122s	user 0.014s	sys 0.007s
I20260709 13:08:24.055779 23303 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.056538 23303 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:24.063627 23293 tablet_bootstrap.cc:492] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:24.064400 23293 ts_tablet_manager.cc:1403] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.012s
I20260709 13:08:24.073889 23233 tablet_service.cc:1511] Processing CreateTablet for tablet 76f52067e0764d909423286098ad3c7c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:24.075477 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f52067e0764d909423286098ad3c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.075726 23296 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:24.078065 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 76f52067e0764d909423286098ad3c7c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:24.081411 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f52067e0764d909423286098ad3c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.081502 23012 tablet_service.cc:1511] Processing CreateTablet for tablet 76f52067e0764d909423286098ad3c7c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:24.082940 23012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f52067e0764d909423286098ad3c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.084419 23234 tablet_service.cc:1511] Processing CreateTablet for tablet 161f6ffe19a04f97acb85cc3152a8234 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:24.085841 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161f6ffe19a04f97acb85cc3152a8234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.087821 23295 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:24.088452 23295 ts_tablet_manager.cc:1403] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.005s
I20260709 13:08:24.078351 23159 tablet_service.cc:1511] Processing CreateTablet for tablet 161f6ffe19a04f97acb85cc3152a8234 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:24.091799 23295 raft_consensus.cc:359] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.092691 23161 tablet_service.cc:1511] Processing CreateTablet for tablet 43a804057f5f4d50bb94ce2f719a663a (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:24.098024 23295 raft_consensus.cc:385] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.098507 23295 raft_consensus.cc:740] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.112187 23159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161f6ffe19a04f97acb85cc3152a8234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.120915 23161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a804057f5f4d50bb94ce2f719a663a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.121889 23294 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:24.122426 23294 ts_tablet_manager.cc:1403] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.145s	user 0.018s	sys 0.018s
I20260709 13:08:24.126175 23294 raft_consensus.cc:359] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.127444 23294 raft_consensus.cc:385] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.127899 23294 raft_consensus.cc:740] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.129236 23294 consensus_queue.cc:260] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.139155 23296 tablet_bootstrap.cc:654] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.141600 23294 ts_tablet_manager.cc:1434] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:08:24.142278 23295 consensus_queue.cc:260] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.073803 23303 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:24.152196 23012 tablet_service.cc:1511] Processing CreateTablet for tablet 161f6ffe19a04f97acb85cc3152a8234 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:24.153880 23012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161f6ffe19a04f97acb85cc3152a8234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.158109 23158 tablet_service.cc:1511] Processing CreateTablet for tablet 481244be0dff49389d585c9e9c8d2384 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:24.160138 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481244be0dff49389d585c9e9c8d2384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.159842 23088 tablet_service.cc:1511] Processing CreateTablet for tablet 481244be0dff49389d585c9e9c8d2384 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:24.161976 23088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481244be0dff49389d585c9e9c8d2384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.172485 23304 raft_consensus.cc:493] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.173164 23304 raft_consensus.cc:515] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.173884 23293 raft_consensus.cc:359] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:24.174659 23293 raft_consensus.cc:385] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.174952 23293 raft_consensus.cc:740] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.175273 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:24.176311 23304 leader_election.cc:290] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:24.177698 23064 leader_election.cc:343] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.178423 23301 raft_consensus.cc:493] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.180068 23295 ts_tablet_manager.cc:1434] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.091s	user 0.015s	sys 0.001s
I20260709 13:08:24.178959 23301 raft_consensus.cc:515] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.189429 23294 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:24.200469 23295 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:24.196398 23293 consensus_queue.cc:260] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:24.212567 23293 ts_tablet_manager.cc:1434] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.148s	user 0.003s	sys 0.007s
I20260709 13:08:24.213744 23293 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:24.196229 23301 leader_election.cc:290] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:24.227174 23238 tablet_service.cc:1511] Processing CreateTablet for tablet 481244be0dff49389d585c9e9c8d2384 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:24.229269 23238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481244be0dff49389d585c9e9c8d2384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.297724 23293 tablet_bootstrap.cc:654] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.293937 23089 tablet_service.cc:1511] Processing CreateTablet for tablet be29e709cce745f3b2421a0de2d75730 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:24.299160 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be29e709cce745f3b2421a0de2d75730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.318470 23295 tablet_bootstrap.cc:654] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.318971 23090 tablet_service.cc:1511] Processing CreateTablet for tablet 8054b94be5cf4afabdc62b1cb6550554 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:24.320429 23090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8054b94be5cf4afabdc62b1cb6550554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.290599 23237 tablet_service.cc:1511] Processing CreateTablet for tablet 8054b94be5cf4afabdc62b1cb6550554 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:24.323618 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8054b94be5cf4afabdc62b1cb6550554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.326630 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:24.328764 23063 leader_election.cc:343] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.329239 23063 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:24.330260 23312 raft_consensus.cc:2749] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.316540 23294 tablet_bootstrap.cc:654] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.342628 23011 tablet_service.cc:1511] Processing CreateTablet for tablet be29e709cce745f3b2421a0de2d75730 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:24.344594 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be29e709cce745f3b2421a0de2d75730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.347256 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca470edbc9134307a2189c750afa9f07" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:24.345897 23161 tablet_service.cc:1511] Processing CreateTablet for tablet 36e46155980a493dbdcd5686e8c81fd2 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:24.346645 23158 tablet_service.cc:1511] Processing CreateTablet for tablet be29e709cce745f3b2421a0de2d75730 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:24.354180 23012 tablet_service.cc:1511] Processing CreateTablet for tablet 8054b94be5cf4afabdc62b1cb6550554 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:24.355777 23012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8054b94be5cf4afabdc62b1cb6550554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.359453 23161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e46155980a493dbdcd5686e8c81fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.361166 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca470edbc9134307a2189c750afa9f07" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:24.361945 23025 raft_consensus.cc:2468] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:24.363214 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be29e709cce745f3b2421a0de2d75730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.362919 23233 tablet_service.cc:1511] Processing CreateTablet for tablet 36e46155980a493dbdcd5686e8c81fd2 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:24.364583 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e46155980a493dbdcd5686e8c81fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.366128 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 95cb3974c72b4e05a01a96155e84d50c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:24.370069 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95cb3974c72b4e05a01a96155e84d50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.370148 23138 leader_election.cc:304] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:24.371800 23304 raft_consensus.cc:2804] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.372244 23304 raft_consensus.cc:493] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.372661 23304 raft_consensus.cc:3060] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.374902 23296 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:24.380080 23296 ts_tablet_manager.cc:1403] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.305s	user 0.041s	sys 0.044s
I20260709 13:08:24.381768 23009 tablet_service.cc:1511] Processing CreateTablet for tablet 36e46155980a493dbdcd5686e8c81fd2 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:24.385298 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e46155980a493dbdcd5686e8c81fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.386350 23304 raft_consensus.cc:515] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.381904 23160 tablet_service.cc:1511] Processing CreateTablet for tablet 95cb3974c72b4e05a01a96155e84d50c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:24.388564 23160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95cb3974c72b4e05a01a96155e84d50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.395915 23234 tablet_service.cc:1511] Processing CreateTablet for tablet 95cb3974c72b4e05a01a96155e84d50c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:24.397646 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95cb3974c72b4e05a01a96155e84d50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.407131 23295 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:24.407815 23295 ts_tablet_manager.cc:1403] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.208s	user 0.013s	sys 0.020s
W20260709 13:08:24.381687 23140 leader_election.cc:343] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.411702 23302 raft_consensus.cc:493] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.412351 23302 raft_consensus.cc:515] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:24.412542 23008 tablet_service.cc:1511] Processing CreateTablet for tablet 0d68f7978d614f7e9d3dd87066f10091 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:24.413990 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d68f7978d614f7e9d3dd87066f10091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.416677 23302 leader_election.cc:290] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:24.423414 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:24.423766 23088 tablet_service.cc:1511] Processing CreateTablet for tablet 0d68f7978d614f7e9d3dd87066f10091 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:08:24.428002 22988 leader_election.cc:343] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.437201 23088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d68f7978d614f7e9d3dd87066f10091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.446166 23293 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:24.447058 23293 ts_tablet_manager.cc:1403] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.233s	user 0.018s	sys 0.003s
I20260709 13:08:24.428304 23302 raft_consensus.cc:493] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.451715 23302 raft_consensus.cc:515] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:24.476342 23302 leader_election.cc:290] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:24.478641 23295 raft_consensus.cc:359] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.484965 23295 raft_consensus.cc:385] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.485339 23295 raft_consensus.cc:740] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.485991 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:24.486281 23295 consensus_queue.cc:260] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:24.488240 22989 leader_election.cc:343] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.488824 22989 leader_election.cc:304] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:24.489470 23295 ts_tablet_manager.cc:1434] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.003s
I20260709 13:08:24.490209 23301 raft_consensus.cc:2749] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.490676 23295 tablet_bootstrap.cc:492] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:24.512153 23296 raft_consensus.cc:359] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.513182 23296 raft_consensus.cc:385] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.513533 23296 raft_consensus.cc:740] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.519523 23161 tablet_service.cc:1511] Processing CreateTablet for tablet 0d68f7978d614f7e9d3dd87066f10091 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:24.521270 23161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d68f7978d614f7e9d3dd87066f10091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.525346 23296 consensus_queue.cc:260] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.524475 23293 raft_consensus.cc:359] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.527418 23293 raft_consensus.cc:385] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.527804 23293 raft_consensus.cc:740] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.529440 23012 tablet_service.cc:1511] Processing CreateTablet for tablet d7c80de33300430e9f3578384080ff53 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:24.529487 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca470edbc9134307a2189c750afa9f07" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
W20260709 13:08:24.533890 23140 leader_election.cc:343] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.531353 23012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c80de33300430e9f3578384080ff53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.537220 23294 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:24.537904 23294 ts_tablet_manager.cc:1403] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.367s	user 0.020s	sys 0.023s
I20260709 13:08:24.541515 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca470edbc9134307a2189c750afa9f07" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:24.541757 23294 raft_consensus.cc:359] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:24.542270 23025 raft_consensus.cc:3060] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.542538 23294 raft_consensus.cc:385] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.542886 23294 raft_consensus.cc:740] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.543752 23304 leader_election.cc:290] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:24.545189 23090 tablet_service.cc:1511] Processing CreateTablet for tablet d7c80de33300430e9f3578384080ff53 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:24.546702 23090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c80de33300430e9f3578384080ff53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.543936 23293 consensus_queue.cc:260] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.553233 23159 tablet_service.cc:1511] Processing CreateTablet for tablet 7630566d5f604f289dbfa8aae3cabf2f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:24.554793 23159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7630566d5f604f289dbfa8aae3cabf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.557991 23293 ts_tablet_manager.cc:1434] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.111s	user 0.013s	sys 0.001s
I20260709 13:08:24.558445 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a73b5f8f04698bf33b4c6f5ffea8b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:24.559320 23293 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:24.561056 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a73b5f8f04698bf33b4c6f5ffea8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.566179 23009 tablet_service.cc:1511] Processing CreateTablet for tablet 7630566d5f604f289dbfa8aae3cabf2f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:24.568357 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7630566d5f604f289dbfa8aae3cabf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.577769 23163 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a73b5f8f04698bf33b4c6f5ffea8b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:24.580470 23163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a73b5f8f04698bf33b4c6f5ffea8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.580405 23025 raft_consensus.cc:2468] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:24.585161 23138 leader_election.cc:304] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:24.585635 23295 tablet_bootstrap.cc:654] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.586639 23304 raft_consensus.cc:2804] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.587124 23304 raft_consensus.cc:697] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:24.588074 23304 consensus_queue.cc:237] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.594712 23312 raft_consensus.cc:493] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.595309 23312 raft_consensus.cc:515] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.598001 23312 leader_election.cc:290] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:24.602936 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56145698faa64689af33cb5ae7097cb1" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:24.602631 23237 tablet_service.cc:1511] Processing CreateTablet for tablet d7c80de33300430e9f3578384080ff53 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:24.605222 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c80de33300430e9f3578384080ff53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:24.608559 23211 leader_election.cc:343] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.608986 23234 tablet_service.cc:1511] Processing CreateTablet for tablet 7630566d5f604f289dbfa8aae3cabf2f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:24.610430 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7630566d5f604f289dbfa8aae3cabf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.612461 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:24.614248 23064 leader_election.cc:343] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.573778 23294 consensus_queue.cc:260] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:24.616685 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:24.618487 23294 ts_tablet_manager.cc:1434] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.003s
I20260709 13:08:24.618011 23233 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a73b5f8f04698bf33b4c6f5ffea8b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:24.619818 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a73b5f8f04698bf33b4c6f5ffea8b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:24.619848 23066 leader_election.cc:343] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.622886 23066 leader_election.cc:304] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:24.623970 23008 tablet_service.cc:1511] Processing CreateTablet for tablet f061f1bc80274cada8b20297e47bd6f3 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:24.624493 23312 raft_consensus.cc:2749] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.625538 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f061f1bc80274cada8b20297e47bd6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.637621 23296 ts_tablet_manager.cc:1434] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.230s	user 0.010s	sys 0.025s
I20260709 13:08:24.639077 23296 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:24.649849 22921 catalog_manager.cc:5697] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.652696 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:24.656949 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56145698faa64689af33cb5ae7097cb1" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:24.656996 23089 tablet_service.cc:1511] Processing CreateTablet for tablet f061f1bc80274cada8b20297e47bd6f3 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:24.659204 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f061f1bc80274cada8b20297e47bd6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.659971 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:24.660720 23025 raft_consensus.cc:2468] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:24.669394 23295 tablet_bootstrap.cc:492] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:24.669870 23158 tablet_service.cc:1511] Processing CreateTablet for tablet f061f1bc80274cada8b20297e47bd6f3 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:24.676115 23295 ts_tablet_manager.cc:1403] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.013s
I20260709 13:08:24.686311 23012 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc9b7bc403743f781fa69a6b3b60b24 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:24.687891 23162 tablet_service.cc:1511] Processing CreateTablet for tablet 360366783c4b4b5f91f38c323f304f3a (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:24.689903 23012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc9b7bc403743f781fa69a6b3b60b24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:24.690387 23212 leader_election.cc:343] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.691170 23238 tablet_service.cc:1511] Processing CreateTablet for tablet 360366783c4b4b5f91f38c323f304f3a (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:24.692593 23238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360366783c4b4b5f91f38c323f304f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.674916 23293 tablet_bootstrap.cc:654] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.676573 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f061f1bc80274cada8b20297e47bd6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.671983 23294 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:24.693068 23090 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc9b7bc403743f781fa69a6b3b60b24 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:24.696947 23090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc9b7bc403743f781fa69a6b3b60b24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:24.691159 23212 leader_election.cc:343] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.699985 23162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360366783c4b4b5f91f38c323f304f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.704986 23233 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc9b7bc403743f781fa69a6b3b60b24 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:24.706430 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc9b7bc403743f781fa69a6b3b60b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.701689 23212 leader_election.cc:304] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:24.711603 23296 tablet_bootstrap.cc:654] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.704106 23294 tablet_bootstrap.cc:654] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.715943 23328 raft_consensus.cc:493] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.716918 23328 raft_consensus.cc:515] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.719461 23328 leader_election.cc:290] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:24.730784 23312 raft_consensus.cc:493] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.731393 23312 raft_consensus.cc:515] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.732295 23295 raft_consensus.cc:359] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:24.733114 23295 raft_consensus.cc:385] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.733419 23295 raft_consensus.cc:740] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.734233 23295 consensus_queue.cc:260] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:24.736339 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41361b7bb5d44f2ba006fb10f2c275d8" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:24.719693 23302 raft_consensus.cc:2749] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.740967 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41361b7bb5d44f2ba006fb10f2c275d8" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:24.743166 23066 leader_election.cc:343] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.743643 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:24.743809 23064 leader_election.cc:343] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.744339 23064 leader_election.cc:304] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:24.744642 23025 raft_consensus.cc:2468] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:24.749866 23293 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:24.750495 23293 ts_tablet_manager.cc:1403] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.191s	user 0.019s	sys 0.015s
W20260709 13:08:24.735656 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 44521.1us
I20260709 13:08:24.751411 23212 leader_election.cc:304] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:24.752518 23302 raft_consensus.cc:493] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.759390 23009 tablet_service.cc:1511] Processing CreateTablet for tablet 360366783c4b4b5f91f38c323f304f3a (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:24.760058 23302 raft_consensus.cc:515] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.760916 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360366783c4b4b5f91f38c323f304f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.766784 23302 leader_election.cc:290] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:24.767061 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 462ac7fd6cff4fa3ae2823a5c93a8c66 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:24.768504 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462ac7fd6cff4fa3ae2823a5c93a8c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.768476 23138 leader_election.cc:304] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:24.769480 23328 raft_consensus.cc:2804] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.769851 23328 raft_consensus.cc:493] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.770221 23328 raft_consensus.cc:3060] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.770301 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:24.767452 23302 raft_consensus.cc:2804] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.771692 23302 raft_consensus.cc:493] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.772136 23302 raft_consensus.cc:3060] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.745898 23312 leader_election.cc:290] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:24.782909 23211 leader_election.cc:343] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.804104 23312 raft_consensus.cc:2749] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:24.813295 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 62025.2us
I20260709 13:08:24.815016 23163 tablet_service.cc:1511] Processing CreateTablet for tablet 462ac7fd6cff4fa3ae2823a5c93a8c66 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:24.816444 23163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462ac7fd6cff4fa3ae2823a5c93a8c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.817720 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:24.821553 23237 tablet_service.cc:1511] Processing CreateTablet for tablet 462ac7fd6cff4fa3ae2823a5c93a8c66 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:24.822091 23293 raft_consensus.cc:359] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.822886 23293 raft_consensus.cc:385] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.822957 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462ac7fd6cff4fa3ae2823a5c93a8c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.824923 23294 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:24.825450 23294 ts_tablet_manager.cc:1403] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.154s	user 0.004s	sys 0.012s
I20260709 13:08:24.828748 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:24.830240 23296 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:24.830745 23296 ts_tablet_manager.cc:1403] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.192s	user 0.019s	sys 0.034s
W20260709 13:08:24.835850 23138 leader_election.cc:343] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:24.812968 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 69801.8us
I20260709 13:08:24.838227 23296 raft_consensus.cc:359] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.839040 23296 raft_consensus.cc:385] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.823272 23293 raft_consensus.cc:740] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.842851 23089 tablet_service.cc:1511] Processing CreateTablet for tablet 6e95d2f411234daa8343913c7fd7da28 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:24.851692 23296 raft_consensus.cc:740] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.844107 23012 tablet_service.cc:1511] Processing CreateTablet for tablet 6e95d2f411234daa8343913c7fd7da28 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:24.846133 23294 raft_consensus.cc:359] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.834390 23328 raft_consensus.cc:515] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.852694 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e95d2f411234daa8343913c7fd7da28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.852340 23293 consensus_queue.cc:260] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:24.855175 23294 raft_consensus.cc:385] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.857764 23162 tablet_service.cc:1511] Processing CreateTablet for tablet 6e95d2f411234daa8343913c7fd7da28 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:24.859205 23012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e95d2f411234daa8343913c7fd7da28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.860021 23328 leader_election.cc:290] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:24.863310 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:24.863965 23025 raft_consensus.cc:3060] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:24.860755 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:24.866391 23295 ts_tablet_manager.cc:1434] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.180s	user 0.014s	sys 0.016s
I20260709 13:08:24.867993 23293 ts_tablet_manager.cc:1434] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.117s	user 0.011s	sys 0.000s
I20260709 13:08:24.869138 23293 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:24.869611 23295 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:24.872861 23009 tablet_service.cc:1511] Processing CreateTablet for tablet 90401217dded44f3bbae100f43bd7c9d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:24.812157 23302 raft_consensus.cc:515] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
W20260709 13:08:24.877575 23212 leader_election.cc:343] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.877760 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:24.878167 23212 leader_election.cc:304] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:24.855137 23296 consensus_queue.cc:260] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:24.879370 23138 leader_election.cc:343] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.881242 23296 ts_tablet_manager.cc:1434] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:08:24.880807 23090 tablet_service.cc:1511] Processing CreateTablet for tablet 90401217dded44f3bbae100f43bd7c9d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:24.881476 23158 tablet_service.cc:1511] Processing CreateTablet for tablet 2433c50320714f4288969a94d5e1bf12 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:24.882372 23090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90401217dded44f3bbae100f43bd7c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.885031 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90401217dded44f3bbae100f43bd7c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.885730 23008 tablet_service.cc:1511] Processing CreateTablet for tablet 2433c50320714f4288969a94d5e1bf12 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:24.887147 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2433c50320714f4288969a94d5e1bf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.860363 23294 raft_consensus.cc:740] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.884956 23302 leader_election.cc:290] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:24.888537 23294 consensus_queue.cc:260] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.890708 23336 raft_consensus.cc:2749] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.891131 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2433c50320714f4288969a94d5e1bf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.894260 23025 raft_consensus.cc:2468] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:24.895592 23138 leader_election.cc:304] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:24.897284 23162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e95d2f411234daa8343913c7fd7da28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.898861 23328 raft_consensus.cc:2804] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.899433 23328 raft_consensus.cc:697] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:24.900405 23328 consensus_queue.cc:237] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.907843 23296 tablet_bootstrap.cc:492] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:24.909569 23238 tablet_service.cc:1511] Processing CreateTablet for tablet 2433c50320714f4288969a94d5e1bf12 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:24.910538 23233 tablet_service.cc:1511] Processing CreateTablet for tablet 90401217dded44f3bbae100f43bd7c9d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:24.912879 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
W20260709 13:08:24.915153 23212 leader_election.cc:343] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.910952 23238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2433c50320714f4288969a94d5e1bf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.918069 23295 tablet_bootstrap.cc:654] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.919751 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90401217dded44f3bbae100f43bd7c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.931743 23294 ts_tablet_manager.cc:1434] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.106s	user 0.010s	sys 0.000s
I20260709 13:08:24.933072 23294 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:24.941020 23089 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8e0388048448ad81268fb914e7d4cc (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:24.942566 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8e0388048448ad81268fb914e7d4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.942723 23301 raft_consensus.cc:493] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.943310 23301 raft_consensus.cc:515] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:24.946199 23294 tablet_bootstrap.cc:654] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.946830 23163 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8e0388048448ad81268fb914e7d4cc (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:24.947754 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:24.948364 23163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8e0388048448ad81268fb914e7d4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.948448 23100 raft_consensus.cc:2468] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:24.949420 23301 leader_election.cc:290] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:24.950497 23296 tablet_bootstrap.cc:654] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.955006 22989 leader_election.cc:304] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:24.957041 23237 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8e0388048448ad81268fb914e7d4cc (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:24.958523 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8e0388048448ad81268fb914e7d4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.958797 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 33472d9d8b514a79b3645d0aa02749c2 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:24.960225 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33472d9d8b514a79b3645d0aa02749c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.977327 23008 tablet_service.cc:1511] Processing CreateTablet for tablet 33472d9d8b514a79b3645d0aa02749c2 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:24.978430 23295 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:24.978765 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33472d9d8b514a79b3645d0aa02749c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.982292 23293 tablet_bootstrap.cc:654] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.974057 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:24.984544 23025 raft_consensus.cc:3060] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.973259 23301 raft_consensus.cc:2804] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.987927 23301 raft_consensus.cc:493] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.988291 23301 raft_consensus.cc:3060] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.018239 23158 tablet_service.cc:1511] Processing CreateTablet for tablet 33472d9d8b514a79b3645d0aa02749c2 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:25.020028 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33472d9d8b514a79b3645d0aa02749c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.025628 23294 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:25.026276 23294 ts_tablet_manager.cc:1403] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.056s
I20260709 13:08:24.994339 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
W20260709 13:08:25.028018 22991 leader_election.cc:343] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.029763 23294 raft_consensus.cc:359] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:25.030547 23294 raft_consensus.cc:385] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.030828 23294 raft_consensus.cc:740] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.031178 23296 tablet_bootstrap.cc:492] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:25.031749 23296 ts_tablet_manager.cc:1403] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.006s
I20260709 13:08:25.032424 23025 raft_consensus.cc:2468] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:25.033279 23234 tablet_service.cc:1511] Processing CreateTablet for tablet d338f57c69b44220a6c31510e829a8f6 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:25.034736 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d338f57c69b44220a6c31510e829a8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.035162 23011 tablet_service.cc:1511] Processing CreateTablet for tablet d338f57c69b44220a6c31510e829a8f6 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:25.036207 23212 leader_election.cc:304] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:25.036521 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d338f57c69b44220a6c31510e829a8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.037334 23247 raft_consensus.cc:3060] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.037464 23336 raft_consensus.cc:2804] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.038074 23336 raft_consensus.cc:697] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:25.038964 23336 consensus_queue.cc:237] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.039788 23295 ts_tablet_manager.cc:1403] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.006s
I20260709 13:08:25.058187 23295 raft_consensus.cc:359] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.059023 23295 raft_consensus.cc:385] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.058566 23328 consensus_queue.cc:1048] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.059381 23295 raft_consensus.cc:740] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.062477 23301 raft_consensus.cc:515] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.068142 23295 consensus_queue.cc:260] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.069023 23088 tablet_service.cc:1511] Processing CreateTablet for tablet d338f57c69b44220a6c31510e829a8f6 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:25.069871 23335 raft_consensus.cc:493] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.070798 23088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d338f57c69b44220a6c31510e829a8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.070515 23335 raft_consensus.cc:515] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.065833 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:25.073266 23335 leader_election.cc:290] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
W20260709 13:08:25.073947 22991 leader_election.cc:343] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.075122 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:25.075999 23023 raft_consensus.cc:2393] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:25.082233 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:25.083927 23066 leader_election.cc:304] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:25.085294 23335 raft_consensus.cc:3060] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.086352 23294 consensus_queue.cc:260] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:25.085300 23296 raft_consensus.cc:359] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.088892 23296 raft_consensus.cc:385] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.089203 23296 raft_consensus.cc:740] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.089375 23294 ts_tablet_manager.cc:1434] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.003s
I20260709 13:08:25.090653 23294 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:25.090551 23328 consensus_queue.cc:1048] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.097625 23295 ts_tablet_manager.cc:1434] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:08:25.097641 23296 consensus_queue.cc:260] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.098896 23295 tablet_bootstrap.cc:492] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:25.100512 23296 ts_tablet_manager.cc:1434] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.003s
I20260709 13:08:25.107728 23294 tablet_bootstrap.cc:654] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.110734 23296 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:25.117394 23158 tablet_service.cc:1511] Processing CreateTablet for tablet c068aa5e483f41e783c5498945e63250 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:25.118959 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c068aa5e483f41e783c5498945e63250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.112458 23335 raft_consensus.cc:2749] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.113646 23328 raft_consensus.cc:493] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.127203 23328 raft_consensus.cc:515] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:25.127804 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:25.128495 23100 raft_consensus.cc:3060] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.131395 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:25.132232 23248 raft_consensus.cc:2468] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:25.133813 23140 leader_election.cc:304] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:25.134773 23328 leader_election.cc:290] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:25.134856 23304 raft_consensus.cc:2804] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.135349 23304 raft_consensus.cc:493] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.135742 23304 raft_consensus.cc:3060] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.136130 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:25.136840 23025 raft_consensus.cc:2468] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:25.142997 23335 raft_consensus.cc:493] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.143831 23335 raft_consensus.cc:515] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.131657 23301 leader_election.cc:290] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:25.146420 23304 raft_consensus.cc:515] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:25.147991 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb649bdf39d4f11b38e2a5246a82b28" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:25.149586 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:25.150244 23248 raft_consensus.cc:3060] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:25.150280 23063 leader_election.cc:343] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.153992 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb649bdf39d4f11b38e2a5246a82b28" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
W20260709 13:08:25.160574 23066 leader_election.cc:343] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.161335 23066 leader_election.cc:304] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:25.162737 23338 raft_consensus.cc:2749] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.165987 23100 raft_consensus.cc:2468] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:25.167438 22989 leader_election.cc:304] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:25.168496 23335 leader_election.cc:290] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:25.170468 23301 raft_consensus.cc:2804] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.171066 23301 raft_consensus.cc:697] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:25.172058 23301 consensus_queue.cc:237] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.177640 23295 tablet_bootstrap.cc:654] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.177205 23234 tablet_service.cc:1511] Processing CreateTablet for tablet c068aa5e483f41e783c5498945e63250 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:25.178678 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:25.179194 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c068aa5e483f41e783c5498945e63250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.179409 23025 raft_consensus.cc:3060] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.177281 22923 catalog_manager.cc:5697] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.183154 23304 leader_election.cc:290] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:25.199152 23009 tablet_service.cc:1511] Processing CreateTablet for tablet c068aa5e483f41e783c5498945e63250 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:25.200614 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c068aa5e483f41e783c5498945e63250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.201658 23296 tablet_bootstrap.cc:654] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.191299 23248 raft_consensus.cc:2468] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:25.205782 23140 leader_election.cc:304] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:25.206179 23158 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed56e7a911d48c097f25c20e39f2385 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:25.207583 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed56e7a911d48c097f25c20e39f2385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.211301 23237 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed56e7a911d48c097f25c20e39f2385 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:25.212831 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed56e7a911d48c097f25c20e39f2385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.212714 23008 tablet_service.cc:1511] Processing CreateTablet for tablet 98752a0b59b54debad030db8c47b501d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:25.214296 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98752a0b59b54debad030db8c47b501d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.215111 23025 raft_consensus.cc:2468] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:25.215770 23304 raft_consensus.cc:2804] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.217190 23293 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:25.220001 23293 ts_tablet_manager.cc:1403] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.351s	user 0.044s	sys 0.041s
I20260709 13:08:25.219784 23089 tablet_service.cc:1511] Processing CreateTablet for tablet 98752a0b59b54debad030db8c47b501d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:25.221524 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98752a0b59b54debad030db8c47b501d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.223627 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed56e7a911d48c097f25c20e39f2385 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:25.224226 23293 raft_consensus.cc:359] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.225057 23293 raft_consensus.cc:385] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.225420 23293 raft_consensus.cc:740] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.225163 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed56e7a911d48c097f25c20e39f2385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.252992 22923 catalog_manager.cc:5697] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.256706 23233 tablet_service.cc:1511] Processing CreateTablet for tablet a14623ec43e74ec68cdc611737321081 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:25.249848 23294 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:25.258502 23294 ts_tablet_manager.cc:1403] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.168s	user 0.018s	sys 0.001s
I20260709 13:08:25.258571 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14623ec43e74ec68cdc611737321081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.270076 23158 tablet_service.cc:1511] Processing CreateTablet for tablet 98752a0b59b54debad030db8c47b501d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:25.274274 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98752a0b59b54debad030db8c47b501d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.242291 23304 raft_consensus.cc:697] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:25.226413 23293 consensus_queue.cc:260] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.281208 23011 tablet_service.cc:1511] Processing CreateTablet for tablet a14623ec43e74ec68cdc611737321081 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:25.282752 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14623ec43e74ec68cdc611737321081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.287004 23296 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:25.287897 23296 ts_tablet_manager.cc:1403] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.011s
I20260709 13:08:25.295727 23296 raft_consensus.cc:359] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:25.296700 23296 raft_consensus.cc:385] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.297138 23296 raft_consensus.cc:740] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.297964 23296 consensus_queue.cc:260] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:25.300674 23296 ts_tablet_manager.cc:1434] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:25.301832 23296 tablet_bootstrap.cc:492] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:25.253527 22921 catalog_manager.cc:5697] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.316840 23294 raft_consensus.cc:359] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.317781 23294 raft_consensus.cc:385] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.318128 23294 raft_consensus.cc:740] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.321339 23293 ts_tablet_manager.cc:1434] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.001s
I20260709 13:08:25.322578 23293 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:25.319033 23294 consensus_queue.cc:260] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.340226 23088 tablet_service.cc:1511] Processing CreateTablet for tablet a14623ec43e74ec68cdc611737321081 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:25.341733 23088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14623ec43e74ec68cdc611737321081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.346453 23233 tablet_service.cc:1511] Processing CreateTablet for tablet 40b7fb9731dd45f2a99ae81ca62d6889 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:25.347725 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b7fb9731dd45f2a99ae81ca62d6889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.352492 23008 tablet_service.cc:1511] Processing CreateTablet for tablet 40b7fb9731dd45f2a99ae81ca62d6889 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:25.353960 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b7fb9731dd45f2a99ae81ca62d6889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.357415 23158 tablet_service.cc:1511] Processing CreateTablet for tablet 40b7fb9731dd45f2a99ae81ca62d6889 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:25.358435 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b7fb9731dd45f2a99ae81ca62d6889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.338330 23304 consensus_queue.cc:237] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:25.364675 23295 tablet_bootstrap.cc:492] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:25.365296 23295 ts_tablet_manager.cc:1403] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.267s	user 0.028s	sys 0.029s
I20260709 13:08:25.367797 23294 ts_tablet_manager.cc:1434] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 13:08:25.369969 23294 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:25.374794 23296 tablet_bootstrap.cc:654] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.383461 23354 consensus_queue.cc:1048] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.384137 23295 raft_consensus.cc:359] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.385231 23295 raft_consensus.cc:385] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.385620 23295 raft_consensus.cc:740] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.393208 23293 tablet_bootstrap.cc:654] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.401197 23089 tablet_service.cc:1511] Processing CreateTablet for tablet 7c383c2bf6b74c63a4d6713bf94c339c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:25.402761 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c383c2bf6b74c63a4d6713bf94c339c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.408097 23163 tablet_service.cc:1511] Processing CreateTablet for tablet 7c383c2bf6b74c63a4d6713bf94c339c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:25.410074 23163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c383c2bf6b74c63a4d6713bf94c339c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.386672 23295 consensus_queue.cc:260] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.419346 23234 tablet_service.cc:1511] Processing CreateTablet for tablet 7c383c2bf6b74c63a4d6713bf94c339c (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:25.429246 23085 tablet_service.cc:1511] Processing CreateTablet for tablet c8c24c5fe50b420cb84b427a38c4b550 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:25.433449 23296 tablet_bootstrap.cc:492] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:25.434104 23296 ts_tablet_manager.cc:1403] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.001s
I20260709 13:08:25.430596 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c24c5fe50b420cb84b427a38c4b550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.422950 23294 tablet_bootstrap.cc:654] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:25.437948 23138 consensus_peers.cc:597] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.442132 23162 tablet_service.cc:1511] Processing CreateTablet for tablet c8c24c5fe50b420cb84b427a38c4b550 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:25.443333 23293 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:25.443652 23162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c24c5fe50b420cb84b427a38c4b550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.445960 23293 ts_tablet_manager.cc:1403] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.000s
I20260709 13:08:25.427580 23295 ts_tablet_manager.cc:1434] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.004s
I20260709 13:08:25.454411 23336 consensus_queue.cc:1048] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.444983 23011 tablet_service.cc:1511] Processing CreateTablet for tablet c8c24c5fe50b420cb84b427a38c4b550 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:25.460857 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c383c2bf6b74c63a4d6713bf94c339c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.463495 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c24c5fe50b420cb84b427a38c4b550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.458187 23295 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:25.481504 23008 tablet_service.cc:1511] Processing CreateTablet for tablet 1351248e1da24069a4599e9fdc8b3e6b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:25.482849 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1351248e1da24069a4599e9fdc8b3e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.481401 23336 consensus_queue.cc:1048] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:25.482788 23293 raft_consensus.cc:359] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.491001 23293 raft_consensus.cc:385] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.482990 22921 catalog_manager.cc:5697] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.491329 23293 raft_consensus.cc:740] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.494788 23353 raft_consensus.cc:493] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.495362 23353 raft_consensus.cc:515] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:25.496479 23089 tablet_service.cc:1511] Processing CreateTablet for tablet 1351248e1da24069a4599e9fdc8b3e6b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:25.497947 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1351248e1da24069a4599e9fdc8b3e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.462982 23237 tablet_service.cc:1511] Processing CreateTablet for tablet 1351248e1da24069a4599e9fdc8b3e6b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:25.488332 23304 raft_consensus.cc:493] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.456939 23296 raft_consensus.cc:359] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.508277 23353 leader_election.cc:290] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:25.509034 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:25.510213 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:25.511963 23295 tablet_bootstrap.cc:654] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:25.525432 23138 leader_election.cc:343] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:25.526072 23140 leader_election.cc:343] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.517910 23304 raft_consensus.cc:515] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.518138 23158 tablet_service.cc:1511] Processing CreateTablet for tablet dc4702f1cac747e4bb14d663d83e58ca (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:25.529143 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4702f1cac747e4bb14d663d83e58ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.526561 23140 leader_election.cc:304] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:25.493139 23293 consensus_queue.cc:260] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.521713 23233 tablet_service.cc:1511] Processing CreateTablet for tablet dc4702f1cac747e4bb14d663d83e58ca (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:25.523303 23296 raft_consensus.cc:385] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.533111 23296 raft_consensus.cc:740] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.534116 23296 consensus_queue.cc:260] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.535598 23354 raft_consensus.cc:2749] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.537335 23293 ts_tablet_manager.cc:1434] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.001s
I20260709 13:08:25.538123 23304 leader_election.cc:290] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:25.554209 23293 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:25.540004 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56145698faa64689af33cb5ae7097cb1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:25.555414 23247 raft_consensus.cc:2468] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:25.557057 23140 leader_election.cc:304] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:25.558063 23304 raft_consensus.cc:2804] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.558451 23304 raft_consensus.cc:493] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.558799 23304 raft_consensus.cc:3060] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.540473 23294 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:25.544056 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56145698faa64689af33cb5ae7097cb1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:25.546146 23296 ts_tablet_manager.cc:1434] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.112s	user 0.011s	sys 0.000s
I20260709 13:08:25.560695 23294 ts_tablet_manager.cc:1403] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.191s	user 0.009s	sys 0.010s
I20260709 13:08:25.560705 23100 raft_consensus.cc:2468] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:25.561784 23296 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:25.519660 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1351248e1da24069a4599e9fdc8b3e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.563767 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4702f1cac747e4bb14d663d83e58ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.564188 23294 raft_consensus.cc:359] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.565012 23294 raft_consensus.cc:385] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.565330 23294 raft_consensus.cc:740] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.566504 23294 consensus_queue.cc:260] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.567317 23304 raft_consensus.cc:515] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.569692 23294 ts_tablet_manager.cc:1434] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:08:25.570456 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56145698faa64689af33cb5ae7097cb1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:25.571067 23294 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:25.571110 23100 raft_consensus.cc:3060] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.574167 23296 tablet_bootstrap.cc:654] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.574946 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56145698faa64689af33cb5ae7097cb1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:25.575618 23247 raft_consensus.cc:3060] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.579917 23301 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.580570 23294 tablet_bootstrap.cc:654] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.580443 23301 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.581990 23293 tablet_bootstrap.cc:654] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.582839 23301 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:25.585346 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:25.586081 23099 raft_consensus.cc:2468] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:25.587700 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:25.589358 22989 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
W20260709 13:08:25.590749 22988 leader_election.cc:343] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.596196 23301 raft_consensus.cc:2804] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.597749 23301 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.598178 23301 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.609838 23008 tablet_service.cc:1511] Processing CreateTablet for tablet dc4702f1cac747e4bb14d663d83e58ca (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:25.611336 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4702f1cac747e4bb14d663d83e58ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.612622 23089 tablet_service.cc:1511] Processing CreateTablet for tablet e899ea012af5427ca26140b778e6b811 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:25.615511 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e899ea012af5427ca26140b778e6b811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.619068 23295 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:25.619738 23295 ts_tablet_manager.cc:1403] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.001s
I20260709 13:08:25.608315 23247 raft_consensus.cc:2468] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:25.621346 23140 leader_election.cc:304] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:25.622318 23353 raft_consensus.cc:2804] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.622833 23353 raft_consensus.cc:697] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:25.623747 23353 consensus_queue.cc:237] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:25.623253 23295 raft_consensus.cc:359] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.636425 23295 raft_consensus.cc:385] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.636906 23295 raft_consensus.cc:740] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.650800 22922 catalog_manager.cc:5697] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.654425 23162 tablet_service.cc:1511] Processing CreateTablet for tablet e899ea012af5427ca26140b778e6b811 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:25.652940 23304 leader_election.cc:290] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:25.652158 23295 consensus_queue.cc:260] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.662015 23295 ts_tablet_manager.cc:1434] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:08:25.663645 23347 consensus_queue.cc:1048] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.667002 23234 tablet_service.cc:1511] Processing CreateTablet for tablet e899ea012af5427ca26140b778e6b811 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:25.668653 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e899ea012af5427ca26140b778e6b811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.675498 23162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e899ea012af5427ca26140b778e6b811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.682554 23011 tablet_service.cc:1511] Processing CreateTablet for tablet 990e32f21d80459799b74a21dfa0be97 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:25.683990 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990e32f21d80459799b74a21dfa0be97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.683672 23089 tablet_service.cc:1511] Processing CreateTablet for tablet 990e32f21d80459799b74a21dfa0be97 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:25.684916 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990e32f21d80459799b74a21dfa0be97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.686057 23163 tablet_service.cc:1511] Processing CreateTablet for tablet 990e32f21d80459799b74a21dfa0be97 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:25.687290 23163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990e32f21d80459799b74a21dfa0be97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.688464 23238 tablet_service.cc:1511] Processing CreateTablet for tablet 08e6c94513d545df957ae3d6c984123b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:25.689746 23238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e6c94513d545df957ae3d6c984123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.695201 23295 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:25.708817 23009 tablet_service.cc:1511] Processing CreateTablet for tablet 08e6c94513d545df957ae3d6c984123b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:25.710748 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e6c94513d545df957ae3d6c984123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.711753 23336 raft_consensus.cc:493] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.712528 23336 raft_consensus.cc:515] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.715158 23336 leader_election.cc:290] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:25.716965 23302 raft_consensus.cc:493] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.717658 23302 raft_consensus.cc:515] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.721431 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41361b7bb5d44f2ba006fb10f2c275d8" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:25.722153 23098 raft_consensus.cc:2468] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:25.723838 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41361b7bb5d44f2ba006fb10f2c275d8" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:25.724228 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:25.724629 23025 raft_consensus.cc:2468] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:25.725009 23212 leader_election.cc:304] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:25.726502 23302 leader_election.cc:290] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:25.727078 23302 raft_consensus.cc:2804] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.727469 23302 raft_consensus.cc:493] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.727221 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 08e6c94513d545df957ae3d6c984123b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:25.727839 23302 raft_consensus.cc:3060] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.728569 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e6c94513d545df957ae3d6c984123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.746873 23158 tablet_service.cc:1511] Processing CreateTablet for tablet 820d0fdc714544b1bb07aacd6c176a0b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:25.752530 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820d0fdc714544b1bb07aacd6c176a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.763221 23295 tablet_bootstrap.cc:654] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.765947 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:25.770572 23212 leader_election.cc:304] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:25.771786 23296 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:25.768257 23237 tablet_service.cc:1511] Processing CreateTablet for tablet 820d0fdc714544b1bb07aacd6c176a0b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:25.792769 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820d0fdc714544b1bb07aacd6c176a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.793314 23011 tablet_service.cc:1511] Processing CreateTablet for tablet 33ef6a4ccfc2494489563699b0216088 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:25.794955 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ef6a4ccfc2494489563699b0216088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.802245 23293 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:25.802963 23293 ts_tablet_manager.cc:1403] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.249s	user 0.024s	sys 0.057s
I20260709 13:08:25.803517 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 33ef6a4ccfc2494489563699b0216088 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:25.804922 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ef6a4ccfc2494489563699b0216088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.806561 23293 raft_consensus.cc:359] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.807507 23293 raft_consensus.cc:385] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.807957 23293 raft_consensus.cc:740] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.658879 23301 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.778817 23089 tablet_service.cc:1511] Processing CreateTablet for tablet adbc01cc61ed4eaab25d8cb87f61bdba (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:25.809393 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbc01cc61ed4eaab25d8cb87f61bdba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.809057 23293 consensus_queue.cc:260] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.780045 23160 tablet_service.cc:1511] Processing CreateTablet for tablet adbc01cc61ed4eaab25d8cb87f61bdba (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:25.812381 23160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbc01cc61ed4eaab25d8cb87f61bdba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.766062 23247 raft_consensus.cc:3060] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.682874 23100 raft_consensus.cc:2468] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:25.815860 23296 ts_tablet_manager.cc:1403] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.254s	user 0.029s	sys 0.055s
I20260709 13:08:25.770985 23302 raft_consensus.cc:515] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.786219 23304 consensus_queue.cc:1048] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.819597 23296 raft_consensus.cc:359] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.820392 23296 raft_consensus.cc:385] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.820691 23296 raft_consensus.cc:740] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.790642 23233 tablet_service.cc:1511] Processing CreateTablet for tablet adbc01cc61ed4eaab25d8cb87f61bdba (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:25.822000 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbc01cc61ed4eaab25d8cb87f61bdba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.823035 23294 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:25.790683 23009 tablet_service.cc:1511] Processing CreateTablet for tablet 820d0fdc714544b1bb07aacd6c176a0b (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:25.823652 23294 ts_tablet_manager.cc:1403] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.253s	user 0.058s	sys 0.047s
I20260709 13:08:25.824297 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820d0fdc714544b1bb07aacd6c176a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.827935 23296 consensus_queue.cc:260] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.830240 23293 ts_tablet_manager.cc:1434] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:08:25.832818 23293 tablet_bootstrap.cc:492] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:25.833472 23302 leader_election.cc:290] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:25.834401 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41361b7bb5d44f2ba006fb10f2c275d8" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:25.835121 23024 raft_consensus.cc:3060] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.827173 23294 raft_consensus.cc:359] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.836282 23294 raft_consensus.cc:385] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.836620 23294 raft_consensus.cc:740] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.837448 23294 consensus_queue.cc:260] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.839915 23294 ts_tablet_manager.cc:1434] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:08:25.841033 23294 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:25.809412 23295 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:25.844177 23295 ts_tablet_manager.cc:1403] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.001s
I20260709 13:08:25.845490 23335 raft_consensus.cc:493] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.846102 23335 raft_consensus.cc:515] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.847410 23295 raft_consensus.cc:359] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.848989 23335 leader_election.cc:290] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:25.850662 23301 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:25.850530 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:25.896729 23295 raft_consensus.cc:385] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.897142 23295 raft_consensus.cc:740] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.851629 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:25.897990 23173 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.898058 23295 consensus_queue.cc:260] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.900656 23162 tablet_service.cc:1511] Processing CreateTablet for tablet ba98dd70fec646a2b2d9e48e32da649d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:25.902150 23162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98dd70fec646a2b2d9e48e32da649d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.853766 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:25.854640 23296 ts_tablet_manager.cc:1434] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 13:08:25.854435 23161 tablet_service.cc:1511] Processing CreateTablet for tablet 33ef6a4ccfc2494489563699b0216088 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:25.855136 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:25.834967 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41361b7bb5d44f2ba006fb10f2c275d8" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:25.856621 23234 tablet_service.cc:1511] Processing CreateTablet for tablet b575cdcb4fac42e984e4dc708fcad605 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:25.903839 23009 tablet_service.cc:1511] Processing CreateTablet for tablet e19758a128eb4647906943d8a455fea1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:25.908864 23234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b575cdcb4fac42e984e4dc708fcad605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.905467 23295 ts_tablet_manager.cc:1434] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.001s
I20260709 13:08:25.864559 23304 consensus_queue.cc:1048] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.909406 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19758a128eb4647906943d8a455fea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.912324 23295 tablet_bootstrap.cc:492] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:25.867616 23294 tablet_bootstrap.cc:654] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.926915 23173 raft_consensus.cc:2468] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:25.869760 23024 raft_consensus.cc:2468] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:25.873636 23088 tablet_service.cc:1511] Processing CreateTablet for tablet b575cdcb4fac42e984e4dc708fcad605 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:25.930218 23088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b575cdcb4fac42e984e4dc708fcad605. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:25.885358 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:25.885015 23163 tablet_service.cc:1511] Processing CreateTablet for tablet e19758a128eb4647906943d8a455fea1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:25.886926 23293 tablet_bootstrap.cc:654] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.932755 23212 leader_election.cc:304] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:25.933811 23302 raft_consensus.cc:2804] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.934335 23302 raft_consensus.cc:697] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:25.935264 23302 consensus_queue.cc:237] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.890830 23233 tablet_service.cc:1511] Processing CreateTablet for tablet e19758a128eb4647906943d8a455fea1 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:25.940089 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19758a128eb4647906943d8a455fea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.942795 23085 tablet_service.cc:1511] Processing CreateTablet for tablet 6248ccc292244da38810b46798b3843f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:25.944223 23085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6248ccc292244da38810b46798b3843f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.891724 23375 consensus_queue.cc:1048] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.890911 23373 raft_consensus.cc:2749] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.896962 23090 tablet_service.cc:1511] Processing CreateTablet for tablet ba98dd70fec646a2b2d9e48e32da649d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:25.951828 23090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98dd70fec646a2b2d9e48e32da649d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.951395 23160 tablet_service.cc:1511] Processing CreateTablet for tablet 6248ccc292244da38810b46798b3843f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:25.866146 23011 tablet_service.cc:1511] Processing CreateTablet for tablet b575cdcb4fac42e984e4dc708fcad605 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:25.956058 23295 tablet_bootstrap.cc:654] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.957679 23373 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.958221 23373 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:25.958719 23009 tablet_service.cc:1511] Processing CreateTablet for tablet 6248ccc292244da38810b46798b3843f (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:25.914659 23064 leader_election.cc:304] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:25.960199 23335 raft_consensus.cc:2749] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.918273 23100 raft_consensus.cc:3060] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.960455 23373 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:25.968978 22988 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:25.906191 23296 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:25.907066 23161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ef6a4ccfc2494489563699b0216088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.971879 23163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19758a128eb4647906943d8a455fea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.908008 23098 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.974747 23160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6248ccc292244da38810b46798b3843f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.978648 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:25.981168 23099 raft_consensus.cc:3060] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.976791 23237 tablet_service.cc:1511] Processing CreateTablet for tablet ba98dd70fec646a2b2d9e48e32da649d (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:25.985034 23237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98dd70fec646a2b2d9e48e32da649d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.987592 23375 raft_consensus.cc:2804] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.988377 23375 raft_consensus.cc:697] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:25.989328 23376 raft_consensus.cc:493] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.989899 23376 raft_consensus.cc:515] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:25.992594 23376 leader_election.cc:290] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:25.994407 23304 raft_consensus.cc:493] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.995332 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:25.996291 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:25.997090 23097 raft_consensus.cc:2468] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:25.995016 23304 raft_consensus.cc:515] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
W20260709 13:08:25.997956 22988 leader_election.cc:343] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:25.995684 23212 leader_election.cc:343] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.001394 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb649bdf39d4f11b38e2a5246a82b28" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:25.989378 23375 consensus_queue.cc:237] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.002317 23097 raft_consensus.cc:2468] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:26.001412 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb649bdf39d4f11b38e2a5246a82b28" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:26.003470 23304 leader_election.cc:290] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
W20260709 13:08:26.005476 23140 leader_election.cc:343] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:25.960392 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 45824us
I20260709 13:08:26.008062 23138 leader_election.cc:304] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:26.009683 23353 raft_consensus.cc:2804] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.010085 23353 raft_consensus.cc:493] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.010430 23353 raft_consensus.cc:3060] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.020196 23304 consensus_queue.cc:1048] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.021577 23233 tablet_service.cc:1511] Processing CreateTablet for tablet dc91ac3261d049d1ab7aaa70e0c081e9 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:26.022210 22989 leader_election.cc:304] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:26.023517 23301 raft_consensus.cc:2804] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.023978 23301 raft_consensus.cc:493] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.024319 23301 raft_consensus.cc:3060] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.024998 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:26.026655 23212 leader_election.cc:343] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.027144 23212 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:26.021607 23011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b575cdcb4fac42e984e4dc708fcad605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:26.028376 23373 raft_consensus.cc:2749] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.029050 23009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6248ccc292244da38810b46798b3843f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:26.023483 23233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc91ac3261d049d1ab7aaa70e0c081e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:26.036248 23089 tablet_service.cc:1511] Processing CreateTablet for tablet dc91ac3261d049d1ab7aaa70e0c081e9 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:26.038019 23089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc91ac3261d049d1ab7aaa70e0c081e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:26.041095 23008 tablet_service.cc:1511] Processing CreateTablet for tablet dc91ac3261d049d1ab7aaa70e0c081e9 (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:26.042784 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc91ac3261d049d1ab7aaa70e0c081e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:26.052850 23238 tablet_service.cc:1511] Processing CreateTablet for tablet e414b2459e7d4897b74262e9f85a84aa (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:26.053288 23158 tablet_service.cc:1511] Processing CreateTablet for tablet e414b2459e7d4897b74262e9f85a84aa (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:26.054462 23238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e414b2459e7d4897b74262e9f85a84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:26.054499 23158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e414b2459e7d4897b74262e9f85a84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:26.110737 23293 tablet_bootstrap.cc:492] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:26.111512 23293 ts_tablet_manager.cc:1403] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.279s	user 0.013s	sys 0.027s
I20260709 13:08:26.119596 23295 tablet_bootstrap.cc:492] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:26.120131 23295 ts_tablet_manager.cc:1403] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.208s	user 0.028s	sys 0.036s
I20260709 13:08:26.124039 23294 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:26.124825 23294 ts_tablet_manager.cc:1403] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.284s	user 0.025s	sys 0.023s
I20260709 13:08:26.193050 23304 consensus_queue.cc:1048] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:08:26.256189 22910 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 124019us
I20260709 13:08:26.257589 23100 raft_consensus.cc:2468] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:26.259689 23294 raft_consensus.cc:359] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.260463 23294 raft_consensus.cc:385] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.260731 23294 raft_consensus.cc:740] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.261449 23294 consensus_queue.cc:260] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.264319 23294 ts_tablet_manager.cc:1434] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.139s	user 0.029s	sys 0.036s
I20260709 13:08:26.265504 23294 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:26.266577 23295 raft_consensus.cc:359] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.267287 23295 raft_consensus.cc:385] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.267581 23295 raft_consensus.cc:740] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.268487 23295 consensus_queue.cc:260] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.275667 23008 tablet_service.cc:1511] Processing CreateTablet for tablet e414b2459e7d4897b74262e9f85a84aa (DEFAULT_TABLE table=test-workload [id=1a83e8a7a01a413c9f0a8b62ce7c64f2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:26.276890 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e414b2459e7d4897b74262e9f85a84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:26.279220 23295 ts_tablet_manager.cc:1434] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.159s	user 0.009s	sys 0.002s
I20260709 13:08:26.280946 23295 tablet_bootstrap.cc:492] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:26.286509 23293 raft_consensus.cc:359] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.287225 23293 raft_consensus.cc:385] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.287509 23293 raft_consensus.cc:740] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.288244 23293 consensus_queue.cc:260] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.297425 23293 ts_tablet_manager.cc:1434] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.186s	user 0.006s	sys 0.002s
I20260709 13:08:26.298514 23293 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:26.299681 22921 catalog_manager.cc:5697] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.304704 23293 tablet_bootstrap.cc:654] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:26.277343 22908 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 137350us
I20260709 13:08:26.329033 23098 raft_consensus.cc:2468] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:26.318107 22922 catalog_manager.cc:5697] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.296732 23353 raft_consensus.cc:515] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.332268 23353 leader_election.cc:290] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:26.334915 23296 tablet_bootstrap.cc:654] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.334810 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb649bdf39d4f11b38e2a5246a82b28" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:26.336448 23301 raft_consensus.cc:515] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:26.337239 23140 leader_election.cc:343] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.339102 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb649bdf39d4f11b38e2a5246a82b28" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:26.340219 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:26.345968 23100 raft_consensus.cc:3060] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.347142 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:26.342031 23098 raft_consensus.cc:3060] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.342682 23301 leader_election.cc:290] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
W20260709 13:08:26.349300 22988 leader_election.cc:343] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.352403 23293 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:26.353034 23293 ts_tablet_manager.cc:1403] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.004s
I20260709 13:08:26.358107 23294 tablet_bootstrap.cc:654] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.366945 23295 tablet_bootstrap.cc:654] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.356706 23293 raft_consensus.cc:359] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.369578 23293 raft_consensus.cc:385] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.369864 23100 raft_consensus.cc:2468] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:26.369957 23293 raft_consensus.cc:740] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.371034 23293 consensus_queue.cc:260] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.375439 23293 ts_tablet_manager.cc:1434] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:08:26.379531 23296 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:26.380342 23296 ts_tablet_manager.cc:1403] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.474s	user 0.017s	sys 0.031s
I20260709 13:08:26.381466 22989 leader_election.cc:304] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:26.382529 23376 raft_consensus.cc:2804] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.383177 23376 raft_consensus.cc:697] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:26.384219 23376 consensus_queue.cc:237] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.396683 23293 tablet_bootstrap.cc:492] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:26.409454 23373 consensus_queue.cc:1048] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.413053 23373 raft_consensus.cc:493] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.413621 23373 raft_consensus.cc:515] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.416155 23296 raft_consensus.cc:359] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.417303 23296 raft_consensus.cc:385] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.417358 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab6a41e225bf43a8a84737c4cedbbff9" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:26.417913 23296 raft_consensus.cc:740] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.418272 23099 raft_consensus.cc:2468] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:26.419598 23212 leader_election.cc:304] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:26.420547 23302 raft_consensus.cc:2804] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.421103 23302 raft_consensus.cc:493] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.422046 23293 tablet_bootstrap.cc:654] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.423977 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab6a41e225bf43a8a84737c4cedbbff9" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:26.421574 23302 raft_consensus.cc:3060] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:26.427366 23211 leader_election.cc:343] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.418992 23296 consensus_queue.cc:260] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.432633 23296 ts_tablet_manager.cc:1434] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 13:08:26.433894 23296 tablet_bootstrap.cc:492] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:26.421533 23373 leader_election.cc:290] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:26.377532 23098 raft_consensus.cc:2468] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:26.440830 23294 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:26.441514 23294 ts_tablet_manager.cc:1403] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.176s	user 0.026s	sys 0.015s
I20260709 13:08:26.444999 23302 raft_consensus.cc:515] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.447651 23302 leader_election.cc:290] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:26.449286 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab6a41e225bf43a8a84737c4cedbbff9" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:26.449937 23100 raft_consensus.cc:3060] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.452011 23138 leader_election.cc:304] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:26.452692 23296 tablet_bootstrap.cc:654] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.452937 23304 raft_consensus.cc:2804] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.453497 23304 raft_consensus.cc:697] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:26.452620 23294 raft_consensus.cc:359] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.454249 23294 raft_consensus.cc:385] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.454569 23294 raft_consensus.cc:740] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.454672 23304 consensus_queue.cc:237] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.456508 23294 consensus_queue.cc:260] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.457255 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab6a41e225bf43a8a84737c4cedbbff9" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:26.473047 23302 consensus_queue.cc:1048] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.475780 23294 ts_tablet_manager.cc:1434] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
W20260709 13:08:26.477044 23211 leader_election.cc:343] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.477375 23294 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:26.477819 23391 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.480310 23391 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.492326 23391 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:26.479470 23100 raft_consensus.cc:2468] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:26.494716 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:26.497331 23212 leader_election.cc:304] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:26.497789 23293 tablet_bootstrap.cc:492] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:26.498850 23373 raft_consensus.cc:2804] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.499411 23293 ts_tablet_manager.cc:1403] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.003s
I20260709 13:08:26.495857 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:26.499655 23295 tablet_bootstrap.cc:492] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:26.499680 23373 raft_consensus.cc:697] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:26.500120 23248 raft_consensus.cc:2468] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:26.500305 23295 ts_tablet_manager.cc:1403] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.220s	user 0.040s	sys 0.050s
W20260709 13:08:26.499451 22989 leader_election.cc:343] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.501116 23373 consensus_queue.cc:237] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.501577 22991 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:26.503382 23295 raft_consensus.cc:359] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.503832 23376 raft_consensus.cc:2804] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.504117 23295 raft_consensus.cc:385] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.504316 23376 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.504551 23295 raft_consensus.cc:740] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.504789 23376 raft_consensus.cc:3060] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.504122 23391 consensus_queue.cc:1048] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:26.505388 23295 consensus_queue.cc:260] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.507738 23295 ts_tablet_manager.cc:1434] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:26.508757 23295 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:26.512466 23293 raft_consensus.cc:359] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.513309 23293 raft_consensus.cc:385] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.513645 23293 raft_consensus.cc:740] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.514555 23293 consensus_queue.cc:260] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.516826 23293 ts_tablet_manager.cc:1434] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:08:26.519193 23376 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.520282 23293 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:26.518257 23296 tablet_bootstrap.cc:492] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:26.518890 23294 tablet_bootstrap.cc:654] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.521481 23296 ts_tablet_manager.cc:1403] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.006s
I20260709 13:08:26.522358 23376 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:26.523663 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:26.524283 23248 raft_consensus.cc:3060] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.524803 23296 raft_consensus.cc:359] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.525708 23296 raft_consensus.cc:385] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.526029 23296 raft_consensus.cc:740] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.526839 23296 consensus_queue.cc:260] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.529325 23296 ts_tablet_manager.cc:1434] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:26.530396 23296 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:26.517877 23295 tablet_bootstrap.cc:654] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.520471 23391 raft_consensus.cc:493] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.531927 23391 raft_consensus.cc:515] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.535471 23391 leader_election.cc:290] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:26.540877 23294 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:26.540633 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:26.541366 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:26.542418 22989 leader_election.cc:343] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.543290 23294 ts_tablet_manager.cc:1403] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.001s
W20260709 13:08:26.549054 22988 leader_election.cc:343] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.549630 22988 leader_election.cc:304] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:26.550406 23391 raft_consensus.cc:2749] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.553095 23335 raft_consensus.cc:493] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.554250 23293 tablet_bootstrap.cc:654] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.553879 23335 raft_consensus.cc:515] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.553228 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
W20260709 13:08:26.556241 22989 leader_election.cc:343] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.559263 23296 tablet_bootstrap.cc:654] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.561738 23391 consensus_queue.cc:1048] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.563757 23294 raft_consensus.cc:359] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.565387 23294 raft_consensus.cc:385] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.566099 23294 raft_consensus.cc:740] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.565637 23335 leader_election.cc:290] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:26.581367 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bb24234c374237ae3cfd67bca1c794" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:26.584667 23295 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:26.584527 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bb24234c374237ae3cfd67bca1c794" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:26.585197 23295 ts_tablet_manager.cc:1403] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.012s
W20260709 13:08:26.586055 23063 leader_election.cc:343] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.586383 23373 raft_consensus.cc:493] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.586885 23373 raft_consensus.cc:515] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:26.588270 23066 leader_election.cc:343] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.588349 23295 raft_consensus.cc:359] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.588903 23066 leader_election.cc:304] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:26.589172 23295 raft_consensus.cc:385] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.589533 23295 raft_consensus.cc:740] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.589602 23373 leader_election.cc:290] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:26.590140 23335 raft_consensus.cc:2749] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.590305 23295 consensus_queue.cc:260] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.592298 23295 ts_tablet_manager.cc:1434] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:08:26.592147 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:26.593477 23295 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:26.595710 22923 catalog_manager.cc:5697] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.596352 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:26.597936 23174 raft_consensus.cc:2468] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:26.583323 23294 consensus_queue.cc:260] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.567704 23248 raft_consensus.cc:2468] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:26.601701 23211 leader_election.cc:304] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:26.602831 23024 raft_consensus.cc:2468] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:26.602773 23373 raft_consensus.cc:2804] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.603811 23373 raft_consensus.cc:493] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.604175 23373 raft_consensus.cc:3060] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.604408 22991 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:26.607668 23376 raft_consensus.cc:2804] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.608829 23295 tablet_bootstrap.cc:654] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.612183 23293 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:26.612767 23293 ts_tablet_manager.cc:1403] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.015s
I20260709 13:08:26.620534 23376 raft_consensus.cc:697] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:26.628894 23376 consensus_queue.cc:237] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.633980 22919 catalog_manager.cc:5697] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.644809 23293 raft_consensus.cc:359] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.645679 23293 raft_consensus.cc:385] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.645980 23293 raft_consensus.cc:740] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.647684 23293 consensus_queue.cc:260] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.652194 23294 ts_tablet_manager.cc:1434] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 13:08:26.653577 23294 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:26.655705 23293 ts_tablet_manager.cc:1434] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:08:26.660971 23293 tablet_bootstrap.cc:492] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:26.679491 23373 raft_consensus.cc:515] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.682986 23293 tablet_bootstrap.cc:654] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.683367 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:26.684094 23024 raft_consensus.cc:3060] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.683843 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:26.685251 23294 tablet_bootstrap.cc:654] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.686249 23373 leader_election.cc:290] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:26.686493 23173 raft_consensus.cc:3060] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.687572 23295 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:26.688107 23295 ts_tablet_manager.cc:1403] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.095s	user 0.040s	sys 0.018s
I20260709 13:08:26.691458 23295 raft_consensus.cc:359] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.692302 23295 raft_consensus.cc:385] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.691598 22921 catalog_manager.cc:5697] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.692621 23295 raft_consensus.cc:740] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.693392 23295 consensus_queue.cc:260] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.694756 23024 raft_consensus.cc:2468] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:26.696148 23295 ts_tablet_manager.cc:1434] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:08:26.696357 23212 leader_election.cc:304] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:26.697357 23295 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:26.698155 23296 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:26.698804 23296 ts_tablet_manager.cc:1403] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.027s
I20260709 13:08:26.704897 23295 tablet_bootstrap.cc:654] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.708249 23173 raft_consensus.cc:2468] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:26.707955 23296 raft_consensus.cc:359] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.709127 23296 raft_consensus.cc:385] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.709432 23296 raft_consensus.cc:740] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.710155 23296 consensus_queue.cc:260] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.714031 23294 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:26.714691 23294 ts_tablet_manager.cc:1403] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.003s
I20260709 13:08:26.715498 23373 raft_consensus.cc:2804] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.718261 23296 ts_tablet_manager.cc:1434] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:08:26.718123 23294 raft_consensus.cc:359] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.719193 23294 raft_consensus.cc:385] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.719386 23296 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:26.719581 23294 raft_consensus.cc:740] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.720558 23294 consensus_queue.cc:260] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.724819 23373 raft_consensus.cc:697] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:26.726122 23294 ts_tablet_manager.cc:1434] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:08:26.729787 23294 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:26.730963 23295 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:26.731528 23295 ts_tablet_manager.cc:1403] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.013s
I20260709 13:08:26.726017 23373 consensus_queue.cc:237] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.737100 23294 tablet_bootstrap.cc:654] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.739316 23296 tablet_bootstrap.cc:654] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.741700 23293 tablet_bootstrap.cc:492] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:26.742353 23293 ts_tablet_manager.cc:1403] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.008s
I20260709 13:08:26.747995 23293 raft_consensus.cc:359] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.748724 23293 raft_consensus.cc:385] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.748961 23293 raft_consensus.cc:740] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.749624 23293 consensus_queue.cc:260] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.754827 23293 ts_tablet_manager.cc:1434] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:08:26.755167 23402 raft_consensus.cc:493] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.755970 23295 raft_consensus.cc:359] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.756757 23295 raft_consensus.cc:385] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.756539 23402 raft_consensus.cc:515] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.757050 23295 raft_consensus.cc:740] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.757272 23293 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:26.757870 23295 consensus_queue.cc:260] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.746163 22922 catalog_manager.cc:5697] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.762092 23295 ts_tablet_manager.cc:1434] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:08:26.764135 23295 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:26.762413 23402 leader_election.cc:290] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:26.765626 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:26.766037 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:26.767009 23402 raft_consensus.cc:493] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.768462 23212 leader_election.cc:343] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:26.773173 23211 leader_election.cc:343] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.776114 23211 leader_election.cc:304] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:26.769177 23402 raft_consensus.cc:515] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.780047 23373 raft_consensus.cc:2749] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.781819 23295 tablet_bootstrap.cc:654] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.781991 23402 leader_election.cc:290] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:26.783627 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb649bdf39d4f11b38e2a5246a82b28" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:26.784003 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb649bdf39d4f11b38e2a5246a82b28" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:26.784611 23099 raft_consensus.cc:2393] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86f6c62fa9a94b679e852571485aa293 in current term 1: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
I20260709 13:08:26.785989 23294 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:26.786695 23294 ts_tablet_manager.cc:1403] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.010s
I20260709 13:08:26.786856 23211 leader_election.cc:304] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:26.787431 23296 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:26.788018 23296 ts_tablet_manager.cc:1403] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.015s
I20260709 13:08:26.788187 23293 tablet_bootstrap.cc:654] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.788208 23402 raft_consensus.cc:3060] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.790246 23294 raft_consensus.cc:359] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.790812 23296 raft_consensus.cc:359] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.796361 23294 raft_consensus.cc:385] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.796478 23296 raft_consensus.cc:385] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.796738 23294 raft_consensus.cc:740] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.796896 23296 raft_consensus.cc:740] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.797559 23294 consensus_queue.cc:260] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.797678 23296 consensus_queue.cc:260] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.797145 22919 catalog_manager.cc:5697] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.799919 23296 ts_tablet_manager.cc:1434] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:08:26.800033 23294 ts_tablet_manager.cc:1434] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:08:26.801121 23294 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:26.806770 23296 tablet_bootstrap.cc:492] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:26.809677 23295 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:26.810218 23295 ts_tablet_manager.cc:1403] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 13:08:26.794512 23293 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:26.812829 23293 ts_tablet_manager.cc:1403] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.004s
I20260709 13:08:26.813449 23402 raft_consensus.cc:2749] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.813397 23295 raft_consensus.cc:359] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.814343 23295 raft_consensus.cc:385] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.814646 23295 raft_consensus.cc:740] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.815474 23296 tablet_bootstrap.cc:654] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.815385 23295 consensus_queue.cc:260] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.817765 23295 ts_tablet_manager.cc:1434] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:26.818756 23295 tablet_bootstrap.cc:492] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:26.818533 23293 raft_consensus.cc:359] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.819168 23293 raft_consensus.cc:385] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.819355 23293 raft_consensus.cc:740] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.807371 23294 tablet_bootstrap.cc:654] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.820032 23293 consensus_queue.cc:260] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.821892 23173 raft_consensus.cc:3060] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.822528 23293 ts_tablet_manager.cc:1434] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:08:26.823860 23293 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:26.828639 23295 tablet_bootstrap.cc:654] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.833927 23293 tablet_bootstrap.cc:654] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.836907 23304 raft_consensus.cc:493] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.837607 23304 raft_consensus.cc:515] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.845157 23354 consensus_queue.cc:1048] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.853394 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab6a41e225bf43a8a84737c4cedbbff9" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:26.854514 23100 raft_consensus.cc:2393] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:26.855825 23304 leader_election.cc:290] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:26.861500 23293 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:26.856881 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab6a41e225bf43a8a84737c4cedbbff9" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:26.862283 23293 ts_tablet_manager.cc:1403] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.011s
I20260709 13:08:26.863735 23140 leader_election.cc:304] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:26.865370 23301 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.866097 23301 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.867635 23304 raft_consensus.cc:3060] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.879477 23301 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:26.880802 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:26.881633 23100 raft_consensus.cc:2468] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:26.882988 22989 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:26.887365 23293 raft_consensus.cc:359] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.888232 23293 raft_consensus.cc:385] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.888520 23293 raft_consensus.cc:740] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.889213 23293 consensus_queue.cc:260] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.890604 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:26.891304 23248 raft_consensus.cc:2468] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:26.891477 23293 ts_tablet_manager.cc:1434] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:08:26.892644 23293 tablet_bootstrap.cc:492] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:26.895000 23376 raft_consensus.cc:2804] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.895637 23376 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.896037 23376 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.901417 23375 consensus_queue.cc:1048] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.907454 23293 tablet_bootstrap.cc:654] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.908663 23354 raft_consensus.cc:493] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.909242 23354 raft_consensus.cc:515] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:26.910519 23335 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.911278 23335 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.913564 23354 leader_election.cc:290] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:26.914969 23335 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:26.916848 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:26.919212 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:26.920225 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:26.922508 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:26.923763 23248 raft_consensus.cc:2393] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:26.926879 23066 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:26.934610 23293 tablet_bootstrap.cc:492] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:26.935217 23293 ts_tablet_manager.cc:1403] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.013s
I20260709 13:08:26.939163 23335 raft_consensus.cc:3060] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.943451 23293 raft_consensus.cc:359] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.944285 23293 raft_consensus.cc:385] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.944586 23293 raft_consensus.cc:740] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.945372 23293 consensus_queue.cc:260] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.947604 23293 ts_tablet_manager.cc:1434] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:08:26.927984 23138 leader_election.cc:304] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:26.948633 23293 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:26.954506 23354 raft_consensus.cc:2749] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.970064 23376 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:26.973227 23293 tablet_bootstrap.cc:654] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.975133 23294 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:26.977784 23295 tablet_bootstrap.cc:492] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:26.978665 23304 raft_consensus.cc:2749] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.981976 23296 tablet_bootstrap.cc:492] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:26.982569 23294 ts_tablet_manager.cc:1403] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.182s	user 0.041s	sys 0.026s
I20260709 13:08:26.984108 23296 ts_tablet_manager.cc:1403] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.178s	user 0.053s	sys 0.057s
I20260709 13:08:26.987283 23296 raft_consensus.cc:359] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.988135 23296 raft_consensus.cc:385] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.988384 23296 raft_consensus.cc:740] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.989177 23296 consensus_queue.cc:260] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:26.991954 23296 ts_tablet_manager.cc:1434] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:08:26.993242 23296 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:26.983014 23295 ts_tablet_manager.cc:1403] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.164s	user 0.029s	sys 0.033s
I20260709 13:08:27.006567 23304 consensus_queue.cc:1048] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.983441 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:27.008327 23098 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.009933 23294 raft_consensus.cc:359] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.018224 23294 raft_consensus.cc:385] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.003928 23301 consensus_queue.cc:1048] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.983270 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:27.020416 23248 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.020309 23294 raft_consensus.cc:740] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.023021 23294 consensus_queue.cc:260] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.027647 23294 ts_tablet_manager.cc:1434] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 13:08:27.030561 23294 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:27.030860 23248 raft_consensus.cc:2468] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:27.034320 23402 raft_consensus.cc:493] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.034900 23402 raft_consensus.cc:515] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:26.982081 23376 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:27.018946 23295 raft_consensus.cc:359] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.019475 23391 raft_consensus.cc:493] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.039706 23295 raft_consensus.cc:385] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.040092 23295 raft_consensus.cc:740] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.001312 23296 tablet_bootstrap.cc:654] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.037215 23402 leader_election.cc:290] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:27.045501 23295 consensus_queue.cc:260] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.056229 23335 raft_consensus.cc:2749] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.057461 22991 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:27.058871 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161f6ffe19a04f97acb85cc3152a8234" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:27.059649 23024 raft_consensus.cc:2468] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:27.045087 23391 raft_consensus.cc:515] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.061054 23212 leader_election.cc:304] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:27.062114 23391 leader_election.cc:290] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:27.062714 23391 raft_consensus.cc:2804] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.062901 23301 consensus_queue.cc:1048] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.063854 23373 raft_consensus.cc:2804] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.064265 23373 raft_consensus.cc:493] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.064603 23373 raft_consensus.cc:3060] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.066120 23295 ts_tablet_manager.cc:1434] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:08:27.063203 23391 raft_consensus.cc:697] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:27.067946 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161f6ffe19a04f97acb85cc3152a8234" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.068163 23391 consensus_queue.cc:237] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.072463 23302 consensus_queue.cc:1048] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.079965 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:27.080832 23248 raft_consensus.cc:2468] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
W20260709 13:08:27.082386 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:27.091395 23295 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:27.095258 23293 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:27.096186 23293 ts_tablet_manager.cc:1403] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.148s	user 0.045s	sys 0.039s
W20260709 13:08:27.082480 23211 leader_election.cc:343] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.102994 23430 raft_consensus.cc:493] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.103922 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.098233 23302 raft_consensus.cc:493] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.082990 23098 raft_consensus.cc:2468] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:27.112746 22991 leader_election.cc:304] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:27.126220 23173 raft_consensus.cc:2468] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:27.146490 23293 raft_consensus.cc:359] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.147293 23293 raft_consensus.cc:385] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.125252 23430 raft_consensus.cc:515] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.147802 23293 raft_consensus.cc:740] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.147964 23402 consensus_queue.cc:1048] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.149722 23430 leader_election.cc:290] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:27.128567 23302 raft_consensus.cc:515] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.151446 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:27.152202 23302 leader_election.cc:290] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.152415 23024 raft_consensus.cc:2468] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:27.153016 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bb24234c374237ae3cfd67bca1c794" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:27.153699 23098 raft_consensus.cc:2468] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:27.154803 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:27.155892 23099 raft_consensus.cc:2468] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:27.157366 23295 tablet_bootstrap.cc:654] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.136955 23375 raft_consensus.cc:2804] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.160391 23375 raft_consensus.cc:493] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.160903 23375 raft_consensus.cc:3060] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.154984 23212 leader_election.cc:304] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:27.166680 23296 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:27.167416 23296 ts_tablet_manager.cc:1403] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.174s	user 0.027s	sys 0.012s
I20260709 13:08:27.169981 23138 leader_election.cc:304] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:27.170571 23296 raft_consensus.cc:359] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.171312 23296 raft_consensus.cc:385] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.171602 23296 raft_consensus.cc:740] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.172330 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bb24234c374237ae3cfd67bca1c794" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.173358 23173 raft_consensus.cc:2468] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:27.177690 23402 raft_consensus.cc:2804] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.178272 23402 raft_consensus.cc:493] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.178719 23402 raft_consensus.cc:3060] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.180882 23376 consensus_queue.cc:1048] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.181957 23430 raft_consensus.cc:2804] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.182497 23430 raft_consensus.cc:493] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.182930 23430 raft_consensus.cc:3060] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.191571 23294 tablet_bootstrap.cc:654] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.172354 23296 consensus_queue.cc:260] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.199893 23293 consensus_queue.cc:260] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.207762 23328 raft_consensus.cc:493] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.208413 23328 raft_consensus.cc:515] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.210790 23328 leader_election.cc:290] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:27.210263 23375 raft_consensus.cc:515] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.228291 23293 ts_tablet_manager.cc:1434] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.132s	user 0.012s	sys 0.001s
I20260709 13:08:27.234418 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a804057f5f4d50bb94ce2f719a663a" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:27.235000 23375 leader_election.cc:290] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:27.236774 23296 ts_tablet_manager.cc:1434] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.001s
I20260709 13:08:27.238293 23296 tablet_bootstrap.cc:492] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:27.236667 23099 raft_consensus.cc:2468] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:27.236673 23373 raft_consensus.cc:515] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.240523 23433 raft_consensus.cc:493] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.241524 23373 leader_election.cc:290] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:27.241196 23433 raft_consensus.cc:515] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.243979 23293 tablet_bootstrap.cc:492] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:27.250257 23433 leader_election.cc:290] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.252542 23296 tablet_bootstrap.cc:654] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.255097 23402 raft_consensus.cc:515] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.261058 23402 leader_election.cc:290] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.263350 23295 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:27.264201 23295 ts_tablet_manager.cc:1403] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.173s	user 0.022s	sys 0.012s
I20260709 13:08:27.267653 23295 raft_consensus.cc:359] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.268438 23295 raft_consensus.cc:385] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.268776 23295 raft_consensus.cc:740] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.270066 23295 consensus_queue.cc:260] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.274775 23295 ts_tablet_manager.cc:1434] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:27.276165 23295 tablet_bootstrap.cc:492] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:27.272330 23430 raft_consensus.cc:515] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.278083 23430 leader_election.cc:290] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:27.278162 23294 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:27.322590 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a804057f5f4d50bb94ce2f719a663a" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:27.333038 23294 ts_tablet_manager.cc:1403] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.303s	user 0.019s	sys 0.021s
I20260709 13:08:27.333922 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a804057f5f4d50bb94ce2f719a663a" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:27.334913 23064 leader_election.cc:343] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.326265 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:27.335978 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bb24234c374237ae3cfd67bca1c794" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:27.336827 23174 raft_consensus.cc:3060] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.337157 23099 raft_consensus.cc:3060] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.340011 23294 raft_consensus.cc:359] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.341455 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a804057f5f4d50bb94ce2f719a663a" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.342885 23173 raft_consensus.cc:2468] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:27.326771 23138 leader_election.cc:304] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:27.330056 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:27.344926 23248 raft_consensus.cc:3060] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.346376 23304 raft_consensus.cc:2804] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.346975 23304 raft_consensus.cc:493] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.325210 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161f6ffe19a04f97acb85cc3152a8234" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:27.349064 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:27.349713 23024 raft_consensus.cc:3060] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.352203 23097 raft_consensus.cc:3060] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.354120 23373 consensus_queue.cc:1048] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.355176 23063 leader_election.cc:304] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:27.364488 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161f6ffe19a04f97acb85cc3152a8234" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:27.365850 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bb24234c374237ae3cfd67bca1c794" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:27.366956 23173 raft_consensus.cc:3060] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.369156 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:27.370312 23025 raft_consensus.cc:3060] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.374217 23335 raft_consensus.cc:2804] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.374809 23335 raft_consensus.cc:493] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.375227 23335 raft_consensus.cc:3060] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.347476 23304 raft_consensus.cc:3060] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.377210 23097 raft_consensus.cc:2468] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:27.383208 23099 raft_consensus.cc:2468] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:27.385283 23212 leader_election.cc:304] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:27.386329 23373 raft_consensus.cc:2804] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.387004 23373 raft_consensus.cc:697] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
W20260709 13:08:27.388587 23211 leader_election.cc:343] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.388449 23373 consensus_queue.cc:237] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.389663 23302 consensus_queue.cc:1048] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.398722 23295 tablet_bootstrap.cc:654] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.341518 23294 raft_consensus.cc:385] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.405843 23294 raft_consensus.cc:740] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.411000 23293 tablet_bootstrap.cc:654] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.409884 23138 leader_election.cc:304] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:27.419423 23294 consensus_queue.cc:260] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.427651 23022 raft_consensus.cc:2468] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:27.442534 23433 raft_consensus.cc:493] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.443388 23433 raft_consensus.cc:515] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.446264 23433 leader_election.cc:290] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:27.446964 23402 raft_consensus.cc:493] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.447746 23402 raft_consensus.cc:515] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.449659 23335 raft_consensus.cc:515] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.450307 23430 raft_consensus.cc:2804] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.451118 23430 raft_consensus.cc:697] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:27.457630 23335 leader_election.cc:290] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.447337 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481244be0dff49389d585c9e9c8d2384" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.460963 23021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a804057f5f4d50bb94ce2f719a663a" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
W20260709 13:08:27.461967 23063 leader_election.cc:343] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.464555 23373 raft_consensus.cc:493] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.469360 23304 raft_consensus.cc:515] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.488085 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481244be0dff49389d585c9e9c8d2384" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:27.488933 23247 raft_consensus.cc:2468] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:27.490556 23294 ts_tablet_manager.cc:1434] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.157s	user 0.014s	sys 0.002s
I20260709 13:08:27.482208 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a804057f5f4d50bb94ce2f719a663a" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:27.496611 23430 consensus_queue.cc:237] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.497648 23294 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:27.501206 23402 leader_election.cc:290] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.504839 23171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481244be0dff49389d585c9e9c8d2384" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.505746 23172 raft_consensus.cc:2393] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
W20260709 13:08:27.507359 23211 leader_election.cc:343] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.508599 23248 raft_consensus.cc:2468] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:27.508973 22919 catalog_manager.cc:5697] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.492527 23024 raft_consensus.cc:2468] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:27.514585 23066 leader_election.cc:304] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:27.518081 23293 tablet_bootstrap.cc:492] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:27.534546 23293 ts_tablet_manager.cc:1403] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.291s	user 0.019s	sys 0.003s
I20260709 13:08:27.535590 23025 raft_consensus.cc:2468] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:27.485781 23373 raft_consensus.cc:515] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.538126 23293 raft_consensus.cc:359] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.538552 23373 leader_election.cc:290] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:27.538895 23293 raft_consensus.cc:385] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.539237 23293 raft_consensus.cc:740] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.522092 23063 leader_election.cc:304] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:27.548691 23293 consensus_queue.cc:260] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.549278 23335 raft_consensus.cc:2749] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.494084 23174 raft_consensus.cc:2468] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:27.551136 23293 ts_tablet_manager.cc:1434] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:08:27.525003 23304 leader_election.cc:290] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:27.539626 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.542590 23296 tablet_bootstrap.cc:492] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:27.544508 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a804057f5f4d50bb94ce2f719a663a" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:27.545642 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a804057f5f4d50bb94ce2f719a663a" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:27.555871 23023 raft_consensus.cc:3060] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.556233 23100 raft_consensus.cc:2393] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:27.517722 22991 leader_election.cc:304] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:27.557885 23173 raft_consensus.cc:2468] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:27.547792 23451 raft_consensus.cc:2804] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.559268 23451 raft_consensus.cc:493] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.559887 23451 raft_consensus.cc:3060] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:27.563870 23211 leader_election.cc:343] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.566957 23296 ts_tablet_manager.cc:1403] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.329s	user 0.012s	sys 0.025s
I20260709 13:08:27.567807 23301 raft_consensus.cc:2804] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.568442 23301 raft_consensus.cc:697] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:27.568593 23375 consensus_queue.cc:1048] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.570613 23294 tablet_bootstrap.cc:654] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.552618 23293 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:27.574829 23301 consensus_queue.cc:237] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.595649 23391 consensus_queue.cc:1048] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.597373 23451 raft_consensus.cc:515] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.600080 23451 leader_election.cc:290] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:27.587975 23296 raft_consensus.cc:359] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.600903 23296 raft_consensus.cc:385] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.601577 23296 raft_consensus.cc:740] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.606173 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481244be0dff49389d585c9e9c8d2384" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:27.607463 23099 raft_consensus.cc:2393] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86f6c62fa9a94b679e852571485aa293 in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:27.600868 23023 raft_consensus.cc:2468] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:27.609756 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481244be0dff49389d585c9e9c8d2384" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:27.610349 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481244be0dff49389d585c9e9c8d2384" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:27.613116 23296 consensus_queue.cc:260] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.619231 23173 raft_consensus.cc:3060] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.611145 23246 raft_consensus.cc:3060] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.640244 22922 catalog_manager.cc:5697] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.641157 23212 leader_election.cc:304] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:27.642242 23294 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:27.643028 23294 ts_tablet_manager.cc:1403] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.146s	user 0.002s	sys 0.014s
I20260709 13:08:27.642316 23455 raft_consensus.cc:2804] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.650823 23455 raft_consensus.cc:697] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:27.653481 23455 consensus_queue.cc:237] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.656801 23294 raft_consensus.cc:359] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.660580 23294 raft_consensus.cc:385] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.660944 23294 raft_consensus.cc:740] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
W20260709 13:08:27.655869 22988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 63445.7us
I20260709 13:08:27.664260 23295 tablet_bootstrap.cc:492] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:27.664991 23295 ts_tablet_manager.cc:1403] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.389s	user 0.024s	sys 0.009s
I20260709 13:08:27.664717 23138 leader_election.cc:304] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:27.667687 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:27.669555 23302 raft_consensus.cc:493] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.671684 23294 consensus_queue.cc:260] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.670070 23302 raft_consensus.cc:515] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.670012 23304 raft_consensus.cc:2804] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.674340 23304 raft_consensus.cc:697] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:27.675405 23304 consensus_queue.cc:237] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.676739 23293 tablet_bootstrap.cc:654] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.675494 23302 leader_election.cc:290] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.678398 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95cb3974c72b4e05a01a96155e84d50c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.678220 23295 raft_consensus.cc:359] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.679179 23295 raft_consensus.cc:385] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.679555 23295 raft_consensus.cc:740] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.670046 23212 leader_election.cc:304] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:27.688628 23295 consensus_queue.cc:260] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
W20260709 13:08:27.688860 23211 leader_election.cc:343] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.691000 23451 raft_consensus.cc:493] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.699745 23451 raft_consensus.cc:515] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.694249 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95cb3974c72b4e05a01a96155e84d50c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:27.702980 23100 raft_consensus.cc:2468] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
W20260709 13:08:27.695901 23212 leader_election.cc:343] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.705327 23295 ts_tablet_manager.cc:1434] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:08:27.705240 23212 leader_election.cc:304] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:27.705534 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be29e709cce745f3b2421a0de2d75730" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.705734 23246 raft_consensus.cc:2468] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:27.706403 23455 raft_consensus.cc:2749] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.703933 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be29e709cce745f3b2421a0de2d75730" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:27.693228 23293 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:27.690225 23294 ts_tablet_manager.cc:1434] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.001s
I20260709 13:08:27.702064 23451 leader_election.cc:290] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.701222 23173 raft_consensus.cc:2468] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:27.706868 23295 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:27.707304 23302 raft_consensus.cc:2749] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.726148 23294 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:27.707270 23066 leader_election.cc:304] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:27.728772 23293 ts_tablet_manager.cc:1403] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.176s	user 0.017s	sys 0.005s
I20260709 13:08:27.729406 23451 raft_consensus.cc:2804] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.724371 23023 raft_consensus.cc:2468] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:27.732905 23451 raft_consensus.cc:697] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:27.733206 23296 ts_tablet_manager.cc:1434] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.166s	user 0.009s	sys 0.004s
I20260709 13:08:27.733994 23451 consensus_queue.cc:237] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.734825 23295 tablet_bootstrap.cc:654] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.735628 23296 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:27.738103 23293 raft_consensus.cc:359] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.738919 23293 raft_consensus.cc:385] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.717262 23212 leader_election.cc:304] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
W20260709 13:08:27.707216 23063 leader_election.cc:343] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.740075 23402 raft_consensus.cc:2804] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.740545 23402 raft_consensus.cc:493] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.741214 23402 raft_consensus.cc:3060] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.740438 23063 leader_election.cc:304] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:27.752243 23296 tablet_bootstrap.cc:654] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.752591 23335 raft_consensus.cc:2804] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.753108 23335 raft_consensus.cc:493] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.753526 23335 raft_consensus.cc:3060] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.764087 22923 catalog_manager.cc:5697] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:27.769105 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 61910.3us
I20260709 13:08:27.771229 23335 raft_consensus.cc:515] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.774581 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be29e709cce745f3b2421a0de2d75730" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:27.775270 23023 raft_consensus.cc:3060] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.782284 23402 raft_consensus.cc:515] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.784587 23402 leader_election.cc:290] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.785671 23335 leader_election.cc:290] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:27.788564 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95cb3974c72b4e05a01a96155e84d50c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:27.739369 23293 raft_consensus.cc:740] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
W20260709 13:08:27.790787 23211 leader_election.cc:343] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.791718 23295 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:27.790916 23293 consensus_queue.cc:260] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.792284 23295 ts_tablet_manager.cc:1403] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.086s	user 0.006s	sys 0.008s
I20260709 13:08:27.796169 23293 ts_tablet_manager.cc:1434] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 13:08:27.797432 23293 tablet_bootstrap.cc:492] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:27.797626 23295 raft_consensus.cc:359] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.799466 23295 raft_consensus.cc:385] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.799808 23295 raft_consensus.cc:740] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.800582 23295 consensus_queue.cc:260] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.801084 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be29e709cce745f3b2421a0de2d75730" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:27.803669 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95cb3974c72b4e05a01a96155e84d50c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:27.804324 23100 raft_consensus.cc:3060] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.808040 23295 ts_tablet_manager.cc:1434] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:08:27.809229 23295 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:27.809556 23293 tablet_bootstrap.cc:654] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.810804 23023 raft_consensus.cc:2468] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:27.812260 23064 leader_election.cc:304] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:27.813423 23335 raft_consensus.cc:2804] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.813930 23100 raft_consensus.cc:2468] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:27.814061 23335 raft_consensus.cc:697] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:27.815471 23335 consensus_queue.cc:237] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:27.794029 23294 tablet_bootstrap.cc:654] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:27.823784 23063 leader_election.cc:343] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.825146 23296 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:27.825657 23296 ts_tablet_manager.cc:1403] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.020s
I20260709 13:08:27.829054 23296 raft_consensus.cc:359] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.828660 22922 catalog_manager.cc:5697] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.830809 23294 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:27.830602 23212 leader_election.cc:304] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:27.831322 23294 ts_tablet_manager.cc:1403] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.004s
I20260709 13:08:27.831957 23402 raft_consensus.cc:2804] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.832496 23402 raft_consensus.cc:697] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:27.833408 23402 consensus_queue.cc:237] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.834206 23294 raft_consensus.cc:359] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.834930 23294 raft_consensus.cc:385] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.835196 23294 raft_consensus.cc:740] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.829780 23296 raft_consensus.cc:385] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.840854 23296 raft_consensus.cc:740] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.841699 23296 consensus_queue.cc:260] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.843608 23293 tablet_bootstrap.cc:492] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:27.844122 23293 ts_tablet_manager.cc:1403] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.000s
I20260709 13:08:27.844725 23295 tablet_bootstrap.cc:654] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.846542 22921 catalog_manager.cc:5697] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.847955 23296 ts_tablet_manager.cc:1434] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:08:27.849370 23296 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:27.847658 23293 raft_consensus.cc:359] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.850855 23294 consensus_queue.cc:260] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.850857 23293 raft_consensus.cc:385] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.852646 23293 raft_consensus.cc:740] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.853531 23293 consensus_queue.cc:260] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:27.855728 23293 ts_tablet_manager.cc:1434] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:08:27.856899 23293 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:27.862303 23296 tablet_bootstrap.cc:654] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.870189 23293 tablet_bootstrap.cc:654] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.871778 23294 ts_tablet_manager.cc:1434] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:08:27.873220 23294 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:27.875833 22919 catalog_manager.cc:5697] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.883574 23294 tablet_bootstrap.cc:654] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.884694 23293 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:27.885334 23293 ts_tablet_manager.cc:1403] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.001s
I20260709 13:08:27.889427 23296 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:27.890205 23296 ts_tablet_manager.cc:1403] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.002s
I20260709 13:08:27.894474 23376 raft_consensus.cc:493] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.895226 23376 raft_consensus.cc:515] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.897136 22923 catalog_manager.cc:5697] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.897053 23296 raft_consensus.cc:359] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.900240 23296 raft_consensus.cc:385] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.900609 23296 raft_consensus.cc:740] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.900902 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:27.901656 23100 raft_consensus.cc:2468] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:27.901741 23296 consensus_queue.cc:260] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.903311 22989 leader_election.cc:304] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:27.904332 23375 raft_consensus.cc:2804] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.904740 23375 raft_consensus.cc:493] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.905102 23375 raft_consensus.cc:3060] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.898495 23293 raft_consensus.cc:359] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.909567 23293 raft_consensus.cc:385] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.909947 23293 raft_consensus.cc:740] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.910921 23293 consensus_queue.cc:260] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.898723 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:27.912442 23246 raft_consensus.cc:2468] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:27.914069 23376 leader_election.cc:290] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:27.917804 23375 raft_consensus.cc:515] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.920948 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:27.921612 23246 raft_consensus.cc:3060] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.927069 23293 ts_tablet_manager.cc:1434] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:08:27.928709 23293 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:27.926386 22920 catalog_manager.cc:5697] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.931491 23402 raft_consensus.cc:493] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.932260 23296 ts_tablet_manager.cc:1434] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:08:27.932121 23402 raft_consensus.cc:515] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.935961 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:27.936923 23455 consensus_queue.cc:1048] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:27.937820 23212 leader_election.cc:343] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.938853 23294 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:27.939234 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:27.940786 23296 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
W20260709 13:08:27.941377 23211 leader_election.cc:343] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.941860 23211 leader_election.cc:304] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:27.942678 23402 leader_election.cc:290] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:27.944770 23455 raft_consensus.cc:2749] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.939393 23294 ts_tablet_manager.cc:1403] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.042s
I20260709 13:08:27.949065 23296 tablet_bootstrap.cc:654] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.955219 23246 raft_consensus.cc:2468] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:27.957751 22991 leader_election.cc:304] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:27.957653 23294 raft_consensus.cc:359] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.958595 23294 raft_consensus.cc:385] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.958920 23301 raft_consensus.cc:2804] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.959573 23301 raft_consensus.cc:697] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:27.960513 23301 consensus_queue.cc:237] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:27.961174 23293 tablet_bootstrap.cc:654] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.958900 23294 raft_consensus.cc:740] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.966053 23294 consensus_queue.cc:260] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:27.969830 22918 catalog_manager.cc:5697] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.980489 23294 ts_tablet_manager.cc:1434] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 13:08:27.981261 23430 consensus_queue.cc:1048] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.986083 23294 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:27.988737 23402 consensus_queue.cc:1048] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.991314 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:27.992067 23100 raft_consensus.cc:3060] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.988200 23375 leader_election.cc:290] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:27.997972 23295 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:27.998571 23295 ts_tablet_manager.cc:1403] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.030s
I20260709 13:08:28.005371 23295 raft_consensus.cc:359] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.006220 23295 raft_consensus.cc:385] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.006560 23295 raft_consensus.cc:740] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.007422 23295 consensus_queue.cc:260] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.013770 23294 tablet_bootstrap.cc:654] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.024529 22922 catalog_manager.cc:5697] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.029107 23296 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:28.029687 23296 ts_tablet_manager.cc:1403] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.012s
I20260709 13:08:28.031495 23295 ts_tablet_manager.cc:1434] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.001s
I20260709 13:08:28.032721 23295 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:28.039460 23295 tablet_bootstrap.cc:654] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.043381 23293 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:28.044137 23293 ts_tablet_manager.cc:1403] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.001s
I20260709 13:08:28.047358 23293 raft_consensus.cc:359] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.058569 23293 raft_consensus.cc:385] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.058902 23293 raft_consensus.cc:740] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.060998 23293 consensus_queue.cc:260] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.064218 23301 consensus_queue.cc:1048] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.065006 23100 raft_consensus.cc:2468] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.066169 23293 ts_tablet_manager.cc:1434] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:08:28.067480 23293 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:28.063325 23296 raft_consensus.cc:359] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.069200 23296 raft_consensus.cc:385] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.069761 23296 raft_consensus.cc:740] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.074985 23294 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:28.075847 23294 ts_tablet_manager.cc:1403] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.000s
I20260709 13:08:28.080163 23294 raft_consensus.cc:359] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.082852 23294 raft_consensus.cc:385] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.083294 23294 raft_consensus.cc:740] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.099515 23430 consensus_queue.cc:1048] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.092252 23294 consensus_queue.cc:260] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.102500 23294 ts_tablet_manager.cc:1434] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:08:28.100059 23391 raft_consensus.cc:493] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.104251 23391 raft_consensus.cc:515] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.106856 23391 leader_election.cc:290] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:28.112058 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:28.112300 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:28.113005 23248 raft_consensus.cc:2468] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:28.113340 23174 raft_consensus.cc:2468] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:28.119282 23294 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:28.119755 22991 leader_election.cc:304] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:28.122273 23376 raft_consensus.cc:2804] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.122695 23376 raft_consensus.cc:493] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.122816 23293 tablet_bootstrap.cc:654] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.123116 23376 raft_consensus.cc:3060] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.135164 23296 consensus_queue.cc:260] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.139742 23391 consensus_queue.cc:1048] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.148432 23295 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:28.148989 23295 ts_tablet_manager.cc:1403] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.117s	user 0.035s	sys 0.007s
I20260709 13:08:28.151204 23373 raft_consensus.cc:493] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.152472 23294 tablet_bootstrap.cc:654] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.151970 23373 raft_consensus.cc:515] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.152746 23295 raft_consensus.cc:359] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.156550 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:28.160286 23212 leader_election.cc:343] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.158409 23295 raft_consensus.cc:385] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.162794 23295 raft_consensus.cc:740] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.156878 23373 leader_election.cc:290] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:28.163901 23295 consensus_queue.cc:260] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.174438 23295 ts_tablet_manager.cc:1434] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:08:28.175745 23295 tablet_bootstrap.cc:492] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:28.178134 23376 raft_consensus.cc:515] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.184617 23304 consensus_queue.cc:1048] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.188845 23294 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:28.189455 23294 ts_tablet_manager.cc:1403] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.071s	user 0.005s	sys 0.010s
I20260709 13:08:28.194046 23294 raft_consensus.cc:359] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.194974 23294 raft_consensus.cc:385] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.195271 23294 raft_consensus.cc:740] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.196105 23294 consensus_queue.cc:260] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.199092 23294 ts_tablet_manager.cc:1434] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:08:28.200920 23294 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:28.203773 23295 tablet_bootstrap.cc:654] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.207324 23430 raft_consensus.cc:493] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.207904 23430 raft_consensus.cc:515] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.208669 23294 tablet_bootstrap.cc:654] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.210178 23430 leader_election.cc:290] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:28.210975 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
W20260709 13:08:28.211479 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:28.211712 23248 raft_consensus.cc:3060] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.212531 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:28.225095 23376 leader_election.cc:290] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:28.185048 23296 ts_tablet_manager.cc:1434] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.155s	user 0.010s	sys 0.000s
I20260709 13:08:28.228734 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be29e709cce745f3b2421a0de2d75730" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:28.229300 23296 tablet_bootstrap.cc:492] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:28.229732 23025 raft_consensus.cc:2393] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:28.234088 23294 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:28.234695 23294 ts_tablet_manager.cc:1403] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.009s
I20260709 13:08:28.234284 23335 consensus_queue.cc:1048] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:08:28.236155 23248 raft_consensus.cc:2468] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.234120 23293 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:28.237674 23293 ts_tablet_manager.cc:1403] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.170s	user 0.035s	sys 0.012s
I20260709 13:08:28.238878 22991 leader_election.cc:304] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:28.237659 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:28.239944 23391 raft_consensus.cc:2804] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.240314 23173 raft_consensus.cc:3060] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.240492 23391 raft_consensus.cc:697] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:28.241529 23391 consensus_queue.cc:237] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.245157 23293 raft_consensus.cc:359] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.245893 23293 raft_consensus.cc:385] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.246214 23293 raft_consensus.cc:740] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.247936 23293 consensus_queue.cc:260] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.252213 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be29e709cce745f3b2421a0de2d75730" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:28.253361 23211 leader_election.cc:343] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.253890 23211 leader_election.cc:304] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:28.254144 23295 tablet_bootstrap.cc:492] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:28.254726 23295 ts_tablet_manager.cc:1403] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.008s
I20260709 13:08:28.256196 23455 raft_consensus.cc:2749] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.258023 23295 raft_consensus.cc:359] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.258846 23295 raft_consensus.cc:385] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.259136 23295 raft_consensus.cc:740] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.252389 23294 raft_consensus.cc:359] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.261691 23294 raft_consensus.cc:385] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.261972 23294 raft_consensus.cc:740] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.262822 23294 consensus_queue.cc:260] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.264199 23293 ts_tablet_manager.cc:1434] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:08:28.265377 23293 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:28.265460 23294 ts_tablet_manager.cc:1434] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:08:28.266886 23294 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:28.260111 23295 consensus_queue.cc:260] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.268702 23173 raft_consensus.cc:2468] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.283380 23295 ts_tablet_manager.cc:1434] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:08:28.286711 23296 tablet_bootstrap.cc:654] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.287732 23295 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:28.299793 22918 catalog_manager.cc:5697] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.302929 23294 tablet_bootstrap.cc:654] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.310585 23373 consensus_queue.cc:1048] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.313176 23451 consensus_queue.cc:1048] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.336143 23174 raft_consensus.cc:3060] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.345165 23172 raft_consensus.cc:3060] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.351826 23376 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.354897 23301 consensus_queue.cc:1048] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.358677 23138 leader_election.cc:304] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
W20260709 13:08:28.360690 23211 consensus_peers.cc:597] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.362627 23293 tablet_bootstrap.cc:654] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.363752 23295 tablet_bootstrap.cc:654] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.363619 23376 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.385178 23391 consensus_queue.cc:1048] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.386030 23499 consensus_queue.cc:1048] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.387665 23376 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:28.390161 23294 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:28.390779 23294 ts_tablet_manager.cc:1403] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.021s
I20260709 13:08:28.390712 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:28.392452 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:28.393170 23247 raft_consensus.cc:2468] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:28.393963 23098 raft_consensus.cc:2468] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:28.395773 22989 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:28.397387 23373 consensus_queue.cc:1048] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.402474 23451 raft_consensus.cc:493] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.403316 23451 raft_consensus.cc:515] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.407212 23451 leader_election.cc:290] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:28.409411 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:28.410476 23493 raft_consensus.cc:493] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.410996 23493 raft_consensus.cc:515] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.422305 23296 tablet_bootstrap.cc:492] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:28.422842 23296 ts_tablet_manager.cc:1403] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.000s
I20260709 13:08:28.420442 23376 raft_consensus.cc:2804] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:28.421902 23063 leader_election.cc:343] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.424504 23376 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.424957 23376 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.433320 23294 raft_consensus.cc:359] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.434360 23294 raft_consensus.cc:385] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.436156 23294 raft_consensus.cc:740] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.432773 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:28.437760 23294 consensus_queue.cc:260] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.440497 23304 raft_consensus.cc:2749] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.441603 23294 ts_tablet_manager.cc:1434] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.002s
I20260709 13:08:28.442098 23493 leader_election.cc:290] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:28.442353 23335 consensus_queue.cc:1048] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.444878 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161f6ffe19a04f97acb85cc3152a8234" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:28.449085 23451 consensus_queue.cc:1048] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.451581 23296 raft_consensus.cc:359] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.457664 23376 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.455605 23296 raft_consensus.cc:385] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.459444 23296 raft_consensus.cc:740] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.464360 23293 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:28.465181 23293 ts_tablet_manager.cc:1403] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.200s	user 0.012s	sys 0.006s
I20260709 13:08:28.469444 23294 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:28.439064 23025 raft_consensus.cc:2468] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:28.472787 23064 leader_election.cc:304] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:28.476254 23335 raft_consensus.cc:2804] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.476742 23335 raft_consensus.cc:493] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.477134 23335 raft_consensus.cc:3060] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.484494 23296 consensus_queue.cc:260] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.488377 23296 ts_tablet_manager.cc:1434] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 13:08:28.500151 23296 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:28.496433 23455 consensus_queue.cc:1048] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:08:28.510102 23376 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:28.517841 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161f6ffe19a04f97acb85cc3152a8234" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:28.520182 23138 leader_election.cc:304] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:28.521937 23499 raft_consensus.cc:2749] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.512039 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:28.529306 23246 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.532056 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:28.536456 23294 tablet_bootstrap.cc:654] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.540866 23100 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.548655 23293 raft_consensus.cc:359] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.549463 23293 raft_consensus.cc:385] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.549742 23293 raft_consensus.cc:740] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.560554 23295 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:28.565347 23295 ts_tablet_manager.cc:1403] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.280s	user 0.013s	sys 0.015s
I20260709 13:08:28.567726 23391 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.568363 23391 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.557555 23335 raft_consensus.cc:515] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.576951 23293 consensus_queue.cc:260] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.590466 23295 raft_consensus.cc:359] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.591391 23295 raft_consensus.cc:385] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.591722 23295 raft_consensus.cc:740] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.594696 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:28.596004 23293 ts_tablet_manager.cc:1434] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.000s
I20260709 13:08:28.594861 23391 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:28.600062 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:28.602567 23402 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.602901 22988 leader_election.cc:343] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.603202 23402 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.606588 23402 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:28.613122 23296 tablet_bootstrap.cc:654] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.614225 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:28.616219 23212 leader_election.cc:343] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.619261 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:28.621685 23212 leader_election.cc:343] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.622334 23212 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:28.623219 23402 raft_consensus.cc:2749] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.627832 23335 leader_election.cc:290] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:28.628667 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:28.628880 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:28.629416 23024 raft_consensus.cc:3060] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:28.630218 23063 leader_election.cc:343] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.592486 23295 consensus_queue.cc:260] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.638211 23099 raft_consensus.cc:2468] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:28.643567 22989 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:28.644697 23100 raft_consensus.cc:2468] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.644897 23376 raft_consensus.cc:2804] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.647505 23295 ts_tablet_manager.cc:1434] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:08:28.644342 23294 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:28.651763 23294 ts_tablet_manager.cc:1403] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.025s
I20260709 13:08:28.647874 23376 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.652256 23376 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.656138 23295 tablet_bootstrap.cc:492] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:28.649367 22989 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:28.659159 23301 raft_consensus.cc:2804] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.659762 23301 raft_consensus.cc:697] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:28.661047 23174 raft_consensus.cc:3060] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.660805 23301 consensus_queue.cc:237] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.664259 23295 tablet_bootstrap.cc:654] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.645437 23293 tablet_bootstrap.cc:492] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:28.675292 23293 tablet_bootstrap.cc:654] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.675482 23294 raft_consensus.cc:359] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.699890 23294 raft_consensus.cc:385] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.676266 23515 raft_consensus.cc:493] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.693186 23296 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:28.650333 23246 raft_consensus.cc:2468] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.701511 23296 ts_tablet_manager.cc:1403] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.202s	user 0.022s	sys 0.000s
I20260709 13:08:28.703307 23295 tablet_bootstrap.cc:492] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:28.703989 23295 ts_tablet_manager.cc:1403] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.048s	user 0.035s	sys 0.011s
I20260709 13:08:28.693186 23293 tablet_bootstrap.cc:492] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:28.679253 23024 raft_consensus.cc:2468] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:28.704713 23293 ts_tablet_manager.cc:1403] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.002s
I20260709 13:08:28.700292 23294 raft_consensus.cc:740] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.705951 23064 leader_election.cc:304] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:28.707222 23402 raft_consensus.cc:493] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.707096 23295 raft_consensus.cc:359] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.700896 23515 raft_consensus.cc:515] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.707646 23296 raft_consensus.cc:359] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.707978 23295 raft_consensus.cc:385] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.707818 23402 raft_consensus.cc:515] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.708462 23296 raft_consensus.cc:385] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.708498 23295 raft_consensus.cc:740] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.708932 23296 raft_consensus.cc:740] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.709419 23295 consensus_queue.cc:260] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.709618 23294 consensus_queue.cc:260] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.710011 23515 leader_election.cc:290] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:28.711807 23295 ts_tablet_manager.cc:1434] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:28.712159 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:28.712590 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:28.712935 23246 raft_consensus.cc:2468] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:28.713361 23295 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:28.714313 23066 leader_election.cc:304] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
W20260709 13:08:28.715276 23063 leader_election.cc:343] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.715600 23294 ts_tablet_manager.cc:1434] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:08:28.716297 23451 raft_consensus.cc:2804] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.716773 23451 raft_consensus.cc:493] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.717226 23451 raft_consensus.cc:3060] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.717235 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:28.719060 22922 catalog_manager.cc:5697] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:28.720510 23212 leader_election.cc:343] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.721163 23295 tablet_bootstrap.cc:654] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.716830 23294 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:28.721930 23296 consensus_queue.cc:260] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.707741 23335 raft_consensus.cc:2804] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.723932 23293 raft_consensus.cc:359] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.726759 23293 raft_consensus.cc:385] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.726984 23293 raft_consensus.cc:740] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.728024 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:28.729442 23335 raft_consensus.cc:697] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:28.722254 23402 leader_election.cc:290] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:28.734948 23296 ts_tablet_manager.cc:1434] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:08:28.730476 23335 consensus_queue.cc:237] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.736207 23296 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:28.738483 23293 consensus_queue.cc:260] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.730711 23515 raft_consensus.cc:493] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.678129 23376 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.746066 23376 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:28.740736 23515 raft_consensus.cc:515] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.746367 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
W20260709 13:08:28.737260 23211 leader_election.cc:343] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.748524 23211 leader_election.cc:304] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:28.749955 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:28.750386 23515 leader_election.cc:290] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:28.752007 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:28.752781 23246 raft_consensus.cc:2468] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:28.753966 23301 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.752267 22988 leader_election.cc:343] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.754336 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:28.754535 23301 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.754314 23066 leader_election.cc:304] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:28.756963 23301 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:28.757469 23301 raft_consensus.cc:493] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.758183 23294 tablet_bootstrap.cc:654] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:28.757994 23063 leader_election.cc:343] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.747121 23098 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.757936 23301 raft_consensus.cc:515] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.760027 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:28.762558 22989 leader_election.cc:343] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.765113 23455 raft_consensus.cc:2749] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.768294 23515 raft_consensus.cc:2804] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.768196 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:28.768781 23515 raft_consensus.cc:493] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.769029 23246 raft_consensus.cc:2468] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:28.769163 23515 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.775980 22991 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:28.777594 23375 raft_consensus.cc:2804] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.777997 23375 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.778322 23375 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.778772 23391 consensus_queue.cc:1048] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.788415 23515 raft_consensus.cc:515] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.794483 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
W20260709 13:08:28.796299 23063 leader_election.cc:343] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.796600 23301 leader_election.cc:290] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:28.796751 23296 tablet_bootstrap.cc:654] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.790881 23293 ts_tablet_manager.cc:1434] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.086s	user 0.002s	sys 0.005s
I20260709 13:08:28.798779 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:28.799515 23246 raft_consensus.cc:2468] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:28.799995 23293 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:28.813131 23515 leader_election.cc:290] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:28.822969 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:28.823832 23174 raft_consensus.cc:2468] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:28.825467 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:28.826099 23246 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.826452 23375 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.829946 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
W20260709 13:08:28.831439 22989 leader_election.cc:343] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.823729 22991 leader_election.cc:304] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:28.833200 23301 raft_consensus.cc:2804] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.833595 23301 raft_consensus.cc:493] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.833938 23301 raft_consensus.cc:3060] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.838502 23246 raft_consensus.cc:2468] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:28.840041 23066 leader_election.cc:304] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:28.843969 23515 raft_consensus.cc:2804] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.845125 23375 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:28.865016 23375 consensus_queue.cc:1048] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.868587 23301 raft_consensus.cc:515] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.870226 23451 raft_consensus.cc:515] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.874065 23451 leader_election.cc:290] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:28.877125 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:28.877802 23248 raft_consensus.cc:3060] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.878250 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
W20260709 13:08:28.881497 23063 leader_election.cc:343] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.871316 23515 raft_consensus.cc:697] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:28.884774 22922 catalog_manager.cc:5697] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.885198 23515 consensus_queue.cc:237] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.894246 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:28.894937 23246 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.899601 23098 raft_consensus.cc:2468] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.901364 22989 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:28.902144 23296 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:28.902683 23296 ts_tablet_manager.cc:1403] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.167s	user 0.017s	sys 0.000s
I20260709 13:08:28.902870 23375 raft_consensus.cc:2804] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.903401 23375 raft_consensus.cc:697] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:28.904333 23375 consensus_queue.cc:237] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.910602 23295 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:28.911183 23295 ts_tablet_manager.cc:1403] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.198s	user 0.036s	sys 0.093s
I20260709 13:08:28.911716 23301 leader_election.cc:290] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:28.912640 23293 tablet_bootstrap.cc:654] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.914227 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:28.915128 23245 raft_consensus.cc:3060] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.917543 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:28.918220 23173 raft_consensus.cc:3060] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.892194 23248 raft_consensus.cc:2468] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:28.917276 23295 raft_consensus.cc:359] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.937400 23295 raft_consensus.cc:385] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.928539 23294 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:28.938326 23294 ts_tablet_manager.cc:1403] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.222s	user 0.034s	sys 0.022s
I20260709 13:08:28.914230 23296 raft_consensus.cc:359] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.939800 23066 leader_election.cc:304] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:28.941152 23451 raft_consensus.cc:2804] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.941634 23451 raft_consensus.cc:697] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:28.942516 23451 consensus_queue.cc:237] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:28.948741 23294 raft_consensus.cc:359] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.949760 23294 raft_consensus.cc:385] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.950125 23294 raft_consensus.cc:740] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.950562 23296 raft_consensus.cc:385] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.951833 23296 raft_consensus.cc:740] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.953065 23294 consensus_queue.cc:260] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.955171 23296 consensus_queue.cc:260] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:28.952600 23295 raft_consensus.cc:740] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.964666 23246 raft_consensus.cc:2468] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.965189 23245 raft_consensus.cc:2468] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.966974 23294 ts_tablet_manager.cc:1434] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:08:28.956591 23173 raft_consensus.cc:2468] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:28.969010 23296 ts_tablet_manager.cc:1434] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.003s
I20260709 13:08:28.969262 22988 leader_election.cc:304] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:28.970158 23296 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:28.970463 23391 raft_consensus.cc:2804] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.970985 23391 raft_consensus.cc:697] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:28.971913 23391 consensus_queue.cc:237] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:28.973709 22991 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:28.974905 23376 raft_consensus.cc:2804] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.975395 23376 raft_consensus.cc:697] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:28.985980 23294 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:28.976261 23376 consensus_queue.cc:237] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.993319 23296 tablet_bootstrap.cc:654] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.992093 23295 consensus_queue.cc:260] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:28.999586 23293 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:29.000463 23293 ts_tablet_manager.cc:1403] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.201s	user 0.041s	sys 0.020s
I20260709 13:08:29.004827 23293 raft_consensus.cc:359] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.018355 23293 raft_consensus.cc:385] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.017630 23295 ts_tablet_manager.cc:1434] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 13:08:29.020864 23293 raft_consensus.cc:740] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.020982 22923 catalog_manager.cc:5697] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.022145 23295 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
W20260709 13:08:29.022887 22988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 46310.2us
I20260709 13:08:29.023844 23293 consensus_queue.cc:260] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.028940 23294 tablet_bootstrap.cc:654] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.031700 23293 ts_tablet_manager.cc:1434] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:08:29.032898 23293 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:29.033367 23296 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:29.033866 23296 ts_tablet_manager.cc:1403] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.000s
I20260709 13:08:29.036943 23296 raft_consensus.cc:359] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.037652 23296 raft_consensus.cc:385] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.037909 23296 raft_consensus.cc:740] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.038792 23296 consensus_queue.cc:260] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.039382 22918 catalog_manager.cc:5697] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.041272 23296 ts_tablet_manager.cc:1434] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:29.039326 23293 tablet_bootstrap.cc:654] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.042578 23296 tablet_bootstrap.cc:492] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:29.050611 23293 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:29.051076 23296 tablet_bootstrap.cc:654] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.051223 23293 ts_tablet_manager.cc:1403] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 13:08:29.055445 23294 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:29.056181 23294 ts_tablet_manager.cc:1403] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.000s
I20260709 13:08:29.068527 23295 tablet_bootstrap.cc:654] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.083530 22922 catalog_manager.cc:5697] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.087496 23294 raft_consensus.cc:359] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.088375 23294 raft_consensus.cc:385] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.088655 23294 raft_consensus.cc:740] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.092479 23293 raft_consensus.cc:359] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.093927 23293 raft_consensus.cc:385] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.094280 23293 raft_consensus.cc:740] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.089803 23294 consensus_queue.cc:260] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.097920 23294 ts_tablet_manager.cc:1434] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:08:29.099457 23294 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:29.104254 23293 consensus_queue.cc:260] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.107887 23293 ts_tablet_manager.cc:1434] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:08:29.109359 23293 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:29.118824 23295 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:29.115417 22922 catalog_manager.cc:5697] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.120754 23295 ts_tablet_manager.cc:1403] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.040s
I20260709 13:08:29.122990 23294 tablet_bootstrap.cc:654] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.127223 23295 raft_consensus.cc:359] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.128130 23295 raft_consensus.cc:385] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.128496 23295 raft_consensus.cc:740] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.129263 23295 consensus_queue.cc:260] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.131880 23295 ts_tablet_manager.cc:1434] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:29.132491 23293 tablet_bootstrap.cc:654] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.133767 23295 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:29.141234 23295 tablet_bootstrap.cc:654] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.143348 23293 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:29.144088 23293 ts_tablet_manager.cc:1403] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.000s
I20260709 13:08:29.145687 23493 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.146454 23493 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.147397 23293 raft_consensus.cc:359] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.147900 23451 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.148169 23293 raft_consensus.cc:385] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.148523 23293 raft_consensus.cc:740] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.148438 23451 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.150578 23493 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:29.150701 23451 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:29.152186 23294 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:29.152729 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:29.152961 23294 ts_tablet_manager.cc:1403] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.000s
I20260709 13:08:29.154006 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:29.154394 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:29.154884 23098 raft_consensus.cc:2393] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:29.155282 23246 raft_consensus.cc:2393] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:29.152755 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:29.158097 23294 raft_consensus.cc:359] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.159236 23294 raft_consensus.cc:385] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.159624 23294 raft_consensus.cc:740] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.159682 23066 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:29.160593 23138 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:29.161477 23451 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.160899 23294 consensus_queue.cc:260] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.162616 23304 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.163352 23293 consensus_queue.cc:260] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.168717 23293 ts_tablet_manager.cc:1434] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:08:29.170076 23293 tablet_bootstrap.cc:492] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:29.178922 23294 ts_tablet_manager.cc:1434] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:08:29.180858 23294 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:29.181317 22923 catalog_manager.cc:5697] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.184327 23304 raft_consensus.cc:2749] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.188287 23296 tablet_bootstrap.cc:492] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:29.188906 23296 ts_tablet_manager.cc:1403] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.147s	user 0.070s	sys 0.056s
I20260709 13:08:29.193168 23174 raft_consensus.cc:3060] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.193115 23296 raft_consensus.cc:359] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:29.194280 23296 raft_consensus.cc:385] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.194612 23296 raft_consensus.cc:740] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.199000 23451 raft_consensus.cc:2749] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.222105 23375 consensus_queue.cc:1048] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.236317 23391 consensus_queue.cc:1048] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.264381 23375 raft_consensus.cc:493] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.265231 23375 raft_consensus.cc:515] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.268596 23375 leader_election.cc:290] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:29.271920 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:29.277408 22988 leader_election.cc:343] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.278877 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:29.279933 23245 raft_consensus.cc:2468] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:29.284269 22991 leader_election.cc:304] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:29.286819 23536 raft_consensus.cc:2804] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.287309 23536 raft_consensus.cc:493] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.287812 23536 raft_consensus.cc:3060] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:29.292088 23063 consensus_peers.cc:597] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:29.299873 23515 consensus_queue.cc:1048] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.304984 23296 consensus_queue.cc:260] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:29.308207 23296 ts_tablet_manager.cc:1434] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.119s	user 0.068s	sys 0.051s
I20260709 13:08:29.307520 23295 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:29.308995 23376 raft_consensus.cc:493] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.310380 23455 raft_consensus.cc:493] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.310917 23455 raft_consensus.cc:515] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.313426 23455 leader_election.cc:290] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:29.313617 23304 raft_consensus.cc:493] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.309705 23376 raft_consensus.cc:515] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.314214 23304 raft_consensus.cc:515] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.316531 23376 leader_election.cc:290] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:29.309706 23295 ts_tablet_manager.cc:1403] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.010s
I20260709 13:08:29.318150 23304 leader_election.cc:290] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:29.189561 23294 tablet_bootstrap.cc:654] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.329372 23293 tablet_bootstrap.cc:654] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.329372 23296 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:29.331781 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:29.332757 23100 raft_consensus.cc:2468] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:29.333094 23295 raft_consensus.cc:359] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.334030 23295 raft_consensus.cc:385] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.334342 23295 raft_consensus.cc:740] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.335126 23295 consensus_queue.cc:260] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.339830 22989 leader_election.cc:304] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:29.340087 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:29.333029 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433c50320714f4288969a94d5e1bf12" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:29.342078 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433c50320714f4288969a94d5e1bf12" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:29.342782 23025 raft_consensus.cc:2468] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
W20260709 13:08:29.343137 23211 leader_election.cc:343] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.345829 23391 raft_consensus.cc:2804] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.346302 23391 raft_consensus.cc:493] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.346632 23391 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.346905 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:29.348726 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:29.349419 23212 leader_election.cc:304] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:29.350297 23451 consensus_queue.cc:1048] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.351162 23455 raft_consensus.cc:2804] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.351812 23455 raft_consensus.cc:493] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.352178 23455 raft_consensus.cc:3060] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.351099 23499 raft_consensus.cc:493] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.355129 23295 ts_tablet_manager.cc:1434] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 13:08:29.361304 23515 raft_consensus.cc:493] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.356076 23499 raft_consensus.cc:515] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:29.364874 23515 raft_consensus.cc:515] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.374310 23499 leader_election.cc:290] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:29.374413 23515 leader_election.cc:290] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:29.367473 23138 leader_election.cc:304] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:29.376348 23499 raft_consensus.cc:2749] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.378679 23296 tablet_bootstrap.cc:654] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.378919 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:29.380053 23245 raft_consensus.cc:2393] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:29.392180 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:29.393908 23402 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.391053 23548 log.cc:927] Time spent T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:08:29.394775 23402 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:29.396827 22988 leader_election.cc:343] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.399612 23402 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
W20260709 13:08:29.400301 23064 leader_election.cc:343] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.402173 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:29.403648 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:29.404088 23212 leader_election.cc:343] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:29.405406 23212 leader_election.cc:343] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.406075 23212 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:29.408727 23402 raft_consensus.cc:2749] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.407341 23375 consensus_queue.cc:1048] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:29.423331 23295 tablet_bootstrap.cc:492] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:29.415809 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:29.440222 23248 raft_consensus.cc:2468] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:29.445210 23066 leader_election.cc:304] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:29.446852 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:29.447510 23528 raft_consensus.cc:2804] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.448001 23528 raft_consensus.cc:493] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.448359 23528 raft_consensus.cc:3060] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.417155 23536 raft_consensus.cc:515] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.462805 23301 consensus_queue.cc:1048] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.465399 23455 raft_consensus.cc:515] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.473654 23536 leader_election.cc:290] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:29.477519 23391 raft_consensus.cc:515] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.480206 23376 consensus_queue.cc:1048] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.423731 23375 consensus_queue.cc:1048] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:08:29.496767 23173 raft_consensus.cc:3060] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.506156 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:29.507050 23245 raft_consensus.cc:3060] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.510260 23391 leader_election.cc:290] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:29.511073 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:29.511767 23100 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.525700 23138 leader_election.cc:304] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:29.526046 23293 tablet_bootstrap.cc:492] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:29.528383 23293 ts_tablet_manager.cc:1403] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.359s	user 0.016s	sys 0.002s
I20260709 13:08:29.534623 23293 raft_consensus.cc:359] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:29.522921 23515 consensus_queue.cc:1048] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:08:29.536664 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:29.538352 23171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433c50320714f4288969a94d5e1bf12" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
W20260709 13:08:29.540372 23211 leader_election.cc:343] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.546667 23295 tablet_bootstrap.cc:654] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.535473 23293 raft_consensus.cc:385] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.548475 23293 raft_consensus.cc:740] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
W20260709 13:08:29.550671 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:29.551293 23293 consensus_queue.cc:260] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:29.554044 23375 consensus_queue.cc:1048] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:29.556041 22988 leader_election.cc:343] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.558921 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:29.561282 23294 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:29.538020 23515 consensus_queue.cc:1048] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.563082 23293 ts_tablet_manager.cc:1434] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:08:29.568302 23455 leader_election.cc:290] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:29.574616 23293 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:29.569191 23294 ts_tablet_manager.cc:1403] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.389s	user 0.036s	sys 0.030s
I20260709 13:08:29.576253 23493 raft_consensus.cc:2749] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.595268 23100 raft_consensus.cc:2468] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:29.595815 23301 consensus_queue.cc:1048] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:08:29.609743 23528 raft_consensus.cc:515] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.616648 23293 tablet_bootstrap.cc:654] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:29.595729 22988 leader_election.cc:343] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:29.641498 22988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 45831.5us
W20260709 13:08:29.653360 23066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 141527us
I20260709 13:08:29.684904 23296 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:29.685825 23296 ts_tablet_manager.cc:1403] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.357s	user 0.063s	sys 0.039s
I20260709 13:08:29.704109 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
W20260709 13:08:29.706100 23064 leader_election.cc:343] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.688452 23245 raft_consensus.cc:2468] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:29.715349 23557 consensus_queue.cc:1048] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:08:29.716938 22991 leader_election.cc:304] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:29.725292 23376 raft_consensus.cc:2804] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.727972 23376 raft_consensus.cc:697] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:29.729334 23376 consensus_queue.cc:237] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.745684 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433c50320714f4288969a94d5e1bf12" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:29.746905 23024 raft_consensus.cc:3060] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.697279 23528 leader_election.cc:290] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:29.763041 22989 leader_election.cc:304] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:29.765655 23301 raft_consensus.cc:2804] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.766258 23301 raft_consensus.cc:697] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:29.767201 23301 consensus_queue.cc:237] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:29.773618 23296 raft_consensus.cc:359] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.774551 23296 raft_consensus.cc:385] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.774878 23296 raft_consensus.cc:740] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.761395 23294 raft_consensus.cc:359] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.778369 23294 raft_consensus.cc:385] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.778753 23294 raft_consensus.cc:740] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.780820 23296 consensus_queue.cc:260] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.779757 23294 consensus_queue.cc:260] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:29.784641 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 46200.6us
I20260709 13:08:29.785665 23294 ts_tablet_manager.cc:1434] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.194s	user 0.009s	sys 0.001s
I20260709 13:08:29.821236 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:29.822093 23246 raft_consensus.cc:3060] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.824538 23295 tablet_bootstrap.cc:492] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:29.825196 23295 ts_tablet_manager.cc:1403] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.454s	user 0.054s	sys 0.042s
I20260709 13:08:29.843919 23296 ts_tablet_manager.cc:1434] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.158s	user 0.005s	sys 0.005s
I20260709 13:08:29.844930 23295 raft_consensus.cc:359] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:29.848300 23295 raft_consensus.cc:385] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.848743 23295 raft_consensus.cc:740] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.856426 23295 consensus_queue.cc:260] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:29.857880 23296 tablet_bootstrap.cc:492] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:29.877447 23294 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:29.882246 23295 ts_tablet_manager.cc:1434] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.002s
W20260709 13:08:29.855825 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 85608.1us
I20260709 13:08:29.862591 23024 raft_consensus.cc:2468] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
W20260709 13:08:29.900198 22989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 56364.6us
I20260709 13:08:29.904522 23293 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:29.905176 23293 ts_tablet_manager.cc:1403] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.333s	user 0.020s	sys 0.006s
I20260709 13:08:29.912788 23246 raft_consensus.cc:2468] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:29.914417 23066 leader_election.cc:304] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:29.914683 23402 raft_consensus.cc:493] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.915198 23402 raft_consensus.cc:515] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:29.916738 23567 raft_consensus.cc:2804] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.917321 23567 raft_consensus.cc:697] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:29.912647 22921 catalog_manager.cc:5697] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.917479 23402 leader_election.cc:290] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:29.918270 23567 consensus_queue.cc:237] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.928647 23293 raft_consensus.cc:359] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.929586 23293 raft_consensus.cc:385] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.929894 23293 raft_consensus.cc:740] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.935010 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e0388048448ad81268fb914e7d4cc" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:29.940735 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e0388048448ad81268fb914e7d4cc" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:29.941565 23096 raft_consensus.cc:2468] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:29.944165 23293 consensus_queue.cc:260] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:29.946148 23293 ts_tablet_manager.cc:1434] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:08:29.947139 23295 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:29.947337 23293 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:29.951121 23296 tablet_bootstrap.cc:654] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:29.952839 23211 leader_election.cc:343] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.955929 23212 leader_election.cc:304] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:29.956295 23293 tablet_bootstrap.cc:654] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.966212 23212 leader_election.cc:304] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:29.966557 23455 raft_consensus.cc:2804] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.975966 23455 raft_consensus.cc:697] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:29.977056 23455 consensus_queue.cc:237] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:29.974799 23294 tablet_bootstrap.cc:654] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.981701 23295 tablet_bootstrap.cc:654] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.997188 23302 raft_consensus.cc:2804] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.997793 23302 raft_consensus.cc:493] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.998207 23302 raft_consensus.cc:3060] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.069005 23296 tablet_bootstrap.cc:492] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:30.069712 23296 ts_tablet_manager.cc:1403] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.212s	user 0.019s	sys 0.011s
I20260709 13:08:30.077311 22920 catalog_manager.cc:5697] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.072867 23302 raft_consensus.cc:515] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.083669 23302 leader_election.cc:290] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:30.086269 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e0388048448ad81268fb914e7d4cc" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:30.087018 23099 raft_consensus.cc:3060] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.088137 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e0388048448ad81268fb914e7d4cc" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
W20260709 13:08:30.091244 23211 leader_election.cc:343] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.084342 22922 catalog_manager.cc:5697] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.098141 23293 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:30.098196 23099 raft_consensus.cc:2468] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:30.099035 23293 ts_tablet_manager.cc:1403] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.152s	user 0.059s	sys 0.052s
I20260709 13:08:30.099959 23295 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:30.100488 23295 ts_tablet_manager.cc:1403] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.157s	user 0.007s	sys 0.017s
I20260709 13:08:30.100296 23212 leader_election.cc:304] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:30.101298 23296 raft_consensus.cc:359] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.101897 23572 raft_consensus.cc:2804] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.102077 23296 raft_consensus.cc:385] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.102711 23572 raft_consensus.cc:697] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:30.103276 23296 raft_consensus.cc:740] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.104194 23296 consensus_queue.cc:260] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.104087 23572 consensus_queue.cc:237] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.105033 23294 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:30.105630 23294 ts_tablet_manager.cc:1403] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.252s	user 0.009s	sys 0.014s
I20260709 13:08:30.110709 23295 raft_consensus.cc:359] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.111642 23295 raft_consensus.cc:385] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.102102 23293 raft_consensus.cc:359] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.112428 23293 raft_consensus.cc:385] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.112834 23293 raft_consensus.cc:740] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.113668 23294 raft_consensus.cc:359] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.113783 23293 consensus_queue.cc:260] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.112071 23295 raft_consensus.cc:740] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.114804 23294 raft_consensus.cc:385] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.115602 23294 raft_consensus.cc:740] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.116665 23295 consensus_queue.cc:260] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.117911 23293 ts_tablet_manager.cc:1434] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 13:08:30.118269 23296 ts_tablet_manager.cc:1434] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:08:30.117815 23294 consensus_queue.cc:260] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.119390 23293 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:30.120404 23295 ts_tablet_manager.cc:1434] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:08:30.121805 23295 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:30.122967 23567 raft_consensus.cc:493] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.119385 23296 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:30.123672 23567 raft_consensus.cc:515] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.129333 23567 leader_election.cc:290] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:30.133466 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33472d9d8b514a79b3645d0aa02749c2" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:30.133956 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33472d9d8b514a79b3645d0aa02749c2" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:30.134850 23023 raft_consensus.cc:2468] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
W20260709 13:08:30.137842 23063 leader_election.cc:343] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.139973 23174 raft_consensus.cc:3060] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.140395 23293 tablet_bootstrap.cc:654] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.140861 23064 leader_election.cc:304] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:30.142403 23567 raft_consensus.cc:2804] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.142946 23567 raft_consensus.cc:493] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.143386 23567 raft_consensus.cc:3060] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.147310 23455 raft_consensus.cc:493] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.147940 23455 raft_consensus.cc:515] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.148855 23296 tablet_bootstrap.cc:654] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.151971 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c068aa5e483f41e783c5498945e63250" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:30.154444 23455 leader_election.cc:290] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:30.155776 23211 leader_election.cc:343] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.156050 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c068aa5e483f41e783c5498945e63250" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:30.155368 23567 raft_consensus.cc:515] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:30.158202 23212 leader_election.cc:343] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.158679 23212 leader_election.cc:304] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:30.160157 23455 raft_consensus.cc:2749] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.161337 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33472d9d8b514a79b3645d0aa02749c2" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:30.162209 23023 raft_consensus.cc:3060] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.166970 23296 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:30.167647 23296 ts_tablet_manager.cc:1403] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.005s
I20260709 13:08:30.171370 23567 leader_election.cc:290] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:30.172438 23391 consensus_queue.cc:1048] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.172709 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33472d9d8b514a79b3645d0aa02749c2" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:30.171214 23296 raft_consensus.cc:359] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.178177 23296 raft_consensus.cc:385] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:30.178282 23063 leader_election.cc:343] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.178556 23296 raft_consensus.cc:740] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.179657 23296 consensus_queue.cc:260] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.182327 23296 ts_tablet_manager.cc:1434] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:08:30.183507 23296 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:30.161427 23294 ts_tablet_manager.cc:1434] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:08:30.185638 23294 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:30.190011 23296 tablet_bootstrap.cc:654] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.175182 23023 raft_consensus.cc:2468] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:30.192884 23064 leader_election.cc:304] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:30.194512 23567 raft_consensus.cc:2804] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.195422 23567 raft_consensus.cc:697] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:30.197147 23567 consensus_queue.cc:237] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.203858 23296 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:30.204478 23296 ts_tablet_manager.cc:1403] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
I20260709 13:08:30.207444 23549 raft_consensus.cc:493] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.207722 23296 raft_consensus.cc:359] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.208076 23549 raft_consensus.cc:515] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.208611 23296 raft_consensus.cc:385] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.209000 23296 raft_consensus.cc:740] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.209746 23296 consensus_queue.cc:260] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.211941 23296 ts_tablet_manager.cc:1434] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:30.212412 23536 consensus_queue.cc:1048] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.212961 23296 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:30.218815 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:30.220360 23296 tablet_bootstrap.cc:654] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.221544 23549 leader_election.cc:290] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:30.222730 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:30.224094 23294 tablet_bootstrap.cc:654] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.224601 23138 leader_election.cc:304] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:30.227061 23295 tablet_bootstrap.cc:654] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.248466 23293 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:30.236555 23493 raft_consensus.cc:493] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.249188 23293 ts_tablet_manager.cc:1403] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.030s
I20260709 13:08:30.249189 23493 raft_consensus.cc:515] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.251384 23549 raft_consensus.cc:2749] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.252005 23493 leader_election.cc:290] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:30.253927 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:30.254946 23099 raft_consensus.cc:2393] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:30.255091 23296 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:30.255667 23296 ts_tablet_manager.cc:1403] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.003s
I20260709 13:08:30.258038 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:30.263935 23296 raft_consensus.cc:359] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.264730 23296 raft_consensus.cc:385] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.265077 23296 raft_consensus.cc:740] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.265808 23296 consensus_queue.cc:260] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.267787 23577 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.268342 23577 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.270551 23577 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:30.271297 23296 ts_tablet_manager.cc:1434] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:30.271867 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:30.262247 23293 raft_consensus.cc:359] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.273169 23293 raft_consensus.cc:385] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.273600 23293 raft_consensus.cc:740] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.274600 23138 leader_election.cc:304] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:30.274495 23293 consensus_queue.cc:260] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.284304 23296 tablet_bootstrap.cc:492] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:30.285748 23293 ts_tablet_manager.cc:1434] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:08:30.282560 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
W20260709 13:08:30.293780 22989 leader_election.cc:343] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.294032 23247 raft_consensus.cc:2468] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:30.283651 23493 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.296797 23294 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:30.297381 23294 ts_tablet_manager.cc:1403] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.006s
I20260709 13:08:30.302917 23296 tablet_bootstrap.cc:654] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.305857 23549 raft_consensus.cc:493] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.307081 23455 raft_consensus.cc:493] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.311260 23455 raft_consensus.cc:515] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.313525 23455 leader_election.cc:290] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:30.314721 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:30.316308 23212 leader_election.cc:343] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.306676 23549 raft_consensus.cc:515] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.327174 22991 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:30.328348 23294 raft_consensus.cc:359] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.329495 23294 raft_consensus.cc:385] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.329877 23294 raft_consensus.cc:740] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.330570 23391 raft_consensus.cc:2804] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.331204 23391 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.331703 23391 raft_consensus.cc:3060] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.330818 23294 consensus_queue.cc:260] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.340373 23294 ts_tablet_manager.cc:1434] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:08:30.342077 23294 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:30.343607 23295 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:30.344161 23295 ts_tablet_manager.cc:1403] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.010s
I20260709 13:08:30.350471 23295 raft_consensus.cc:359] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.351214 23295 raft_consensus.cc:385] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.351485 23295 raft_consensus.cc:740] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.352151 23295 consensus_queue.cc:260] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.358624 23549 leader_election.cc:290] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:30.362756 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:30.364775 23295 ts_tablet_manager.cc:1434] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:08:30.366264 23295 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:30.369788 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:30.373373 23212 leader_election.cc:343] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.374004 23212 leader_election.cc:304] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:30.377377 23572 raft_consensus.cc:2749] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.378451 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:30.378816 23567 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.379415 23567 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.380489 23138 leader_election.cc:304] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:30.382737 23549 raft_consensus.cc:2749] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.385746 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:30.386541 23245 raft_consensus.cc:2468] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:30.387809 23293 tablet_bootstrap.cc:492] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:30.389509 23066 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:30.390370 23567 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:30.390633 22923 catalog_manager.cc:5697] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.392282 23564 raft_consensus.cc:2804] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.392992 23564 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.392678 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:30.393364 23564 raft_consensus.cc:3060] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.396514 23572 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.397212 23572 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.400528 23572 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:30.402746 23294 tablet_bootstrap.cc:654] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.403657 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:30.406167 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:30.406217 23211 leader_election.cc:343] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.402568 23577 consensus_queue.cc:1048] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:30.408735 23293 tablet_bootstrap.cc:654] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.411260 23169 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:30.420876 23212 leader_election.cc:343] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.421514 23212 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:30.423317 23455 raft_consensus.cc:2749] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.423941 23391 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.426412 22922 catalog_manager.cc:5697] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.429134 23493 raft_consensus.cc:2749] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.438948 23023 raft_consensus.cc:3060] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.441716 23296 tablet_bootstrap.cc:492] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:30.442312 23296 ts_tablet_manager.cc:1403] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.170s	user 0.027s	sys 0.013s
I20260709 13:08:30.444092 23565 consensus_queue.cc:1048] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:30.449461 23024 raft_consensus.cc:2393] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:30.464999 23296 raft_consensus.cc:359] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.473637 23296 raft_consensus.cc:385] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.474102 23296 raft_consensus.cc:740] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.479692 23577 consensus_queue.cc:1048] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.483634 23294 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:30.484257 23294 ts_tablet_manager.cc:1403] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.143s	user 0.019s	sys 0.006s
I20260709 13:08:30.485837 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:30.486606 23246 raft_consensus.cc:3060] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.488472 23295 tablet_bootstrap.cc:654] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.488708 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:30.492004 23296 consensus_queue.cc:260] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.496762 23294 raft_consensus.cc:359] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.498390 23294 raft_consensus.cc:385] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.498895 23294 raft_consensus.cc:740] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.500141 23294 consensus_queue.cc:260] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.503304 23499 raft_consensus.cc:493] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.510190 23499 raft_consensus.cc:515] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.483794 23391 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:30.512774 23499 leader_election.cc:290] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:30.513509 23296 ts_tablet_manager.cc:1434] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 13:08:30.513787 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433c50320714f4288969a94d5e1bf12" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:30.514952 23296 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:30.516371 23293 tablet_bootstrap.cc:492] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:30.516959 23293 ts_tablet_manager.cc:1403] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.035s
I20260709 13:08:30.518287 23565 consensus_queue.cc:1048] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.490899 22920 catalog_manager.cc:5697] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.518778 23294 ts_tablet_manager.cc:1434] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:08:30.525290 23294 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:30.528347 23293 raft_consensus.cc:359] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.538055 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433c50320714f4288969a94d5e1bf12" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:30.539043 23022 raft_consensus.cc:2393] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:30.541235 23170 raft_consensus.cc:3060] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.546459 23246 raft_consensus.cc:2468] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:30.529032 23293 raft_consensus.cc:385] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.549293 23293 raft_consensus.cc:740] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.550187 23293 consensus_queue.cc:260] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.552712 22991 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:30.556690 23564 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.555742 23575 raft_consensus.cc:2804] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.564884 23296 tablet_bootstrap.cc:654] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.573231 23293 ts_tablet_manager.cc:1434] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:08:30.557581 23572 consensus_queue.cc:1048] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:08:30.579329 23572 consensus_queue.cc:1048] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.559491 23575 raft_consensus.cc:697] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:30.583331 23577 raft_consensus.cc:493] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.582973 23575 consensus_queue.cc:237] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:30.583904 23577 raft_consensus.cc:515] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.596168 23099 raft_consensus.cc:2393] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:30.602531 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98752a0b59b54debad030db8c47b501d" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:30.604874 22989 leader_election.cc:343] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.609309 23606 raft_consensus.cc:493] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.610131 23606 raft_consensus.cc:515] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.617744 23293 tablet_bootstrap.cc:492] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:30.574218 23138 leader_election.cc:304] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:30.635744 23577 leader_election.cc:290] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:30.636330 23499 raft_consensus.cc:2749] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.629573 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98752a0b59b54debad030db8c47b501d" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:30.643242 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 83922.7us
W20260709 13:08:30.651974 22988 leader_election.cc:343] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.653450 22988 leader_election.cc:304] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:30.656378 23293 tablet_bootstrap.cc:654] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.655076 23536 raft_consensus.cc:2749] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.635601 23606 leader_election.cc:290] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:30.647630 23572 consensus_queue.cc:1048] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:08:30.663847 23302 raft_consensus.cc:493] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.672277 23302 raft_consensus.cc:515] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.685082 23295 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:30.685702 23295 ts_tablet_manager.cc:1403] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.320s	user 0.018s	sys 0.012s
I20260709 13:08:30.687131 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33472d9d8b514a79b3645d0aa02749c2" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:30.687372 23302 leader_election.cc:290] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:30.687496 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed56e7a911d48c097f25c20e39f2385" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:30.692735 23212 leader_election.cc:343] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.693307 23564 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:30.695477 23170 raft_consensus.cc:3060] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.695848 23295 raft_consensus.cc:359] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.696768 23295 raft_consensus.cc:385] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.697065 23295 raft_consensus.cc:740] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.697932 23295 consensus_queue.cc:260] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:30.698938 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed56e7a911d48c097f25c20e39f2385" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:30.700556 23295 ts_tablet_manager.cc:1434] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:08:30.700978 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:30.701718 23295 tablet_bootstrap.cc:492] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:30.702085 23246 raft_consensus.cc:2393] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:30.695482 23174 raft_consensus.cc:3060] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.705302 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33472d9d8b514a79b3645d0aa02749c2" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:30.706161 23024 raft_consensus.cc:2393] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:30.720077 23294 tablet_bootstrap.cc:654] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.716472 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:30.723435 23064 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:30.725186 23564 raft_consensus.cc:2749] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.725462 23296 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:30.726219 23296 ts_tablet_manager.cc:1403] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.212s	user 0.023s	sys 0.010s
I20260709 13:08:30.727840 23493 raft_consensus.cc:493] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.728416 23493 raft_consensus.cc:515] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.731117 23493 leader_election.cc:290] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:30.731891 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e0388048448ad81268fb914e7d4cc" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:30.739833 23565 consensus_queue.cc:1048] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.744942 23565 consensus_queue.cc:1048] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.750780 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e0388048448ad81268fb914e7d4cc" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:30.746053 23211 leader_election.cc:343] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.753710 23211 leader_election.cc:304] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:30.754611 23302 raft_consensus.cc:2749] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.755769 23455 consensus_queue.cc:1048] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.758590 23296 raft_consensus.cc:359] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.759395 23296 raft_consensus.cc:385] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.759697 23296 raft_consensus.cc:740] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.760532 23296 consensus_queue.cc:260] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.763319 23295 tablet_bootstrap.cc:654] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.773315 23296 ts_tablet_manager.cc:1434] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:08:30.786574 23138 leader_election.cc:304] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:30.789229 23138 leader_election.cc:304] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:30.819223 22922 catalog_manager.cc:5697] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.832355 23606 raft_consensus.cc:2749] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.827366 23296 tablet_bootstrap.cc:492] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
W20260709 13:08:30.849597 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:30.854610 23296 tablet_bootstrap.cc:654] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.870409 23499 raft_consensus.cc:2749] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.871131 23294 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:30.871719 23294 ts_tablet_manager.cc:1403] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.352s	user 0.020s	sys 0.047s
I20260709 13:08:30.874758 23295 tablet_bootstrap.cc:492] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:30.875340 23295 ts_tablet_manager.cc:1403] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.006s
I20260709 13:08:30.887296 23295 raft_consensus.cc:359] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.888466 23295 raft_consensus.cc:385] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.888255 23294 raft_consensus.cc:359] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.888871 23295 raft_consensus.cc:740] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.890853 23294 raft_consensus.cc:385] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.891224 23294 raft_consensus.cc:740] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.891346 23295 consensus_queue.cc:260] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.891983 23294 consensus_queue.cc:260] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:30.895097 23295 ts_tablet_manager.cc:1434] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:08:30.896855 23294 ts_tablet_manager.cc:1434] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:08:30.899505 23295 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:30.910702 23293 tablet_bootstrap.cc:492] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:30.911296 23293 ts_tablet_manager.cc:1403] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.318s	user 0.028s	sys 0.009s
I20260709 13:08:30.916235 23294 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:30.924642 23294 tablet_bootstrap.cc:654] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.966050 23296 tablet_bootstrap.cc:492] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:30.966611 23296 ts_tablet_manager.cc:1403] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.021s
I20260709 13:08:30.967140 23295 tablet_bootstrap.cc:654] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.987231 23296 raft_consensus.cc:359] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.988226 23296 raft_consensus.cc:385] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.988610 23296 raft_consensus.cc:740] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.990507 23296 consensus_queue.cc:260] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.994427 23293 raft_consensus.cc:359] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:30.996707 23294 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:30.997390 23294 ts_tablet_manager.cc:1403] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.094s	user 0.030s	sys 0.016s
I20260709 13:08:30.998454 23296 ts_tablet_manager.cc:1434] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.001s
I20260709 13:08:30.999716 23296 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:31.000486 23294 raft_consensus.cc:359] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.003149 23294 raft_consensus.cc:385] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.003476 23294 raft_consensus.cc:740] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.004249 23294 consensus_queue.cc:260] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.002763 23295 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:31.005354 23295 ts_tablet_manager.cc:1403] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.008s
I20260709 13:08:31.009130 23295 raft_consensus.cc:359] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.009927 23293 raft_consensus.cc:385] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.010246 23293 raft_consensus.cc:740] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.011005 23293 consensus_queue.cc:260] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.012791 23295 raft_consensus.cc:385] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.013188 23295 raft_consensus.cc:740] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.019850 23294 ts_tablet_manager.cc:1434] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:08:31.021382 23294 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:31.020180 23293 ts_tablet_manager.cc:1434] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.003s
I20260709 13:08:31.022586 23499 raft_consensus.cc:493] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.023190 23499 raft_consensus.cc:515] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.025053 23293 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:31.019881 23295 consensus_queue.cc:260] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.028322 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed56e7a911d48c097f25c20e39f2385" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:31.028752 23295 ts_tablet_manager.cc:1434] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:08:31.029059 23246 raft_consensus.cc:2468] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:31.030532 23296 tablet_bootstrap.cc:654] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.033689 23376 raft_consensus.cc:493] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.034157 23376 raft_consensus.cc:515] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.036322 23376 leader_election.cc:290] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:31.037456 23140 leader_election.cc:304] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:31.038276 23606 raft_consensus.cc:2804] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.038635 23606 raft_consensus.cc:493] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.039022 23606 raft_consensus.cc:3060] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.038815 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:31.039649 23098 raft_consensus.cc:2468] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:31.040266 23294 tablet_bootstrap.cc:654] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.040766 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:31.041249 22989 leader_election.cc:304] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:31.041505 23246 raft_consensus.cc:2468] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:31.043144 23536 raft_consensus.cc:2804] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.043227 23295 tablet_bootstrap.cc:492] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:31.043581 23536 raft_consensus.cc:493] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.044001 23536 raft_consensus.cc:3060] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.055371 23536 raft_consensus.cc:515] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.058863 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed56e7a911d48c097f25c20e39f2385" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:31.069268 23293 tablet_bootstrap.cc:654] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.069057 23098 raft_consensus.cc:2468] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:31.070102 23536 leader_election.cc:290] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:31.068554 23295 tablet_bootstrap.cc:654] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.071609 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:31.072288 23246 raft_consensus.cc:3060] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.074142 23294 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:31.074626 23294 ts_tablet_manager.cc:1403] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.016s
I20260709 13:08:31.077540 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:31.077561 23294 raft_consensus.cc:359] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.078258 23098 raft_consensus.cc:3060] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.078783 23549 raft_consensus.cc:493] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.079265 23549 raft_consensus.cc:515] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.081445 23549 leader_election.cc:290] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:31.082376 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c068aa5e483f41e783c5498945e63250" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:31.083094 23247 raft_consensus.cc:2468] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:31.083271 23294 raft_consensus.cc:385] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.083690 23294 raft_consensus.cc:740] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.084769 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c068aa5e483f41e783c5498945e63250" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:31.085829 23023 raft_consensus.cc:2468] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:31.084388 23294 consensus_queue.cc:260] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.088308 23140 leader_election.cc:304] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:31.089134 23549 raft_consensus.cc:2804] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.090045 23549 raft_consensus.cc:493] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.091038 23294 ts_tablet_manager.cc:1434] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:08:31.064141 23296 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:31.096534 23549 raft_consensus.cc:3060] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.096827 23296 ts_tablet_manager.cc:1403] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.097s	user 0.003s	sys 0.016s
I20260709 13:08:31.094394 23246 raft_consensus.cc:2468] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:31.101101 22991 leader_election.cc:304] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:31.102373 23296 raft_consensus.cc:359] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.103188 23296 raft_consensus.cc:385] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.103470 23296 raft_consensus.cc:740] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.104270 23296 consensus_queue.cc:260] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.106707 23296 ts_tablet_manager.cc:1434] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:31.095878 23098 raft_consensus.cc:2468] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:31.107668 23294 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:31.104914 23549 raft_consensus.cc:515] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.110890 23549 leader_election.cc:290] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:31.107167 23295 tablet_bootstrap.cc:492] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:31.111722 23295 ts_tablet_manager.cc:1403] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.000s
I20260709 13:08:31.111827 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c068aa5e483f41e783c5498945e63250" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:31.112566 23246 raft_consensus.cc:3060] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.108889 23296 tablet_bootstrap.cc:492] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:31.116564 23294 tablet_bootstrap.cc:654] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.115247 23295 raft_consensus.cc:359] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.119168 23295 raft_consensus.cc:385] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.119465 23295 raft_consensus.cc:740] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.120239 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c068aa5e483f41e783c5498945e63250" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:31.120244 23575 raft_consensus.cc:2804] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.121179 23025 raft_consensus.cc:3060] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.121281 23575 raft_consensus.cc:697] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:31.122375 23575 consensus_queue.cc:237] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.051769 23499 leader_election.cc:290] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:31.123800 23295 consensus_queue.cc:260] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.126477 23295 ts_tablet_manager.cc:1434] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:08:31.127799 23295 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:31.135984 23376 consensus_queue.cc:1048] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.141310 23296 tablet_bootstrap.cc:654] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.175477 23613 raft_consensus.cc:493] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.182178 23613 raft_consensus.cc:515] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.183174 23025 raft_consensus.cc:2468] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:31.186146 23138 leader_election.cc:304] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:31.186606 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98752a0b59b54debad030db8c47b501d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:31.187609 23023 raft_consensus.cc:2468] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:31.187170 23493 raft_consensus.cc:2804] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.191377 23295 tablet_bootstrap.cc:654] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.192539 23064 leader_election.cc:304] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:31.193746 23564 raft_consensus.cc:2804] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.194167 23564 raft_consensus.cc:493] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.194538 23564 raft_consensus.cc:3060] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.192765 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98752a0b59b54debad030db8c47b501d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:31.197753 23172 raft_consensus.cc:2468] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:31.198742 23376 consensus_queue.cc:1048] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.201152 23606 raft_consensus.cc:515] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.204595 23606 leader_election.cc:290] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:31.207471 23246 raft_consensus.cc:2468] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:31.207505 23564 raft_consensus.cc:515] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.210008 23564 leader_election.cc:290] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:31.211655 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98752a0b59b54debad030db8c47b501d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:31.212570 23025 raft_consensus.cc:3060] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.218914 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed56e7a911d48c097f25c20e39f2385" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:31.191118 23613 leader_election.cc:290] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:31.223204 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98752a0b59b54debad030db8c47b501d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:31.240280 23096 raft_consensus.cc:3060] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.249598 23172 raft_consensus.cc:3060] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.254813 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed56e7a911d48c097f25c20e39f2385" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:31.267755 23246 raft_consensus.cc:3060] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.277769 23246 raft_consensus.cc:2468] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:31.278326 23294 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:31.278952 23294 ts_tablet_manager.cc:1403] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.172s	user 0.011s	sys 0.007s
I20260709 13:08:31.285054 23140 leader_election.cc:304] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:31.293020 23025 raft_consensus.cc:2468] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:31.300837 23293 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:31.301486 23293 ts_tablet_manager.cc:1403] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.277s	user 0.046s	sys 0.033s
I20260709 13:08:31.262423 23493 raft_consensus.cc:697] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:31.299969 22920 catalog_manager.cc:5697] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.316610 23064 leader_election.cc:304] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:31.317781 23564 raft_consensus.cc:2804] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.318320 23564 raft_consensus.cc:697] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:31.319236 23564 consensus_queue.cc:237] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.323360 23293 raft_consensus.cc:359] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.324256 23293 raft_consensus.cc:385] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.324532 23293 raft_consensus.cc:740] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.325277 23293 consensus_queue.cc:260] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.311129 23606 raft_consensus.cc:2804] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.328876 23606 raft_consensus.cc:697] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:31.330245 23606 consensus_queue.cc:237] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.332382 23293 ts_tablet_manager.cc:1434] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:08:31.332232 23493 consensus_queue.cc:237] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.333774 23293 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:31.339026 23096 raft_consensus.cc:2468] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:31.345050 23295 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:31.353088 23295 ts_tablet_manager.cc:1403] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.226s	user 0.044s	sys 0.039s
I20260709 13:08:31.350417 23294 raft_consensus.cc:359] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:31.350984 23632 log.cc:927] Time spent T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:08:31.352028 23172 raft_consensus.cc:2468] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:31.357043 23295 raft_consensus.cc:359] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.357916 23295 raft_consensus.cc:385] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.358258 23295 raft_consensus.cc:740] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.359385 23295 consensus_queue.cc:260] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.360004 23294 raft_consensus.cc:385] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.361155 23294 raft_consensus.cc:740] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.362131 23294 consensus_queue.cc:260] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.376529 23294 ts_tablet_manager.cc:1434] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.000s
I20260709 13:08:31.367653 23617 raft_consensus.cc:493] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.381774 23295 ts_tablet_manager.cc:1434] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:08:31.387017 23294 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:31.386695 23617 raft_consensus.cc:515] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.410753 23617 leader_election.cc:290] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:31.413035 23293 tablet_bootstrap.cc:654] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.417708 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c383c2bf6b74c63a4d6713bf94c339c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:31.418429 23097 raft_consensus.cc:2468] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:31.419605 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c383c2bf6b74c63a4d6713bf94c339c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:31.420833 23295 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
W20260709 13:08:31.425040 23211 leader_election.cc:343] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.429410 23212 leader_election.cc:304] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:31.431180 23572 raft_consensus.cc:2804] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.431576 23572 raft_consensus.cc:493] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.431901 23572 raft_consensus.cc:3060] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:31.435527 22991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 68032.7us
I20260709 13:08:31.436611 23296 tablet_bootstrap.cc:492] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:31.437106 23296 ts_tablet_manager.cc:1403] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.328s	user 0.025s	sys 0.044s
I20260709 13:08:31.448652 23296 raft_consensus.cc:359] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.449456 23296 raft_consensus.cc:385] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.449783 23296 raft_consensus.cc:740] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.450687 23296 consensus_queue.cc:260] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.453246 23296 ts_tablet_manager.cc:1434] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:08:31.454363 23296 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:31.460898 23296 tablet_bootstrap.cc:654] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.459530 22923 catalog_manager.cc:5697] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:31.470305 22988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 103926us
I20260709 13:08:31.471949 23295 tablet_bootstrap.cc:654] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.502151 22920 catalog_manager.cc:5697] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.506649 23294 tablet_bootstrap.cc:654] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.522274 23293 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:31.522939 23293 ts_tablet_manager.cc:1403] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.189s	user 0.014s	sys 0.004s
I20260709 13:08:31.523129 23296 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:31.523718 23296 ts_tablet_manager.cc:1403] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.008s
I20260709 13:08:31.541886 23293 raft_consensus.cc:359] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.543108 23293 raft_consensus.cc:385] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.548910 23296 raft_consensus.cc:359] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.550321 23296 raft_consensus.cc:385] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.550743 23296 raft_consensus.cc:740] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.550814 23639 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.551366 23639 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.551775 23296 consensus_queue.cc:260] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.553994 23639 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:31.556417 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:31.557089 23174 raft_consensus.cc:2468] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:31.558292 22988 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:31.559166 23644 raft_consensus.cc:2804] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.560186 23644 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.560527 23644 raft_consensus.cc:3060] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.532905 23572 raft_consensus.cc:515] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.562415 23606 raft_consensus.cc:493] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.562989 23606 raft_consensus.cc:515] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.565064 23296 ts_tablet_manager.cc:1434] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:08:31.543468 23293 raft_consensus.cc:740] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.570348 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c383c2bf6b74c63a4d6713bf94c339c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:31.571301 23097 raft_consensus.cc:3060] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.575412 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c383c2bf6b74c63a4d6713bf94c339c" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:31.576056 23606 leader_election.cc:290] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:31.576972 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c383c2bf6b74c63a4d6713bf94c339c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:31.577657 23174 raft_consensus.cc:3060] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.565624 22920 catalog_manager.cc:5697] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.583074 23293 consensus_queue.cc:260] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.568121 23572 leader_election.cc:290] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:31.585503 23296 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:31.589430 23293 ts_tablet_manager.cc:1434] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.000s
I20260709 13:08:31.590020 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c383c2bf6b74c63a4d6713bf94c339c" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:31.590967 23247 raft_consensus.cc:2393] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:31.591064 23293 tablet_bootstrap.cc:492] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:31.596453 23140 leader_election.cc:304] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:31.598222 23293 tablet_bootstrap.cc:654] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.605688 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:31.606757 23247 raft_consensus.cc:2468] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:31.607637 23097 raft_consensus.cc:2468] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:31.609148 23212 leader_election.cc:304] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:31.609961 23455 raft_consensus.cc:2804] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.610473 23455 raft_consensus.cc:697] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:31.611420 23455 consensus_queue.cc:237] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.615046 23296 tablet_bootstrap.cc:654] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.636641 23294 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:31.637336 23294 ts_tablet_manager.cc:1403] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.253s	user 0.020s	sys 0.030s
I20260709 13:08:31.640969 23644 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.642590 23294 raft_consensus.cc:359] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.643334 23294 raft_consensus.cc:385] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.643615 23294 raft_consensus.cc:740] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.652022 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:31.652921 23172 raft_consensus.cc:3060] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.656167 23644 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:31.663777 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:31.664503 23247 raft_consensus.cc:3060] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.668897 23294 consensus_queue.cc:260] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.676070 23295 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:31.676904 23295 ts_tablet_manager.cc:1403] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.289s	user 0.034s	sys 0.012s
I20260709 13:08:31.690096 23294 ts_tablet_manager.cc:1434] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.005s
I20260709 13:08:31.693557 23295 raft_consensus.cc:359] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.697013 23295 raft_consensus.cc:385] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.693696 23294 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:31.697412 23295 raft_consensus.cc:740] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
W20260709 13:08:31.696131 23652 log.cc:927] Time spent T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:31.702697 23295 consensus_queue.cc:260] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.697571 23174 raft_consensus.cc:2468] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:31.708282 23606 raft_consensus.cc:2749] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.707041 22920 catalog_manager.cc:5697] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.710177 23172 raft_consensus.cc:2468] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:31.712800 22988 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:31.726094 23295 ts_tablet_manager.cc:1434] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:08:31.733507 23247 raft_consensus.cc:2468] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:31.734751 23296 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:31.735351 23296 ts_tablet_manager.cc:1403] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.153s	user 0.031s	sys 0.007s
I20260709 13:08:31.739223 23296 raft_consensus.cc:359] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.739668 23564 consensus_queue.cc:1048] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.739995 23296 raft_consensus.cc:385] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.740356 23296 raft_consensus.cc:740] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.741117 23296 consensus_queue.cc:260] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.744234 23296 ts_tablet_manager.cc:1434] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:31.716657 23575 raft_consensus.cc:2804] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.745409 23575 raft_consensus.cc:697] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:31.746259 23575 consensus_queue.cc:237] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:31.748821 23644 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.749321 23296 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:31.749380 23644 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.751902 23644 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:31.754071 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:31.754776 23174 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:31.755767 22988 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:31.756841 23643 raft_consensus.cc:2804] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.757230 23643 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.757535 23493 consensus_queue.cc:1048] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.763365 23493 consensus_queue.cc:1048] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.764665 23296 tablet_bootstrap.cc:654] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.757560 23643 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.771503 23565 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.772060 23565 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.774287 23565 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:31.777510 23376 consensus_queue.cc:1048] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.786429 23295 tablet_bootstrap.cc:492] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:31.787196 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:31.789079 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:31.789808 23174 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:31.821986 23645 consensus_queue.cc:1048] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:08:31.807040 23455 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.849071 23455 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.859782 23634 consensus_queue.cc:1048] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:08:31.873522 23293 tablet_bootstrap.cc:492] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:31.874454 23293 ts_tablet_manager.cc:1403] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.284s	user 0.028s	sys 0.024s
I20260709 13:08:31.847996 23639 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.890702 23639 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:31.848407 23063 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:31.898934 23643 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:31.913498 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:31.918049 23098 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:31.928200 23293 raft_consensus.cc:359] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:31.929049 23293 raft_consensus.cc:385] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.929375 23293 raft_consensus.cc:740] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.926663 23645 raft_consensus.cc:2804] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.931268 23645 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.932538 23296 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:31.936478 23296 ts_tablet_manager.cc:1403] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.187s	user 0.066s	sys 0.071s
I20260709 13:08:31.934125 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:31.951892 23293 consensus_queue.cc:260] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
W20260709 13:08:31.964983 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:31.925760 23455 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
W20260709 13:08:31.926353 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 86615.9us
I20260709 13:08:31.939742 23645 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.964425 23023 raft_consensus.cc:2393] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:31.960434 23248 raft_consensus.cc:2468] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:31.964425 23639 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:32.022936 23293 ts_tablet_manager.cc:1434] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.148s	user 0.015s	sys 0.013s
I20260709 13:08:32.039103 23293 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
W20260709 13:08:32.041361 23657 log.cc:927] Time spent T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:08:32.042747 23294 tablet_bootstrap.cc:654] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:32.043805 23655 log.cc:927] Time spent T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:08:32.050055 23295 tablet_bootstrap.cc:654] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.061697 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:32.062609 23098 raft_consensus.cc:2468] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:32.078505 22989 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:32.079493 23296 raft_consensus.cc:359] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:32.083401 23296 raft_consensus.cc:385] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.083699 23296 raft_consensus.cc:740] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.084393 23296 consensus_queue.cc:260] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:32.090728 23296 ts_tablet_manager.cc:1434] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.154s	user 0.007s	sys 0.000s
I20260709 13:08:32.096716 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:32.096678 23092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:32.079988 23664 raft_consensus.cc:2804] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.081004 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:32.099597 23172 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.103433 23664 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.103783 23092 raft_consensus.cc:2468] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:32.121024 23664 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.137624 23499 raft_consensus.cc:493] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.143519 23665 raft_consensus.cc:493] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.144263 23665 raft_consensus.cc:515] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:32.143597 23294 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:32.146811 23294 ts_tablet_manager.cc:1403] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.453s	user 0.008s	sys 0.017s
I20260709 13:08:32.164283 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:32.149283 23499 raft_consensus.cc:515] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:32.168289 23499 leader_election.cc:290] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:32.194963 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 55481.1us
I20260709 13:08:32.198756 23296 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:32.198872 23293 tablet_bootstrap.cc:654] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.219323 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:32.233196 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 52460.3us
W20260709 13:08:32.213696 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 83484.8us
W20260709 13:08:32.233520 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 117790us
I20260709 13:08:32.195629 23645 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.246013 23294 raft_consensus.cc:359] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.249261 23294 raft_consensus.cc:385] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.249686 23294 raft_consensus.cc:740] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.269158 23665 leader_election.cc:290] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:32.331671 23091 raft_consensus.cc:2393] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:32.270473 23572 raft_consensus.cc:493] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.351440 23572 raft_consensus.cc:515] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:32.353281 23645 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:32.354132 23572 leader_election.cc:290] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:32.349148 23671 consensus_queue.cc:1048] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.098s
W20260709 13:08:32.350459 23646 log.cc:927] Time spent T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:32.394583 23172 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:32.389746 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:32.396791 22988 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:32.398059 23681 raft_consensus.cc:2804] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.398563 23681 raft_consensus.cc:697] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:32.401716 23295 tablet_bootstrap.cc:492] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:32.404171 23295 ts_tablet_manager.cc:1403] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.618s	user 0.017s	sys 0.012s
W20260709 13:08:32.409368 23212 leader_election.cc:343] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.416923 23296 tablet_bootstrap.cc:654] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:32.419910 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 148858us
W20260709 13:08:32.383214 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 127298us
I20260709 13:08:32.351428 23686 consensus_queue.cc:1048] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.168s
I20260709 13:08:32.399457 23681 consensus_queue.cc:237] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:32.433894 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 46032.5us
I20260709 13:08:32.436533 23643 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:32.449870 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:32.461685 23294 consensus_queue.cc:260] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.461953 23664 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:32.463680 23688 raft_consensus.cc:493] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.464632 23688 raft_consensus.cc:515] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.465160 23018 raft_consensus.cc:2393] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86f6c62fa9a94b679e852571485aa293 in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:32.466413 23664 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
W20260709 13:08:32.430769 23138 leader_election.cc:343] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.471977 23294 ts_tablet_manager.cc:1434] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.325s	user 0.013s	sys 0.000s
I20260709 13:08:32.476742 23294 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:32.482115 23293 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:32.482877 23296 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:32.483711 23171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:32.484401 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e899ea012af5427ca26140b778e6b811" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:32.484508 23171 raft_consensus.cc:2468] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:32.485939 23296 ts_tablet_manager.cc:1403] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.306s	user 0.022s	sys 0.000s
I20260709 13:08:32.482784 23293 ts_tablet_manager.cc:1403] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.444s	user 0.015s	sys 0.006s
W20260709 13:08:32.490098 23211 leader_election.cc:343] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.490108 23295 raft_consensus.cc:359] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:32.491122 23295 raft_consensus.cc:385] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.491482 23295 raft_consensus.cc:740] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.492309 23295 consensus_queue.cc:260] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:32.492529 23293 raft_consensus.cc:359] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:32.494964 23295 ts_tablet_manager.cc:1434] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.004s
I20260709 13:08:32.471168 23243 raft_consensus.cc:2468] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:32.498145 23294 tablet_bootstrap.cc:654] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.491151 23211 leader_election.cc:304] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:32.500957 23617 raft_consensus.cc:2804] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.501370 23617 raft_consensus.cc:493] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.501842 23617 raft_consensus.cc:3060] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.502238 23140 leader_election.cc:304] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:32.493314 23293 raft_consensus.cc:385] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.509078 23293 raft_consensus.cc:740] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.511333 23293 consensus_queue.cc:260] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:32.548209 22989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 81493.7us
I20260709 13:08:32.558985 23693 raft_consensus.cc:2804] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.559615 23693 raft_consensus.cc:493] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.559962 23693 raft_consensus.cc:3060] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.561769 23688 leader_election.cc:290] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:32.561470 23296 raft_consensus.cc:359] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.565667 23296 raft_consensus.cc:385] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.566084 23296 raft_consensus.cc:740] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.572026 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e899ea012af5427ca26140b778e6b811" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:32.572914 23091 raft_consensus.cc:2468] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:32.573521 23617 raft_consensus.cc:515] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:32.574697 22991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 325838us
I20260709 13:08:32.577315 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:32.581169 23617 leader_election.cc:290] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:32.585012 23212 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:32.586838 23572 raft_consensus.cc:2804] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.587251 23572 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.587630 23572 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.588590 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:32.589489 23174 raft_consensus.cc:2393] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:32.591214 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:32.596122 23294 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:32.596733 23294 ts_tablet_manager.cc:1403] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.029s
I20260709 13:08:32.596783 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:32.597514 23098 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.602347 23617 consensus_queue.cc:1048] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.603737 23212 leader_election.cc:304] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:32.604636 23617 raft_consensus.cc:2804] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.605008 23617 raft_consensus.cc:493] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.605332 23617 raft_consensus.cc:3060] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.607519 23572 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:32.607834 23294 raft_consensus.cc:359] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:32.608618 23294 raft_consensus.cc:385] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.608968 23294 raft_consensus.cc:740] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.610064 23294 consensus_queue.cc:260] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:32.611938 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:32.613579 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:32.614423 23243 raft_consensus.cc:2393] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:32.618258 23296 consensus_queue.cc:260] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.611729 23063 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
W20260709 13:08:32.615324 22989 leader_election.cc:343] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.629140 23293 ts_tablet_manager.cc:1434] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.142s	user 0.011s	sys 0.004s
I20260709 13:08:32.636076 23296 ts_tablet_manager.cc:1434] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.150s	user 0.007s	sys 0.000s
I20260709 13:08:32.638154 23294 ts_tablet_manager.cc:1434] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:08:32.638995 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:32.639400 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:32.640384 23168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:32.641170 23168 raft_consensus.cc:2468] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
W20260709 13:08:32.645087 23212 leader_election.cc:343] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.656325 23296 tablet_bootstrap.cc:492] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:32.656698 22988 leader_election.cc:304] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:32.656704 23293 tablet_bootstrap.cc:492] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:32.631918 23645 raft_consensus.cc:2749] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:32.661813 23295 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:32.660048 23681 consensus_queue.cc:1048] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:32.664930 23672 raft_consensus.cc:2804] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:32.663730 22991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 46897.7us
I20260709 13:08:32.665385 23672 raft_consensus.cc:493] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.665786 23672 raft_consensus.cc:3060] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.669710 23698 consensus_queue.cc:1048] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.676652 23693 raft_consensus.cc:515] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:32.678169 23172 raft_consensus.cc:2393] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86f6c62fa9a94b679e852571485aa293 in current term 1: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
I20260709 13:08:32.678831 23294 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:32.678900 23302 consensus_queue.cc:1048] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:32.699654 23295 tablet_bootstrap.cc:654] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.660022 23572 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
W20260709 13:08:32.720085 22989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 44201.1us
I20260709 13:08:32.722561 22922 catalog_manager.cc:5697] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.729259 23693 leader_election.cc:290] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:32.736809 23659 raft_consensus.cc:493] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.737625 23240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:32.738746 23240 raft_consensus.cc:2393] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:32.737528 23659 raft_consensus.cc:515] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:32.744514 23294 tablet_bootstrap.cc:654] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.764673 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:32.771521 23212 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:32.774507 23293 tablet_bootstrap.cc:654] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.785697 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:32.794818 23098 raft_consensus.cc:2468] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:32.806354 23211 leader_election.cc:304] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:32.820436 23672 raft_consensus.cc:515] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.829718 23296 tablet_bootstrap.cc:654] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.796113 23572 raft_consensus.cc:2749] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:32.842689 22989 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:32.850649 23705 raft_consensus.cc:2749] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:08:32.853746 23138 leader_election.cc:343] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.858254 23294 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:32.858340 23138 leader_election.cc:304] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:32.861603 23294 ts_tablet_manager.cc:1403] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.202s	user 0.030s	sys 0.008s
I20260709 13:08:32.863327 23295 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:32.863873 23295 ts_tablet_manager.cc:1403] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.202s	user 0.022s	sys 0.034s
I20260709 13:08:32.862212 23634 raft_consensus.cc:2749] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:32.870630 23701 raft_consensus.cc:2804] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.862439 23617 raft_consensus.cc:515] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:32.872219 23672 leader_election.cc:290] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:32.891610 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:32.892450 23172 raft_consensus.cc:3060] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.893445 23617 leader_election.cc:290] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:32.898746 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:32.899601 23246 raft_consensus.cc:2468] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:32.900460 23701 raft_consensus.cc:697] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:32.912550 22991 leader_election.cc:304] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:32.914119 23683 raft_consensus.cc:2804] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.914559 23683 raft_consensus.cc:493] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.914911 23683 raft_consensus.cc:3060] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.901391 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:32.937796 23172 raft_consensus.cc:2468] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:32.927383 23295 raft_consensus.cc:359] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.938750 23295 raft_consensus.cc:385] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.939086 23295 raft_consensus.cc:740] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.936015 23659 leader_election.cc:290] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:32.939782 23295 consensus_queue.cc:260] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:32.939164 23701 consensus_queue.cc:237] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:32.945554 22988 leader_election.cc:304] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:32.948885 23536 raft_consensus.cc:2804] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.942966 23098 raft_consensus.cc:3060] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.963256 23536 raft_consensus.cc:697] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:32.970474 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:32.975909 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e899ea012af5427ca26140b778e6b811" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:32.986553 23295 ts_tablet_manager.cc:1434] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.000s
I20260709 13:08:32.999030 23295 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
W20260709 13:08:33.004640 23211 leader_election.cc:343] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.993459 23698 consensus_queue.cc:1048] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:08:33.017216 23293 tablet_bootstrap.cc:492] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:33.017800 23293 ts_tablet_manager.cc:1403] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.382s	user 0.027s	sys 0.010s
I20260709 13:08:33.021631 23294 raft_consensus.cc:359] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.022460 23294 raft_consensus.cc:385] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.022758 23294 raft_consensus.cc:740] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.996321 23536 consensus_queue.cc:237] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:33.012054 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e899ea012af5427ca26140b778e6b811" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:33.023479 23294 consensus_queue.cc:260] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:33.045616 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:33.062935 23294 ts_tablet_manager.cc:1434] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.199s	user 0.009s	sys 0.000s
I20260709 13:08:33.064281 23294 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:33.066794 23664 consensus_queue.cc:1048] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:33.068701 22989 leader_election.cc:343] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:33.076705 23293 raft_consensus.cc:359] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.077576 23293 raft_consensus.cc:385] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.077849 23293 raft_consensus.cc:740] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.078473 23293 consensus_queue.cc:260] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.084158 23683 raft_consensus.cc:515] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:33.086352 23683 leader_election.cc:290] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:33.097885 23293 ts_tablet_manager.cc:1434] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 13:08:33.052675 23094 raft_consensus.cc:3060] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:33.106825 23098 raft_consensus.cc:2468] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:33.111286 23293 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:33.107475 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:33.134301 23242 raft_consensus.cc:3060] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:33.147128 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:33.145970 23643 raft_consensus.cc:493] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.150374 23643 raft_consensus.cc:515] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.153088 23643 leader_election.cc:290] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:33.154346 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:33.155340 23245 raft_consensus.cc:2393] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
W20260709 13:08:33.164315 22989 leader_election.cc:343] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:33.165643 23295 tablet_bootstrap.cc:654] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.181201 23296 tablet_bootstrap.cc:492] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:33.181900 23296 ts_tablet_manager.cc:1403] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.526s	user 0.036s	sys 0.042s
I20260709 13:08:33.184587 23296 raft_consensus.cc:359] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.185346 23296 raft_consensus.cc:385] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.185628 23296 raft_consensus.cc:740] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.194931 23294 tablet_bootstrap.cc:654] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.203145 23293 tablet_bootstrap.cc:654] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.218439 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:33.219383 23174 raft_consensus.cc:2393] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 1: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
I20260709 13:08:33.214986 23296 consensus_queue.cc:260] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.247812 22988 leader_election.cc:304] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:33.252414 23094 raft_consensus.cc:2468] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:33.252990 23672 raft_consensus.cc:3060] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:33.258327 23212 leader_election.cc:304] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:33.260201 23704 raft_consensus.cc:2804] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:33.260735 23704 raft_consensus.cc:697] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:33.261631 23704 consensus_queue.cc:237] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.278695 23672 raft_consensus.cc:2749] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:33.284940 23296 ts_tablet_manager.cc:1434] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 13:08:33.220844 23242 raft_consensus.cc:2468] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:33.288410 23294 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:33.289252 23294 ts_tablet_manager.cc:1403] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.225s	user 0.019s	sys 0.021s
I20260709 13:08:33.291007 23296 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:33.295354 22991 leader_election.cc:304] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:33.296875 23295 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:33.297598 23295 ts_tablet_manager.cc:1403] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.303s	user 0.018s	sys 0.034s
I20260709 13:08:33.296939 23701 raft_consensus.cc:2804] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:33.301447 23701 raft_consensus.cc:697] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:33.302389 23701 consensus_queue.cc:237] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:33.300753 23295 raft_consensus.cc:359] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:33.303617 23294 raft_consensus.cc:359] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:33.304553 23295 raft_consensus.cc:385] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.307143 23295 raft_consensus.cc:740] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.308018 23295 consensus_queue.cc:260] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:33.309468 22923 catalog_manager.cc:5697] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } }
I20260709 13:08:33.310500 23295 ts_tablet_manager.cc:1434] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:33.311779 23295 tablet_bootstrap.cc:492] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:33.306735 23294 raft_consensus.cc:385] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.312417 23294 raft_consensus.cc:740] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.313269 23294 consensus_queue.cc:260] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:33.321875 23294 ts_tablet_manager.cc:1434] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:08:33.322999 23294 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:33.330477 23295 tablet_bootstrap.cc:654] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.334158 23294 tablet_bootstrap.cc:654] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.336598 23667 raft_consensus.cc:493] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.337173 23667 raft_consensus.cc:515] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:33.341732 23667 leader_election.cc:290] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:33.384745 23572 raft_consensus.cc:493] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.385473 23572 raft_consensus.cc:515] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.378953 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:33.387996 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:33.388659 23242 raft_consensus.cc:2393] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:33.388978 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc01cc61ed4eaab25d8cb87f61bdba" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:33.391853 23212 leader_election.cc:343] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:33.420845 23296 tablet_bootstrap.cc:654] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.424379 23064 leader_election.cc:304] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:33.427335 23645 raft_consensus.cc:3060] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:33.408159 23572 leader_election.cc:290] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:33.438755 23293 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:33.440413 23294 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:33.440979 23294 ts_tablet_manager.cc:1403] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.118s	user 0.025s	sys 0.013s
I20260709 13:08:33.439381 23293 ts_tablet_manager.cc:1403] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.335s	user 0.013s	sys 0.033s
I20260709 13:08:33.448190 23294 raft_consensus.cc:359] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.451068 23293 raft_consensus.cc:359] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.448925 23294 raft_consensus.cc:385] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.451190 23168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc01cc61ed4eaab25d8cb87f61bdba" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:33.452251 23294 raft_consensus.cc:740] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.451985 23293 raft_consensus.cc:385] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.453289 23293 raft_consensus.cc:740] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.453966 23293 consensus_queue.cc:260] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.455127 23294 consensus_queue.cc:260] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.458549 23293 ts_tablet_manager.cc:1434] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:08:33.459688 23293 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:33.461799 23295 tablet_bootstrap.cc:492] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:33.462317 23295 ts_tablet_manager.cc:1403] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.001s
I20260709 13:08:33.465875 23296 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:33.466425 23296 ts_tablet_manager.cc:1403] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.176s	user 0.016s	sys 0.006s
I20260709 13:08:33.466019 23295 raft_consensus.cc:359] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.467482 23295 raft_consensus.cc:385] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.467816 23295 raft_consensus.cc:740] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.469223 23296 raft_consensus.cc:359] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.469937 23296 raft_consensus.cc:385] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.469658 23295 consensus_queue.cc:260] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.470228 23296 raft_consensus.cc:740] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
W20260709 13:08:33.470594 23211 leader_election.cc:343] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:33.471136 23211 leader_election.cc:304] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:33.472023 23665 raft_consensus.cc:2749] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:33.473445 23295 ts_tablet_manager.cc:1434] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:08:33.470978 23296 consensus_queue.cc:260] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.477654 23294 ts_tablet_manager.cc:1434] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:08:33.478771 23294 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:33.479691 22923 catalog_manager.cc:5697] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.484956 23295 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:33.493516 23683 consensus_queue.cc:1048] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:33.494941 23294 tablet_bootstrap.cc:654] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.477427 23296 ts_tablet_manager.cc:1434] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:33.507831 23639 consensus_queue.cc:1048] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:33.531509 23296 tablet_bootstrap.cc:492] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:33.520713 23643 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.534832 23293 tablet_bootstrap.cc:654] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.527474 23295 tablet_bootstrap.cc:654] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.533941 23643 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:33.540045 23645 raft_consensus.cc:2749] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:33.541859 23643 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:33.549295 23296 tablet_bootstrap.cc:654] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:33.556923 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:33.568037 23171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:33.571749 22988 leader_election.cc:343] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:33.578423 22920 catalog_manager.cc:5697] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:33.582480 22989 leader_election.cc:343] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:33.593904 22989 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:33.594928 23295 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:33.595597 23295 ts_tablet_manager.cc:1403] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.011s
I20260709 13:08:33.582252 22920 catalog_manager.cc:5697] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.580183 23665 raft_consensus.cc:493] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.599920 23499 raft_consensus.cc:493] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.600474 23499 raft_consensus.cc:515] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.602764 23499 leader_election.cc:290] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:33.602245 22920 catalog_manager.cc:5697] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.603505 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d0fdc714544b1bb07aacd6c176a0b" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:33.603425 23665 raft_consensus.cc:515] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.598968 23639 raft_consensus.cc:2749] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:33.607622 23665 leader_election.cc:290] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:33.610877 23242 raft_consensus.cc:2468] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:33.615581 23294 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:33.616797 23294 ts_tablet_manager.cc:1403] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.138s	user 0.005s	sys 0.016s
I20260709 13:08:33.617751 23499 raft_consensus.cc:493] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.618336 23499 raft_consensus.cc:515] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:33.620664 23499 leader_election.cc:290] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:33.621435 23168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d0fdc714544b1bb07aacd6c176a0b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:33.621575 23294 raft_consensus.cc:359] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.623924 23294 raft_consensus.cc:385] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.625941 23140 leader_election.cc:304] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:33.624303 23294 raft_consensus.cc:740] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.630366 23294 consensus_queue.cc:260] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.635193 23294 ts_tablet_manager.cc:1434] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:08:33.635756 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e899ea012af5427ca26140b778e6b811" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:33.623878 23168 raft_consensus.cc:2468] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:33.640709 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d0fdc714544b1bb07aacd6c176a0b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:33.644294 23499 raft_consensus.cc:2804] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:33.644727 23023 raft_consensus.cc:2468] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:33.646257 23499 raft_consensus.cc:493] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.646704 23499 raft_consensus.cc:3060] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:33.641705 23293 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:33.635911 23295 raft_consensus.cc:359] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:33.647846 23293 ts_tablet_manager.cc:1403] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.188s	user 0.013s	sys 0.007s
I20260709 13:08:33.648029 23295 raft_consensus.cc:385] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:33.648566 23295 raft_consensus.cc:740] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:33.648658 23212 leader_election.cc:304] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:33.649580 23572 raft_consensus.cc:2804] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:33.649986 23572 raft_consensus.cc:493] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.650373 23572 raft_consensus.cc:3060] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:33.651211 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d0fdc714544b1bb07aacd6c176a0b" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:33.642971 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e899ea012af5427ca26140b778e6b811" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:33.659039 23295 consensus_queue.cc:260] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:33.665594 23294 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:33.663394 23095 raft_consensus.cc:2393] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:33.652258 23639 consensus_queue.cc:1048] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:08:33.662210 23022 raft_consensus.cc:2468] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:33.706656 23499 raft_consensus.cc:515] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.709039 23499 leader_election.cc:290] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:33.711870 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d0fdc714544b1bb07aacd6c176a0b" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:33.708714 23572 raft_consensus.cc:515] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:33.736119 23293 raft_consensus.cc:359] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:33.725437 22989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 68492.5us
I20260709 13:08:33.716437 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d0fdc714544b1bb07aacd6c176a0b" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:33.721069 23295 ts_tablet_manager.cc:1434] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.125s	user 0.005s	sys 0.003s
I20260709 13:08:33.731434 23296 tablet_bootstrap.cc:492] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:33.759719 23667 raft_consensus.cc:493] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.769209 23246 raft_consensus.cc:2393] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:33.730799 23140 leader_election.cc:304] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:34.064613 23293 raft_consensus.cc:385] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.075119 23296 ts_tablet_manager.cc:1403] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.544s	user 0.025s	sys 0.022s
I20260709 13:08:34.082041 23293 raft_consensus.cc:740] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.085543 23293 consensus_queue.cc:260] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.095890 23294 tablet_bootstrap.cc:654] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.072028 23572 leader_election.cc:290] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:34.084987 23023 raft_consensus.cc:3060] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:34.084595 23171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d0fdc714544b1bb07aacd6c176a0b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:34.107941 23171 raft_consensus.cc:2393] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86f6c62fa9a94b679e852571485aa293 in current term 1: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
I20260709 13:08:34.110134 23296 raft_consensus.cc:359] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:34.110914 23296 raft_consensus.cc:385] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.111276 23293 ts_tablet_manager.cc:1434] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.463s	user 0.032s	sys 0.038s
I20260709 13:08:34.111828 23295 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:34.111202 23296 raft_consensus.cc:740] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.093590 23744 raft_consensus.cc:493] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.151382 23293 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:34.153409 23296 consensus_queue.cc:260] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:34.165432 23750 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.166312 23750 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:34.168073 23302 raft_consensus.cc:493] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.168884 23302 raft_consensus.cc:515] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.088826 23667 raft_consensus.cc:515] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:34.202720 23296 ts_tablet_manager.cc:1434] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.002s
I20260709 13:08:34.146903 23744 raft_consensus.cc:515] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.252394 23750 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:34.253875 23296 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:34.255656 23302 leader_election.cc:290] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:34.258664 23293 tablet_bootstrap.cc:654] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.261518 23634 raft_consensus.cc:3060] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:34.310508 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:34.325372 23744 leader_election.cc:290] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:34.268567 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d0fdc714544b1bb07aacd6c176a0b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:34.358727 23296 tablet_bootstrap.cc:654] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:34.394071 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 663354us
I20260709 13:08:34.367863 23661 consensus_queue.cc:1048] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:08:34.406399 23211 leader_election.cc:304] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:34.381561 23023 raft_consensus.cc:2468] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:34.400415 23667 leader_election.cc:290] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:34.426420 23138 leader_election.cc:304] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:34.430130 23294 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:34.430711 23294 ts_tablet_manager.cc:1403] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.770s	user 0.029s	sys 0.018s
I20260709 13:08:34.413605 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:34.422986 23634 raft_consensus.cc:2749] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:34.453714 23294 raft_consensus.cc:359] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:34.454588 23294 raft_consensus.cc:385] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.454979 23294 raft_consensus.cc:740] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.444705 23025 raft_consensus.cc:2468] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:34.423177 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:34.466472 23665 raft_consensus.cc:2749] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:34.471099 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc01cc61ed4eaab25d8cb87f61bdba" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:34.472069 23166 raft_consensus.cc:2468] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:34.475013 23499 raft_consensus.cc:2804] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:34.475675 23499 raft_consensus.cc:697] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:34.476614 23499 consensus_queue.cc:237] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.477378 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:34.463063 23295 tablet_bootstrap.cc:654] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.482816 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:34.483731 23025 raft_consensus.cc:2468] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
W20260709 13:08:34.489176 22991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 63974.7us
I20260709 13:08:34.504739 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:34.506371 22988 leader_election.cc:343] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:34.506460 23294 consensus_queue.cc:260] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:34.518246 23294 ts_tablet_manager.cc:1434] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.001s
I20260709 13:08:34.520136 23294 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:34.522888 23643 consensus_queue.cc:1048] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:34.521028 23064 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
W20260709 13:08:34.532783 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 118901us
I20260709 13:08:34.540302 23212 leader_election.cc:304] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:34.543362 23751 raft_consensus.cc:2804] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:34.543947 23751 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.544291 23751 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:34.551939 23063 leader_election.cc:304] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
W20260709 13:08:34.559713 23063 leader_election.cc:343] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:34.556495 23296 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:34.584172 23296 ts_tablet_manager.cc:1403] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.331s	user 0.019s	sys 0.000s
I20260709 13:08:34.560449 23748 raft_consensus.cc:2804] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:34.554105 23293 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:34.587894 23748 raft_consensus.cc:493] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.588207 23293 ts_tablet_manager.cc:1403] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.443s	user 0.016s	sys 0.022s
I20260709 13:08:34.588555 23748 raft_consensus.cc:3060] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:34.592501 23296 raft_consensus.cc:359] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.574632 23294 tablet_bootstrap.cc:654] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.577163 23665 raft_consensus.cc:2804] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:34.593909 23665 raft_consensus.cc:493] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.594403 23665 raft_consensus.cc:3060] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:34.593521 23296 raft_consensus.cc:385] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.599764 23296 raft_consensus.cc:740] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.600971 23296 consensus_queue.cc:260] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.603014 23296 ts_tablet_manager.cc:1434] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
W20260709 13:08:34.630890 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 52587.9us
W20260709 13:08:34.633839 23211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 227514us
I20260709 13:08:34.634305 23293 raft_consensus.cc:359] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:34.635077 23293 raft_consensus.cc:385] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.635150 23295 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:34.635366 23293 raft_consensus.cc:740] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.635766 23295 ts_tablet_manager.cc:1403] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.550s	user 0.019s	sys 0.003s
I20260709 13:08:34.636148 23293 consensus_queue.cc:260] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:34.638530 23293 ts_tablet_manager.cc:1434] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 13:08:34.639654 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc01cc61ed4eaab25d8cb87f61bdba" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:34.640338 23242 raft_consensus.cc:2468] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:34.642361 23665 raft_consensus.cc:515] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:34.643411 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 217076us
I20260709 13:08:34.639480 23293 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:34.651135 23296 tablet_bootstrap.cc:492] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:34.656306 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:34.657410 23242 raft_consensus.cc:2393] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:34.662941 23762 raft_consensus.cc:493] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.663594 23762 raft_consensus.cc:515] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.665437 23293 tablet_bootstrap.cc:654] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.665987 23762 leader_election.cc:290] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:34.669126 23748 raft_consensus.cc:515] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:34.670430 23295 raft_consensus.cc:359] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:34.675287 23295 raft_consensus.cc:385] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.675601 23295 raft_consensus.cc:740] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.676245 23295 consensus_queue.cc:260] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:34.677263 23244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:34.678009 23244 raft_consensus.cc:2468] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:34.679196 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:34.679872 23025 raft_consensus.cc:2468] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:34.680598 23665 leader_election.cc:290] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:34.681118 23140 leader_election.cc:304] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:34.681967 23762 raft_consensus.cc:2804] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:34.682324 23762 raft_consensus.cc:493] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.682662 23762 raft_consensus.cc:3060] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.686451 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:34.686411 23295 ts_tablet_manager.cc:1434] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:08:34.690063 23296 tablet_bootstrap.cc:654] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.695145 23025 raft_consensus.cc:3060] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:34.703814 23751 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:34.706559 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc01cc61ed4eaab25d8cb87f61bdba" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:34.706776 23748 leader_election.cc:290] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:34.707437 23242 raft_consensus.cc:3060] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:34.708220 23295 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:34.708640 23021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:34.709374 23021 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:34.712435 23025 raft_consensus.cc:2468] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:34.713832 23212 leader_election.cc:304] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:34.714704 23665 raft_consensus.cc:2804] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:34.715415 23665 raft_consensus.cc:697] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:34.716388 23665 consensus_queue.cc:237] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.718307 23773 consensus_queue.cc:1048] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:34.737411 23293 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:34.738078 23293 ts_tablet_manager.cc:1403] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.005s
I20260709 13:08:34.738200 23762 raft_consensus.cc:515] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.747136 23293 raft_consensus.cc:359] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:34.747977 23293 raft_consensus.cc:385] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.748273 23293 raft_consensus.cc:740] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.748972 23293 consensus_queue.cc:260] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:34.754639 23293 ts_tablet_manager.cc:1434] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:08:34.756680 22991 leader_election.cc:304] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
W20260709 13:08:34.762382 23211 leader_election.cc:343] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:34.767369 23757 raft_consensus.cc:2749] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:34.768942 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:34.775310 23293 tablet_bootstrap.cc:492] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:34.786310 23770 consensus_queue.cc:1048] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:34.794363 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc01cc61ed4eaab25d8cb87f61bdba" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
W20260709 13:08:34.795075 23211 leader_election.cc:343] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:34.796597 23762 leader_election.cc:290] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:34.795182 23170 raft_consensus.cc:3060] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:34.798910 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:34.799582 23245 raft_consensus.cc:3060] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.786194 23751 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:34.807888 23295 tablet_bootstrap.cc:654] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.783401 23748 raft_consensus.cc:493] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.815902 23748 raft_consensus.cc:515] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:34.825618 23296 tablet_bootstrap.cc:492] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:34.827427 23296 ts_tablet_manager.cc:1403] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.000s
I20260709 13:08:34.833154 23294 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:34.833699 23294 ts_tablet_manager.cc:1403] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.314s	user 0.022s	sys 0.028s
I20260709 13:08:34.837219 23665 raft_consensus.cc:493] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.837833 23665 raft_consensus.cc:515] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:34.841006 23665 leader_election.cc:290] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:34.849581 23242 raft_consensus.cc:2468] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:34.857744 23170 raft_consensus.cc:2468] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:34.881490 23293 tablet_bootstrap.cc:654] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.887169 23295 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:34.887844 23295 ts_tablet_manager.cc:1403] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.180s	user 0.012s	sys 0.009s
I20260709 13:08:34.892751 23295 raft_consensus.cc:359] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:34.893656 23295 raft_consensus.cc:385] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.893915 23295 raft_consensus.cc:740] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.894587 23295 consensus_queue.cc:260] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:34.896309 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:34.897765 23063 leader_election.cc:304] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:34.898630 23751 raft_consensus.cc:2804] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:34.899147 23751 raft_consensus.cc:697] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:34.908438 23751 consensus_queue.cc:237] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:34.915958 23295 ts_tablet_manager.cc:1434] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:08:34.917095 23295 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:34.921911 23245 raft_consensus.cc:2468] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:34.922528 23776 consensus_queue.cc:1048] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:34.924029 23296 raft_consensus.cc:359] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:34.924767 23296 raft_consensus.cc:385] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:34.925052 23296 raft_consensus.cc:740] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:34.925372 23140 leader_election.cc:304] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:34.925762 23296 consensus_queue.cc:260] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:34.926335 23776 raft_consensus.cc:2804] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:34.926832 23776 raft_consensus.cc:697] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
W20260709 13:08:34.914947 23063 leader_election.cc:343] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:34.931409 23296 ts_tablet_manager.cc:1434] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.002s
I20260709 13:08:34.935794 23295 tablet_bootstrap.cc:654] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:34.931746 23776 consensus_queue.cc:237] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:34.950336 23296 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
I20260709 13:08:34.950502 23302 raft_consensus.cc:493] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.951046 23302 raft_consensus.cc:515] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:34.953343 23302 leader_election.cc:290] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:34.956881 23293 tablet_bootstrap.cc:492] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:34.957417 23293 ts_tablet_manager.cc:1403] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.182s	user 0.026s	sys 0.005s
I20260709 13:08:34.957185 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:34.959033 23212 leader_election.cc:343] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.008083 23767 raft_consensus.cc:493] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.008828 23767 raft_consensus.cc:515] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:35.030872 23293 raft_consensus.cc:359] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:35.005904 23021 raft_consensus.cc:2468] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:35.034812 23293 raft_consensus.cc:385] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.031889 23767 leader_election.cc:290] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:35.046649 23293 raft_consensus.cc:740] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.050515 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e414b2459e7d4897b74262e9f85a84aa" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:35.061280 23293 consensus_queue.cc:260] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:35.328680 23296 tablet_bootstrap.cc:654] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.341475 23296 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:35.342049 23296 ts_tablet_manager.cc:1403] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.403s	user 0.015s	sys 0.005s
I20260709 13:08:35.345582 23665 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:35.345896 23296 raft_consensus.cc:359] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:35.346259 23665 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:35.346933 23296 raft_consensus.cc:385] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.347318 23296 raft_consensus.cc:740] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.348095 23296 consensus_queue.cc:260] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:35.350273 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:35.350600 23296 ts_tablet_manager.cc:1434] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:08:35.351353 23665 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:35.352303 23296 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
W20260709 13:08:35.359391 22991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 574731us
W20260709 13:08:35.359598 23140 leader_election.cc:343] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.363420 23296 tablet_bootstrap.cc:654] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.446185 23499 raft_consensus.cc:493] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.447268 23499 raft_consensus.cc:515] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:35.456014 23499 leader_election.cc:290] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:35.486943 23767 raft_consensus.cc:493] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.488421 23767 raft_consensus.cc:515] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:35.491245 23767 leader_election.cc:290] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:35.499953 23747 raft_consensus.cc:493] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:35.501055 23747 raft_consensus.cc:515] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:35.502445 23672 consensus_queue.cc:1048] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:35.505012 23747 leader_election.cc:290] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:35.508940 23756 raft_consensus.cc:493] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.509107 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:35.509740 23756 raft_consensus.cc:515] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
W20260709 13:08:35.511641 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:35.513585 23294 raft_consensus.cc:359] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:35.516839 23294 raft_consensus.cc:385] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.517236 23294 raft_consensus.cc:740] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.516923 22921 catalog_manager.cc:5697] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.514907 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98dd70fec646a2b2d9e48e32da649d" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:35.518201 23294 consensus_queue.cc:260] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:35.513579 23756 leader_election.cc:290] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:35.525720 23773 raft_consensus.cc:493] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.526435 23773 raft_consensus.cc:515] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:35.528187 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:35.529328 23296 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:35.529897 23296 ts_tablet_manager.cc:1403] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.178s	user 0.007s	sys 0.016s
I20260709 13:08:35.533084 23296 raft_consensus.cc:359] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:35.533797 23296 raft_consensus.cc:385] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.534061 23296 raft_consensus.cc:740] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.534832 23296 consensus_queue.cc:260] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:35.535691 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b575cdcb4fac42e984e4dc708fcad605" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:35.536521 23095 raft_consensus.cc:2468] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:35.537015 23296 ts_tablet_manager.cc:1434] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:35.537696 23773 leader_election.cc:290] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:35.538285 23296 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf: Bootstrap starting.
W20260709 13:08:35.542115 23794 log.cc:927] Time spent T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed: Append to log took a long time: real 0.488s	user 0.004s	sys 0.000s
I20260709 13:08:35.545436 23296 tablet_bootstrap.cc:654] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.551872 23244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:35.560761 23245 raft_consensus.cc:1275] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:35.560719 23296 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf: No bootstrap required, opened a new log
I20260709 13:08:35.562487 23296 ts_tablet_manager.cc:1403] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.006s
I20260709 13:08:35.563223 23762 consensus_queue.cc:1048] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:35.563624 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98dd70fec646a2b2d9e48e32da649d" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:35.564322 23246 raft_consensus.cc:2468] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
I20260709 13:08:35.565817 23296 raft_consensus.cc:359] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:35.566004 23140 leader_election.cc:304] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:35.567140 23777 raft_consensus.cc:2804] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:35.569061 23748 leader_election.cc:290] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:35.567651 23777 raft_consensus.cc:493] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.573170 23777 raft_consensus.cc:3060] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.567265 23296 raft_consensus.cc:385] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.579855 23296 raft_consensus.cc:740] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.580814 23296 consensus_queue.cc:260] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:35.584159 23777 raft_consensus.cc:515] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:35.587680 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98dd70fec646a2b2d9e48e32da649d" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:35.588338 23242 raft_consensus.cc:3060] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.600416 23296 ts_tablet_manager.cc:1434] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
W20260709 13:08:35.602454 23795 log.cc:927] Time spent T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf: Append to log took a long time: real 0.546s	user 0.001s	sys 0.010s
I20260709 13:08:35.606040 23777 leader_election.cc:290] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:35.610136 23242 raft_consensus.cc:2468] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:35.612668 23140 leader_election.cc:304] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:35.615126 23777 raft_consensus.cc:2804] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.615708 23777 raft_consensus.cc:697] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:35.616614 23777 consensus_queue.cc:237] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:35.631814 23064 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:35.632694 23672 raft_consensus.cc:493] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.633358 23672 raft_consensus.cc:515] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:35.634232 23293 ts_tablet_manager.cc:1434] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.676s	user 0.011s	sys 0.011s
W20260709 13:08:35.634684 23293 ts_tablet_manager.cc:1467] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293: Tablet startup took 676ms
W20260709 13:08:35.635124 23293 ts_tablet_manager.cc:1469] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293: Trace:
0709 13:08:25.975567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.975742 (+   175us) service_pool.cc:224] Handling call
0709 13:08:25.984513 (+  8771us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:08:25.984614 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:08:26.089313 (+104699us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:26.121253 (+ 31940us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:26.121767 (+   514us) inbound_call.cc:177] Queueing success response
0709 13:08:34.765086 (+8643319us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:34.957744 (+192658us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:34.958208 (+   464us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:34.960244 (+  2036us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":32205,"raft.queue_time_us":1945,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":2759,"tablet-open.queue_time_us":8634494}
I20260709 13:08:35.642832 23294 ts_tablet_manager.cc:1434] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.809s	user 0.009s	sys 0.003s
W20260709 13:08:35.643225 23294 ts_tablet_manager.cc:1467] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Tablet startup took 809ms
W20260709 13:08:35.645078 23212 leader_election.cc:343] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:35.643473 23294 ts_tablet_manager.cc:1469] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Trace:
0709 13:08:25.857436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.865239 (+  7803us) service_pool.cc:224] Handling call
0709 13:08:26.020895 (+155656us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b5800011498. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d8b831 00007fcf80d68ac3 00007fcf80d17400 00007fcf7a19caf4 00007fcf7a19ca82 00007fcf7a19c9b1
0709 13:08:26.021046 (+   151us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:08:26.021150 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:08:26.040460 (+ 19310us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:26.110140 (+ 69680us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:26.116439 (+  6299us) inbound_call.cc:177] Queueing success response
0709 13:08:34.519329 (+8402890us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:34.833949 (+314620us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:34.852862 (+ 18913us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:34.853626 (+   764us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":778614,"raft.queue_time_us":122855,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":126,"spinlock_wait_cycles":128628992,"tablet-open.queue_time_us":8402879}
I20260709 13:08:35.646874 23294 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:35.650517 23212 leader_election.cc:304] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:35.652287 23751 raft_consensus.cc:2804] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.653398 23751 raft_consensus.cc:697] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:35.654739 23751 consensus_queue.cc:237] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:35.680485 23293 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293: Bootstrap starting.
I20260709 13:08:35.685137 23294 tablet_bootstrap.cc:654] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.662935 23770 raft_consensus.cc:2804] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:35.707373 22988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 929871us
I20260709 13:08:35.715786 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:35.716464 23174 raft_consensus.cc:3060] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.717190 23295 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:35.717769 23295 ts_tablet_manager.cc:1403] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.801s	user 0.017s	sys 0.015s
I20260709 13:08:35.689368 23766 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:35.699187 23770 raft_consensus.cc:493] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.720062 23168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98dd70fec646a2b2d9e48e32da649d" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:35.712160 23672 leader_election.cc:290] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:35.770416 23098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98dd70fec646a2b2d9e48e32da649d" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:35.746966 23770 raft_consensus.cc:3060] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:35.787534 23138 leader_election.cc:343] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.792212 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:35.793120 23025 raft_consensus.cc:2468] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
W20260709 13:08:35.794157 23211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 50864.4us
I20260709 13:08:35.805135 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98dd70fec646a2b2d9e48e32da649d" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:35.744164 23766 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:35.807727 23138 leader_election.cc:343] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.829761 23025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e414b2459e7d4897b74262e9f85a84aa" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:35.845743 23295 raft_consensus.cc:359] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:35.846761 23295 raft_consensus.cc:385] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.847079 23295 raft_consensus.cc:740] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.847710 23747 raft_consensus.cc:493] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:35.848359 23747 raft_consensus.cc:515] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:35.859344 23211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 62886us
W20260709 13:08:35.860277 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 64509.5us
I20260709 13:08:35.859704 23295 consensus_queue.cc:260] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:35.817291 23756 consensus_queue.cc:1048] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:08:35.869341 23211 leader_election.cc:304] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:35.894701 23021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:35.896792 23753 raft_consensus.cc:2749] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:35.898744 23293 tablet_bootstrap.cc:654] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.901659 23766 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:35.903460 23747 leader_election.cc:290] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:35.901695 23021 raft_consensus.cc:2393] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:35.908782 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:35.912532 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:35.909931 23025 raft_consensus.cc:3060] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.917784 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:35.909929 23097 raft_consensus.cc:2468] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:35.919317 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:35.880432 23767 raft_consensus.cc:493] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.927721 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:35.932884 23138 leader_election.cc:343] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.933614 23138 leader_election.cc:304] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:35.946424 23295 ts_tablet_manager.cc:1434] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.228s	user 0.010s	sys 0.002s
I20260709 13:08:35.968032 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:35.968425 23025 raft_consensus.cc:1275] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:35.950150 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b575cdcb4fac42e984e4dc708fcad605" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:35.948325 23777 raft_consensus.cc:2749] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:35.982429 23138 leader_election.cc:304] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:35.947633 23762 consensus_queue.cc:1048] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:08:35.936201 23767 raft_consensus.cc:515] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:36.005003 23693 raft_consensus.cc:2749] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:36.005228 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:36.011814 23174 raft_consensus.cc:2468] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 0.
I20260709 13:08:35.987684 23212 leader_election.cc:304] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:35.987913 23020 raft_consensus.cc:2468] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:36.015071 23767 leader_election.cc:290] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:35.987968 23818 raft_consensus.cc:493] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:36.003747 23825 raft_consensus.cc:493] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:36.016938 23294 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:36.016546 23818 raft_consensus.cc:515] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:36.017580 23294 ts_tablet_manager.cc:1403] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.371s	user 0.039s	sys 0.055s
I20260709 13:08:36.017302 23825 raft_consensus.cc:515] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:36.019163 23818 leader_election.cc:290] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:35.945616 23763 consensus_queue.cc:1048] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:08:36.022426 23825 leader_election.cc:290] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:36.023766 23748 consensus_queue.cc:1048] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.024555 23294 raft_consensus.cc:359] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:36.025067 23212 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:36.025345 23294 raft_consensus.cc:385] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:36.026595 23294 raft_consensus.cc:740] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.026327 23665 raft_consensus.cc:2749] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.027420 23294 consensus_queue.cc:260] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:35.991438 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 134939us
I20260709 13:08:36.029582 23815 raft_consensus.cc:2749] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.032987 23762 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:36.033607 23762 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:36.034385 23777 raft_consensus.cc:493] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62ed7ae0721746edb91c7e53a9dba2ed)
I20260709 13:08:36.034955 23777 raft_consensus.cc:515] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:36.035166 23766 consensus_queue.cc:1048] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.036016 23762 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:36.029712 23064 leader_election.cc:304] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:36.037297 23777 leader_election.cc:290] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:36.043931 23813 raft_consensus.cc:2749] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.046654 22989 leader_election.cc:304] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
W20260709 13:08:36.047685 23790 log.cc:927] Time spent T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed: Append to log took a long time: real 0.196s	user 0.003s	sys 0.001s
I20260709 13:08:36.048002 23757 raft_consensus.cc:2804] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:36.048413 23757 raft_consensus.cc:493] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.048744 23757 raft_consensus.cc:3060] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.038470 23770 raft_consensus.cc:515] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:36.052243 23770 leader_election.cc:290] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:36.052630 23294 ts_tablet_manager.cc:1434] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:08:36.054101 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.054874 23024 raft_consensus.cc:2468] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:36.061331 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b575cdcb4fac42e984e4dc708fcad605" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:36.062219 23100 raft_consensus.cc:3060] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:36.068599 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 86489.3us
I20260709 13:08:36.073133 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:36.073884 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.087786 23100 raft_consensus.cc:2468] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:36.075234 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b575cdcb4fac42e984e4dc708fcad605" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:36.093317 23024 raft_consensus.cc:3060] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.093576 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:36.094329 23096 raft_consensus.cc:2468] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 0.
W20260709 13:08:36.095602 23121 debug-util.cc:398] Leaking SignalData structure 0x7b0800285860 after lost signal to thread 14296
W20260709 13:08:36.096943 23121 debug-util.cc:398] Leaking SignalData structure 0x7b0800250660 after lost signal to thread 22957
W20260709 13:08:36.098487 23121 debug-util.cc:398] Leaking SignalData structure 0x7b08001c46e0 after lost signal to thread 23049
I20260709 13:08:36.099743 23777 consensus_queue.cc:1048] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.102804 23295 tablet_bootstrap.cc:492] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed: Bootstrap starting.
I20260709 13:08:36.084378 23757 raft_consensus.cc:515] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:36.107762 23757 leader_election.cc:290] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:36.109828 23016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.110816 23016 raft_consensus.cc:2393] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:36.113245 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.126407 23138 leader_election.cc:304] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:36.151791 23212 leader_election.cc:304] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:36.169449 23212 leader_election.cc:304] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:36.175599 23302 raft_consensus.cc:2804] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:36.166865 23121 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6ea0 after lost signal to thread 23124
I20260709 13:08:36.176040 23302 raft_consensus.cc:493] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.163864 23818 raft_consensus.cc:2804] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:36.178453 23302 raft_consensus.cc:3060] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.164940 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:36.166533 23064 leader_election.cc:304] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: bb8204df5095446cb973e600aa7696bf
I20260709 13:08:36.185619 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
W20260709 13:08:36.186491 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 55169.1us
I20260709 13:08:36.188843 23818 raft_consensus.cc:697] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:36.189951 23818 consensus_queue.cc:237] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:36.190827 23091 raft_consensus.cc:3060] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.173693 23815 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:36.192576 23815 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:36.195024 23815 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:36.195108 23806 raft_consensus.cc:493] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8204df5095446cb973e600aa7696bf)
I20260709 13:08:36.195822 23806 raft_consensus.cc:515] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:36.197522 23293 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293: No bootstrap required, opened a new log
I20260709 13:08:36.198066 23806 leader_election.cc:290] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:36.198153 23293 ts_tablet_manager.cc:1403] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293: Time spent bootstrapping tablet: real 0.518s	user 0.008s	sys 0.010s
I20260709 13:08:36.220232 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:36.220999 23168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c068aa5e483f41e783c5498945e63250" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:36.221685 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:36.223474 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:36.218271 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.231171 23771 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:36.231879 23771 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:36.251852 23302 raft_consensus.cc:515] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:36.243880 23121 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4e20 after lost signal to thread 23198
I20260709 13:08:36.255105 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4702f1cac747e4bb14d663d83e58ca" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:36.262209 23302 leader_election.cc:290] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:36.275795 23826 raft_consensus.cc:2804] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:36.276293 23831 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.277320 23831 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:36.278460 23024 raft_consensus.cc:2468] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:36.279889 23800 raft_consensus.cc:493] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:36.280660 23800 raft_consensus.cc:515] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:36.282176 23820 log.cc:927] Time spent T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293: Append to log took a long time: real 0.292s	user 0.004s	sys 0.000s
I20260709 13:08:36.284747 23771 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:36.288579 23831 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:36.276422 23826 raft_consensus.cc:493] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:36.259347 23121 debug-util.cc:398] Leaking SignalData structure 0x7b08000f4240 after lost signal to thread 23199
I20260709 13:08:36.293336 23140 leader_election.cc:304] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:36.319859 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:36.395323 23693 raft_consensus.cc:2749] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:36.395602 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 102408us
I20260709 13:08:36.323941 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.326064 23294 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:36.401203 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c068aa5e483f41e783c5498945e63250" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:36.405638 23294 tablet_bootstrap.cc:654] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:36.413718 23140 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:36.415105 23762 raft_consensus.cc:2749] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.327616 23826 raft_consensus.cc:3060] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.330224 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
W20260709 13:08:36.336773 23138 consensus_peers.cc:597] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.423923 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 87326.1us
I20260709 13:08:36.340981 23091 raft_consensus.cc:2468] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:36.341068 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.426069 23020 raft_consensus.cc:2393] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:36.426815 23748 raft_consensus.cc:2764] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:08:36.260695 23064 leader_election.cc:304] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:36.348675 23293 raft_consensus.cc:359] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:36.429533 23293 raft_consensus.cc:385] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:36.354804 23016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:36.356761 23121 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb2e0 after lost signal to thread 23272
I20260709 13:08:36.359521 23800 leader_election.cc:290] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:36.435286 23138 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:36.430819 22989 leader_election.cc:304] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:36.437012 23661 raft_consensus.cc:2804] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:36.437529 23661 raft_consensus.cc:697] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:36.438452 23661 consensus_queue.cc:237] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:36.442456 23751 raft_consensus.cc:493] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.363232 23295 tablet_bootstrap.cc:654] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:36.369336 22921 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46900 (request call id 59) took 1483 ms. Trace:
I20260709 13:08:36.459702 22921 rpcz_store.cc:276] 0709 13:08:34.886375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.339757 (+453382us) service_pool.cc:224] Handling call
0709 13:08:36.369266 (+1029509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:35.548118 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:35.548545 (+   427us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:35.548570 (+    25us) write_op.cc:435] Acquired schema lock
0709 13:08:35.548580 (+    10us) tablet.cc:662] Decoding operations
0709 13:08:35.548916 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:35.548994 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:35.549035 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:35.549242 (+   207us) tablet.cc:701] Row locks acquired
0709 13:08:35.549260 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:35.549414 (+   154us) write_op.cc:270] Start()
0709 13:08:35.549541 (+   127us) write_op.cc:276] Timestamp: P: 1783602515549370 usec, L: 0
0709 13:08:35.549563 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:35.550373 (+   810us) log.cc:844] Serialized 540 byte log entry
0709 13:08:35.772929 (+222556us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.008485 (+235556us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b180017de80. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a3f3 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
0709 13:08:36.008623 (+   138us) write_op.cc:301] APPLY: starting
0709 13:08:36.008705 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.008815 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.008835 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.009095 (+   260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.009280 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:36.009328 (+    48us) write_op.cc:312] APPLY: finished
0709 13:08:36.009547 (+   219us) log.cc:844] Serialized 22 byte log entry
0709 13:08:36.009711 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.009804 (+    93us) write_op.cc:454] Released schema lock
0709 13:08:36.009846 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.010940 (+  1094us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.010972 (+    32us) write_op.cc:454] Released schema lock
0709 13:08:36.187956 (+176984us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b180017de80. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf81b32de1 00007fcf81b3f5b1 00007fcf78c6a557 00007fcf78c6c7c1 00007fcf78c6c779 00007fcf78c6c709 00007fcf78c6c6d1 00007fcf78c6b9cd 000000000038f354 000000000038f199 00007fcf78c4d83a
Metrics: {"mutex_wait_us":49559,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":41678,"apply.run_cpu_time_us":1589,"apply.run_wall_time_us":2283,"num_ops":1,"prepare.queue_time_us":23948,"prepare.run_cpu_time_us":62378,"prepare.run_wall_time_us":147385,"raft.queue_time_us":75433,"raft.run_cpu_time_us":10859,"raft.run_wall_time_us":33818,"replication_time_us":223212,"spinlock_wait_cycles":9552128,"thread_start_us":254858,"threads_started":4,"wal-append.queue_time_us":144708}]]}
W20260709 13:08:36.379417 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 210053us
I20260709 13:08:36.384624 22922 catalog_manager.cc:5697] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.474237 23751 raft_consensus.cc:515] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:36.392917 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:36.429831 23293 raft_consensus.cc:740] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.456758 23748 raft_consensus.cc:2749] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.386869 23170 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.484279 22991 leader_election.cc:304] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:36.484215 23293 consensus_queue.cc:260] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:36.485857 23802 raft_consensus.cc:2749] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:36.486549 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 233076us
I20260709 13:08:36.487215 23293 ts_tablet_manager.cc:1434] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293: Time spent starting tablet: real 0.288s	user 0.006s	sys 0.005s
I20260709 13:08:36.488951 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
W20260709 13:08:36.489506 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 54327.5us
I20260709 13:08:36.491060 23172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:36.492946 23064 leader_election.cc:304] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:36.475819 23212 leader_election.cc:304] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:36.361392 23022 raft_consensus.cc:2468] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
W20260709 13:08:36.496981 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 49029us
I20260709 13:08:36.498063 23665 raft_consensus.cc:2749] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.501914 23831 consensus_queue.cc:1048] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.498075 23763 raft_consensus.cc:2749] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.503255 23751 leader_election.cc:290] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:36.506161 23212 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:36.505820 23138 leader_election.cc:304] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:36.504962 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:36.510648 23242 raft_consensus.cc:2393] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:36.556078 23016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.556985 23016 raft_consensus.cc:2468] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 0.
I20260709 13:08:36.538729 23773 raft_consensus.cc:2749] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.558843 23064 leader_election.cc:304] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:36.560238 23763 raft_consensus.cc:2804] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:36.560668 23763 raft_consensus.cc:493] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.561049 23763 raft_consensus.cc:3060] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.562227 23764 raft_consensus.cc:2749] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.564363 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.552076 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:36.567744 23021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:36.568487 23021 raft_consensus.cc:3060] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.579859 23294 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: No bootstrap required, opened a new log
I20260709 13:08:36.580565 23294 ts_tablet_manager.cc:1403] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.255s	user 0.017s	sys 0.003s
I20260709 13:08:36.586452 23294 raft_consensus.cc:359] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:36.589751 23294 raft_consensus.cc:385] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:36.590087 23294 raft_consensus.cc:740] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.590827 23294 consensus_queue.cc:260] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:36.591078 23751 consensus_queue.cc:1048] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.573117 23826 raft_consensus.cc:515] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:36.592885 23174 raft_consensus.cc:2393] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 1: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
I20260709 13:08:36.593547 23294 ts_tablet_manager.cc:1434] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:36.596081 23826 leader_election.cc:290] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:36.624387 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.643795 23016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:36.648631 23693 raft_consensus.cc:2749] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:36.660619 23748 consensus_queue.cc:1048] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.662744 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:36.651521 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:36.668707 23096 raft_consensus.cc:2393] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 1: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:36.669320 23212 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:36.671835 23839 raft_consensus.cc:2749] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.684969 23834 raft_consensus.cc:493] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.685556 23834 raft_consensus.cc:515] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:36.670625 23212 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:36.704908 23138 leader_election.cc:304] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:36.711093 23815 raft_consensus.cc:2749] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.689424 23834 leader_election.cc:290] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:36.712527 23171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e414b2459e7d4897b74262e9f85a84aa" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:36.713304 23024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e414b2459e7d4897b74262e9f85a84aa" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:36.713548 23171 raft_consensus.cc:2468] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:36.714248 23024 raft_consensus.cc:2468] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 0.
I20260709 13:08:36.711488 23764 raft_consensus.cc:2749] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:36.717559 23211 leader_election.cc:304] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
W20260709 13:08:36.762142 23211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 44729.6us
W20260709 13:08:36.783882 22989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 65592.6us
I20260709 13:08:36.785673 23834 raft_consensus.cc:2804] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:36.884753 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 124572us
I20260709 13:08:36.882308 23834 raft_consensus.cc:493] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.945550 23834 raft_consensus.cc:3060] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:36.958277 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:08:36.975307 23845 log.cc:927] Time spent T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:08:37.005569 23773 consensus_queue.cc:1048] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:08:36.970894 23763 raft_consensus.cc:515] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:37.037619 23295 tablet_bootstrap.cc:492] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed: No bootstrap required, opened a new log
I20260709 13:08:37.038506 23295 ts_tablet_manager.cc:1403] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent bootstrapping tablet: real 0.936s	user 0.015s	sys 0.009s
I20260709 13:08:37.034400 23827 consensus_queue.cc:1048] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:37.042774 23748 raft_consensus.cc:493] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86f6c62fa9a94b679e852571485aa293)
I20260709 13:08:37.043406 23748 raft_consensus.cc:515] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:37.045585 23748 leader_election.cc:290] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:37.047284 22922 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46916 (request call id 74) took 1326 ms. Trace:
I20260709 13:08:37.064986 23095 raft_consensus.cc:2393] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86f6c62fa9a94b679e852571485aa293 in current term 1: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:37.068856 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41361b7bb5d44f2ba006fb10f2c275d8" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:37.056763 22920 catalog_manager.cc:5697] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.078979 22920 catalog_manager.cc:5697] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 1 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.049229 22922 rpcz_store.cc:276] 0709 13:08:35.740004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.750238 (+ 10234us) service_pool.cc:224] Handling call
0709 13:08:37.047190 (+1296952us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:36.579304 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:36.579941 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:36.579985 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:08:36.580004 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:36.580391 (+   387us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:36.580452 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:36.580486 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:36.580737 (+   251us) tablet.cc:701] Row locks acquired
0709 13:08:36.580764 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:08:36.580910 (+   146us) write_op.cc:270] Start()
0709 13:08:36.581067 (+   157us) write_op.cc:276] Timestamp: P: 1783602516580871 usec, L: 0
0709 13:08:36.581104 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.581880 (+   776us) log.cc:844] Serialized 540 byte log entry
0709 13:08:36.583754 (+  1874us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.959811 (+376057us) write_op.cc:301] APPLY: starting
0709 13:08:36.962049 (+  2238us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.965191 (+  3142us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.965350 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.965640 (+   290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.965838 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:36.965907 (+    69us) write_op.cc:312] APPLY: finished
0709 13:08:36.971197 (+  5290us) log.cc:844] Serialized 22 byte log entry
0709 13:08:36.976188 (+  4991us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.976281 (+    93us) write_op.cc:454] Released schema lock
0709 13:08:36.976327 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.976710 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.976741 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":364153,"apply.run_cpu_time_us":2116,"apply.run_wall_time_us":24377,"num_ops":1,"prepare.queue_time_us":51663,"prepare.run_cpu_time_us":2890,"prepare.run_wall_time_us":2890,"replication_time_us":2515,"thread_start_us":328805,"threads_started":2}]]}
W20260709 13:08:37.110280 22989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 72217.9us
I20260709 13:08:37.114274 23295 raft_consensus.cc:359] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:37.115335 23295 raft_consensus.cc:385] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:37.115898 23295 raft_consensus.cc:740] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.058646 23815 consensus_queue.cc:1048] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260709 13:08:37.124965 23295 consensus_queue.cc:260] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:37.108933 23774 consensus_queue.cc:1048] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:08:37.140970 23295 ts_tablet_manager.cc:1434] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.001s
I20260709 13:08:37.142012 23763 leader_election.cc:290] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:37.152668 23021 consensus_meta.cc:287] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.003s
I20260709 13:08:37.184614 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41361b7bb5d44f2ba006fb10f2c275d8" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:37.176523 23021 raft_consensus.cc:2468] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:37.242210 23244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:37.243604 23244 raft_consensus.cc:2393] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
W20260709 13:08:37.263679 22988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 46283.8us
I20260709 13:08:37.274180 23021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:37.266047 23064 leader_election.cc:304] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:37.303917 23824 raft_consensus.cc:2749] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:37.275434 23021 raft_consensus.cc:2393] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 1: Already voted for candidate 86f6c62fa9a94b679e852571485aa293 in this term.
I20260709 13:08:37.319116 23212 leader_election.cc:304] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:37.349627 23770 raft_consensus.cc:2804] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:37.350360 23770 raft_consensus.cc:697] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
W20260709 13:08:37.373940 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 108007us
W20260709 13:08:37.389102 23211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 196689us
W20260709 13:08:37.389766 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 70804.2us
I20260709 13:08:37.400032 22920 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46886 (request call id 83) took 1139 ms. Trace:
W20260709 13:08:37.417073 22988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 151018us
I20260709 13:08:37.388448 23824 raft_consensus.cc:493] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.400561 22920 rpcz_store.cc:276] 0709 13:08:36.276855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.276995 (+   140us) service_pool.cc:224] Handling call
0709 13:08:37.399956 (+1122961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:37.186550 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:37.187144 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:37.187182 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:08:37.187202 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:37.187684 (+   482us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:37.187747 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:37.187784 (+    37us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:37.188126 (+   342us) tablet.cc:701] Row locks acquired
0709 13:08:37.188139 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:08:37.188329 (+   190us) write_op.cc:270] Start()
0709 13:08:37.188443 (+   114us) write_op.cc:276] Timestamp: P: 1783602517188280 usec, L: 0
0709 13:08:37.188459 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:08:37.189178 (+   719us) log.cc:844] Serialized 928 byte log entry
0709 13:08:37.192981 (+  3803us) op_driver.cc:464] REPLICATION: finished
0709 13:08:37.208419 (+ 15438us) write_op.cc:301] APPLY: starting
0709 13:08:37.216254 (+  7835us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:37.239907 (+ 23653us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:37.248872 (+  8965us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:37.249340 (+   468us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:37.249584 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:37.249667 (+    83us) write_op.cc:312] APPLY: finished
0709 13:08:37.249963 (+   296us) log.cc:844] Serialized 28 byte log entry
0709 13:08:37.250182 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.250297 (+   115us) write_op.cc:454] Released schema lock
0709 13:08:37.250347 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:37.250727 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.250759 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":67621,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":200,"apply.run_cpu_time_us":2496,"apply.run_wall_time_us":52542,"num_ops":2,"prepare.queue_time_us":99638,"prepare.run_cpu_time_us":2963,"prepare.run_wall_time_us":2964,"replication_time_us":4403,"thread_start_us":40759,"threads_started":1}]]}
I20260709 13:08:37.415732 23770 consensus_queue.cc:237] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:37.438288 23824 raft_consensus.cc:515] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:37.464219 23824 leader_election.cc:290] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:37.464653 23064 leader_election.cc:304] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:37.466151 23824 raft_consensus.cc:2749] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:37.483516 23099 raft_consensus.cc:3060] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:37.513994 23240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98dd70fec646a2b2d9e48e32da649d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
W20260709 13:08:37.630962 23834 consensus_meta.cc:287] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.008s
I20260709 13:08:37.631907 23834 raft_consensus.cc:515] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:37.634663 23834 leader_election.cc:290] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:37.700263 22989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 135940us
W20260709 13:08:37.704321 22991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 135578us
I20260709 13:08:37.731302 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e414b2459e7d4897b74262e9f85a84aa" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:37.733264 23173 raft_consensus.cc:3060] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:37.768730 23021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e414b2459e7d4897b74262e9f85a84aa" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:37.774585 23021 raft_consensus.cc:3060] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:37.799191 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98dd70fec646a2b2d9e48e32da649d" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:37.837638 23063 leader_election.cc:304] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:37.863978 23645 raft_consensus.cc:2749] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:37.857240 22918 catalog_manager.cc:5697] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 2, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 2 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.905651 22918 catalog_manager.cc:5697] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 1 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.987872 23021 raft_consensus.cc:2468] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:38.036499 23173 raft_consensus.cc:2468] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:38.038573 23211 leader_election.cc:304] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:38.040621 23753 raft_consensus.cc:2804] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:38.041260 23753 raft_consensus.cc:697] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:38.042541 23753 consensus_queue.cc:237] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:38.053665 23665 consensus_queue.cc:1048] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:38.098516 23665 consensus_queue.cc:1048] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:38.136404 22918 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46900 (request call id 60) took 1096 ms. Trace:
I20260709 13:08:38.137012 22918 rpcz_store.cc:276] 0709 13:08:37.040120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.040293 (+   173us) service_pool.cc:224] Handling call
0709 13:08:38.136268 (+1095975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:38.062378 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:38.063229 (+   851us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:38.063285 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:08:38.063323 (+    38us) tablet.cc:662] Decoding operations
0709 13:08:38.075929 (+ 12606us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:38.076053 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:38.076088 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:38.076591 (+   503us) tablet.cc:701] Row locks acquired
0709 13:08:38.076643 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:08:38.076833 (+   190us) write_op.cc:270] Start()
0709 13:08:38.077031 (+   198us) write_op.cc:276] Timestamp: P: 1783602518076773 usec, L: 0
0709 13:08:38.077070 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:08:38.077941 (+   871us) log.cc:844] Serialized 928 byte log entry
0709 13:08:38.112819 (+ 34878us) op_driver.cc:464] REPLICATION: finished
0709 13:08:38.121343 (+  8524us) write_op.cc:301] APPLY: starting
0709 13:08:38.121455 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:38.121619 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:38.121776 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:38.122269 (+   493us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:38.122589 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:38.122660 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:38.122943 (+   283us) log.cc:844] Serialized 28 byte log entry
0709 13:08:38.126448 (+  3505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:38.126582 (+   134us) write_op.cc:454] Released schema lock
0709 13:08:38.126650 (+    68us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":8202,"num_ops":2,"prepare.queue_time_us":132222,"prepare.run_cpu_time_us":4073,"prepare.run_wall_time_us":16016,"replication_time_us":35552,"thread_start_us":122622,"threads_started":2}]]}
I20260709 13:08:38.150921 22922 catalog_manager.cc:5697] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e reported cstate change: term changed from 0 to 1, leader changed from <none> to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 1 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.176419 22923 catalog_manager.cc:5697] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } }
W20260709 13:08:38.171365 22970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:38.238020 22918 catalog_manager.cc:5697] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.247627 22918 catalog_manager.cc:5697] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 1 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:38.463177 23753 consensus_queue.cc:1048] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:38.480841 14293 tablet_server.cc:179] TabletServer@127.13.245.65:0 shutting down...
W20260709 13:08:38.485258 23064 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:38.549965 23138 consensus_peers.cc:597] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.551995 23212 consensus_peers.cc:597] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.555649 23064 consensus_peers.cc:597] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.565582 23212 consensus_peers.cc:597] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.603039 23138 consensus_peers.cc:597] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.606832 23138 consensus_peers.cc:597] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.618747 23138 consensus_peers.cc:597] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.632373 23138 consensus_peers.cc:597] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.649863 23212 consensus_peers.cc:597] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.658880 23064 consensus_peers.cc:597] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.659870 23064 consensus_peers.cc:597] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.676971 23064 consensus_peers.cc:597] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.680133 23138 consensus_peers.cc:597] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:38.698237 23138 consensus_peers.cc:597] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.712419 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:08:38.716104 23212 consensus_peers.cc:597] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.716542 14293 tablet_replica.cc:333] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.718180 14293 raft_consensus.cc:2243] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.718940 14293 raft_consensus.cc:2272] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.723660 14293 tablet_replica.cc:333] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.724752 14293 raft_consensus.cc:2243] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.725473 14293 raft_consensus.cc:2272] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.729399 14293 tablet_replica.cc:333] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.730611 14293 raft_consensus.cc:2243] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.732195 14293 raft_consensus.cc:2272] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.735385 14293 tablet_replica.cc:333] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.736114 14293 raft_consensus.cc:2243] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.737216 14293 raft_consensus.cc:2272] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.739984 14293 tablet_replica.cc:333] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.740682 14293 raft_consensus.cc:2243] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.742311 14293 raft_consensus.cc:2272] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.746477 14293 tablet_replica.cc:333] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.747875 14293 raft_consensus.cc:2243] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.749339 14293 raft_consensus.cc:2272] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.755497 14293 tablet_replica.cc:333] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.756695 14293 raft_consensus.cc:2243] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:08:38.758576 23138 consensus_peers.cc:597] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.759151 14293 raft_consensus.cc:2272] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.764586 14293 tablet_replica.cc:333] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.765713 14293 raft_consensus.cc:2243] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.768636 14293 raft_consensus.cc:2272] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.774211 14293 tablet_replica.cc:333] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.775645 14293 raft_consensus.cc:2243] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.776886 14293 raft_consensus.cc:2272] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.780241 14293 tablet_replica.cc:333] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.781121 14293 raft_consensus.cc:2243] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.781724 14293 raft_consensus.cc:2272] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.785228 14293 tablet_replica.cc:333] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.786216 14293 raft_consensus.cc:2243] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.787513 14293 raft_consensus.cc:2272] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.790824 14293 tablet_replica.cc:333] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.791791 14293 raft_consensus.cc:2243] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.792997 14293 raft_consensus.cc:2272] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.796304 14293 tablet_replica.cc:333] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.798827 14293 raft_consensus.cc:2243] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.799518 14293 raft_consensus.cc:2272] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.805223 14293 tablet_replica.cc:333] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.805974 14293 raft_consensus.cc:2243] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.807224 14293 raft_consensus.cc:2272] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.811856 14293 tablet_replica.cc:333] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.812966 14293 raft_consensus.cc:2243] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.813581 14293 raft_consensus.cc:2272] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.817183 14293 tablet_replica.cc:333] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: stopping tablet replica
W20260709 13:08:38.818125 23212 consensus_peers.cc:597] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.818274 14293 raft_consensus.cc:2243] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.819687 14293 raft_consensus.cc:2272] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.822978 14293 tablet_replica.cc:333] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.823920 14293 raft_consensus.cc:2243] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:08:38.824908 23212 consensus_peers.cc:597] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.825167 14293 raft_consensus.cc:2272] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.827855 14293 tablet_replica.cc:333] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.828467 14293 raft_consensus.cc:2243] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.829360 14293 raft_consensus.cc:2272] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.831792 14293 tablet_replica.cc:333] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.832630 14293 raft_consensus.cc:2243] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.833329 14293 raft_consensus.cc:2272] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.836127 14293 tablet_replica.cc:333] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.836826 14293 raft_consensus.cc:2243] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.837687 14293 raft_consensus.cc:2272] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.840286 14293 tablet_replica.cc:333] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.840950 14293 raft_consensus.cc:2243] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.841954 14293 raft_consensus.cc:2272] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.845274 14293 tablet_replica.cc:333] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.846179 14293 raft_consensus.cc:2243] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.846756 14293 raft_consensus.cc:2272] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.849977 14293 tablet_replica.cc:333] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.850852 14293 raft_consensus.cc:2243] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.851486 14293 raft_consensus.cc:2272] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.854919 14293 tablet_replica.cc:333] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.855854 14293 raft_consensus.cc:2243] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.856493 14293 raft_consensus.cc:2272] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.859673 14293 tablet_replica.cc:333] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.860500 14293 raft_consensus.cc:2243] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.861122 14293 raft_consensus.cc:2272] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:38.863070 23212 consensus_peers.cc:597] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.864043 14293 tablet_replica.cc:333] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.864728 14293 raft_consensus.cc:2243] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.865676 14293 raft_consensus.cc:2272] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.868140 14293 tablet_replica.cc:333] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.868770 14293 raft_consensus.cc:2243] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.869277 14293 raft_consensus.cc:2272] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.871778 14293 tablet_replica.cc:333] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.872383 14293 raft_consensus.cc:2243] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.872855 14293 raft_consensus.cc:2272] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.875396 14293 tablet_replica.cc:333] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.875999 14293 raft_consensus.cc:2243] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.876955 14293 raft_consensus.cc:2272] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.879789 14293 tablet_replica.cc:333] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.880374 14293 raft_consensus.cc:2243] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.881325 14293 raft_consensus.cc:2272] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.883824 14293 tablet_replica.cc:333] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.884502 14293 raft_consensus.cc:2243] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.885154 14293 raft_consensus.cc:2272] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.888440 14293 tablet_replica.cc:333] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.889389 14293 raft_consensus.cc:2243] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.890058 14293 raft_consensus.cc:2272] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.893217 14293 tablet_replica.cc:333] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.894088 14293 raft_consensus.cc:2243] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.894762 14293 raft_consensus.cc:2272] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.898048 14293 tablet_replica.cc:333] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.898942 14293 raft_consensus.cc:2243] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.899689 14293 raft_consensus.cc:2272] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.903288 14293 tablet_replica.cc:333] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.904155 14293 raft_consensus.cc:2243] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.905102 14293 raft_consensus.cc:2272] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.907486 14293 tablet_replica.cc:333] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.908396 14293 raft_consensus.cc:2243] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:08:38.909188 23064 consensus_peers.cc:597] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.909610 14293 raft_consensus.cc:2272] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.912993 14293 tablet_replica.cc:333] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.913839 14293 raft_consensus.cc:2243] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.915026 14293 raft_consensus.cc:2272] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.918161 14293 tablet_replica.cc:333] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.918817 14293 raft_consensus.cc:2243] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.919405 14293 raft_consensus.cc:2272] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.922267 14293 tablet_replica.cc:333] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.922941 14293 raft_consensus.cc:2243] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.923523 14293 raft_consensus.cc:2272] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.926980 14293 tablet_replica.cc:333] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.927848 14293 raft_consensus.cc:2243] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.929170 14293 raft_consensus.cc:2272] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.932452 14293 tablet_replica.cc:333] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.933346 14293 raft_consensus.cc:2243] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.933933 14293 raft_consensus.cc:2272] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.938231 14293 tablet_replica.cc:333] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.939108 14293 raft_consensus.cc:2243] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.940171 14293 raft_consensus.cc:2272] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.942801 14293 tablet_replica.cc:333] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.943491 14293 raft_consensus.cc:2243] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:38.944576 14293 raft_consensus.cc:2272] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.947585 14293 tablet_replica.cc:333] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.948181 14293 raft_consensus.cc:2243] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.948733 14293 raft_consensus.cc:2272] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.951664 14293 tablet_replica.cc:333] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: stopping tablet replica
I20260709 13:08:38.952251 14293 raft_consensus.cc:2243] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.952772 14293 raft_consensus.cc:2272] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:38.977679 23064 consensus_peers.cc:597] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:39.004076 23212 consensus_peers.cc:597] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:39.040051 23064 connection.cc:573] client connection to 127.13.245.65:41281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:08:39.044099 23212 connection.cc:573] client connection to 127.13.245.65:41281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:08:39.070937 14293 tablet_server.cc:196] TabletServer@127.13.245.65:0 shutdown complete.
W20260709 13:08:39.092453 23212 consensus_peers.cc:597] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:39.254391 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:39.272280 23893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:39.286654 23894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:39.316820 14293 server_base.cc:1061] running on GCE node
W20260709 13:08:39.323945 23896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:39.326535 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:39.326963 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:39.327530 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602519327257 us; error 0 us; skew 500 ppm
I20260709 13:08:39.328425 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:39.344511 14293 webserver.cc:533] Webserver started at http://127.13.245.65:34909/ using document root <none> and password file <none>
I20260709 13:08:39.345394 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:39.345691 14293 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:08:39.354205 14293 fs_manager.cc:714] Time spent opening directory manager: real 0.007s	user 0.001s	sys 0.008s
I20260709 13:08:39.369345 23901 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:39.370543 14293 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.003s	sys 0.006s
I20260709 13:08:39.371066 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "164704f999554466a68662962540809e"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-fc6v"
I20260709 13:08:39.371713 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:39.405143 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:39.407508 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:39.409835 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:39.416297 23908 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:08:39.781857 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:08:39.782199 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.367s	user 0.006s	sys 0.004s
I20260709 13:08:39.782519 14293 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:08:39.787443 23908 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:39.814510 23908 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.815618 23908 tablet_bootstrap.cc:492] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:39.816361 23908 ts_tablet_manager.cc:1403] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.008s
I20260709 13:08:39.820228 23908 raft_consensus.cc:359] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:39.821012 23908 raft_consensus.cc:740] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:39.821986 23908 consensus_queue.cc:260] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:39.825489 23645 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.826124 23645 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:39.828295 23908 ts_tablet_manager.cc:1434] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:08:39.829329 23908 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:39.830116 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:39.834015 23892 raft_consensus.cc:493] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
W20260709 13:08:39.834046 23064 leader_election.cc:336] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:39.835110 23064 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:39.834805 23892 raft_consensus.cc:515] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:39.836021 23888 raft_consensus.cc:2749] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.834174 23645 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:39.837641 23892 leader_election.cc:290] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:39.840379 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:39.845427 23866 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.846118 23866 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:39.846733 23138 leader_election.cc:336] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:39.847324 23138 leader_election.cc:304] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:39.849108 23892 raft_consensus.cc:2749] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.853317 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:39.857802 23212 leader_election.cc:336] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:39.858698 23211 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:39.859804 23770 raft_consensus.cc:2749] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.860890 23866 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:39.867929 23908 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.869045 23908 tablet_bootstrap.cc:492] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:39.869732 23908 ts_tablet_manager.cc:1403] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.012s
I20260709 13:08:39.870525 23866 raft_consensus.cc:493] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.871156 23866 raft_consensus.cc:515] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:39.872579 23908 raft_consensus.cc:359] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:39.873308 23908 raft_consensus.cc:740] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:39.873778 23866 leader_election.cc:290] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:39.874205 23908 consensus_queue.cc:260] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:39.876283 23908 ts_tablet_manager.cc:1434] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:39.877136 23908 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:39.880648 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:39.884331 23212 leader_election.cc:336] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:39.886236 23212 leader_election.cc:304] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:39.887108 23866 raft_consensus.cc:2749] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.896042 23908 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.897312 23908 tablet_bootstrap.cc:492] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:39.898108 23908 ts_tablet_manager.cc:1403] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:08:39.901367 23892 raft_consensus.cc:493] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.901216 23908 raft_consensus.cc:359] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:39.902117 23908 raft_consensus.cc:740] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:39.901963 23892 raft_consensus.cc:515] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:39.903040 23908 consensus_queue.cc:260] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:39.904223 23892 leader_election.cc:290] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:39.905540 23908 ts_tablet_manager.cc:1434] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:39.906673 23908 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:39.907997 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:39.915709 23645 raft_consensus.cc:493] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.916479 23645 raft_consensus.cc:515] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:39.922629 23645 leader_election.cc:290] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:39.924731 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:39.925769 23866 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.926512 23866 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:39.928738 23866 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:39.932576 23888 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.933228 23888 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:39.937062 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
W20260709 13:08:39.937649 23212 leader_election.cc:336] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:39.941629 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:39.945339 23212 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:39.947377 23753 raft_consensus.cc:2749] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:39.947571 23064 leader_election.cc:336] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:39.949154 23138 leader_election.cc:336] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:39.949640 23138 leader_election.cc:304] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:39.925685 23166 raft_consensus.cc:2468] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:39.952934 23887 raft_consensus.cc:493] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.953474 23887 raft_consensus.cc:515] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:39.956480 23753 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.957129 23753 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:39.958113 23887 leader_election.cc:290] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:39.958740 23887 raft_consensus.cc:2749] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.959368 23753 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:39.960255 23063 leader_election.cc:304] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:39.961616 23892 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.962186 23892 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:39.963061 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:39.964308 23892 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:39.964957 23888 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:39.965593 23888 raft_consensus.cc:2804] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.965934 23888 raft_consensus.cc:493] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
W20260709 13:08:39.968813 23212 leader_election.cc:336] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:39.970077 23751 raft_consensus.cc:493] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.974411 23888 raft_consensus.cc:3060] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.974689 23751 raft_consensus.cc:515] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:39.977108 23751 leader_election.cc:290] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:39.977634 23212 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:39.977881 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:39.978370 23866 raft_consensus.cc:493] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.978554 23246 raft_consensus.cc:2468] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:39.978924 23866 raft_consensus.cc:515] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:39.979993 23066 leader_election.cc:304] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:39.981112 23866 leader_election.cc:290] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:39.981276 23751 raft_consensus.cc:2804] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.981680 23751 raft_consensus.cc:493] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.982214 23751 raft_consensus.cc:3060] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.972671 23645 raft_consensus.cc:493] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.983367 23645 raft_consensus.cc:515] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:39.986308 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:39.986956 23166 raft_consensus.cc:2468] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:39.988233 23063 leader_election.cc:304] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:39.981703 23866 raft_consensus.cc:2749] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:39.973763 23064 leader_election.cc:336] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:39.995808 23064 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:39.997396 23645 leader_election.cc:290] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:39.997984 23645 raft_consensus.cc:2804] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.998327 23645 raft_consensus.cc:493] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:39.998667 23645 raft_consensus.cc:3060] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:40.005579 23212 leader_election.cc:336] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.030514 23751 raft_consensus.cc:515] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.049180 23916 raft_consensus.cc:2749] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.050225 23916 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.050741 23918 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
W20260709 13:08:40.051067 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 50483.2us
I20260709 13:08:40.050789 23916 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.053992 23916 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:40.042532 23645 raft_consensus.cc:515] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.056949 23645 leader_election.cc:290] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:40.051385 23918 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.060745 23866 raft_consensus.cc:493] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.061358 23866 raft_consensus.cc:515] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.064594 23866 leader_election.cc:290] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:40.065513 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 91781.5us
W20260709 13:08:40.070001 23212 leader_election.cc:336] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.076627 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 127486us
I20260709 13:08:40.075701 23916 raft_consensus.cc:493] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.077714 23916 raft_consensus.cc:515] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.081789 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.083063 23918 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.084509 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.085443 23246 raft_consensus.cc:2468] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.087491 23066 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:40.089326 23918 raft_consensus.cc:2804] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.089833 23918 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.090308 23918 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.096024 23753 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.096876 23753 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:40.102056 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 113910us
I20260709 13:08:40.103082 23753 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.107780 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:40.108865 23166 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.108870 23887 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.109822 23887 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.110173 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6248ccc292244da38810b46798b3843f" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:40.110792 23170 raft_consensus.cc:3060] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.112519 23887 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.113205 23914 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.113773 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.115154 23246 raft_consensus.cc:2468] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:40.116667 23140 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:40.119061 23917 raft_consensus.cc:2804] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.119586 23917 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.113963 23914 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.120940 23866 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.121661 23866 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.122545 23914 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.120046 23917 raft_consensus.cc:3060] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:40.123924 23212 leader_election.cc:336] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.132202 23770 raft_consensus.cc:493] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.132815 23770 raft_consensus.cc:515] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.133706 23866 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.134526 23866 raft_consensus.cc:493] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.134945 23770 leader_election.cc:290] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.137487 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.137850 23645 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.138454 23645 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.135260 23866 raft_consensus.cc:515] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.140571 23645 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
W20260709 13:08:40.141323 23212 leader_election.cc:336] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.142045 23212 leader_election.cc:336] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.144236 23170 raft_consensus.cc:2468] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:40.141386 23866 leader_election.cc:290] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.141534 23916 leader_election.cc:290] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.148869 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.149899 23093 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:40.152117 23888 raft_consensus.cc:515] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.154058 23097 raft_consensus.cc:2393] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 2: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:40.156064 23916 raft_consensus.cc:493] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.156754 23916 raft_consensus.cc:515] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:40.160179 23212 leader_election.cc:336] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.161007 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.161854 23246 raft_consensus.cc:2468] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.162966 23066 leader_election.cc:304] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:40.163324 23916 leader_election.cc:290] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.164367 23916 raft_consensus.cc:2804] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.165349 23916 raft_consensus.cc:493] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.166215 23916 raft_consensus.cc:3060] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.167825 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e6c94513d545df957ae3d6c984123b" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.168134 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.171368 23246 raft_consensus.cc:3060] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.174609 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.175433 23100 raft_consensus.cc:2468] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:40.177080 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.180675 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.182196 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:40.185515 23866 raft_consensus.cc:493] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.186326 23866 raft_consensus.cc:515] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.187291 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:40.188934 23770 raft_consensus.cc:493] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.188271 23916 raft_consensus.cc:515] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.189572 23770 raft_consensus.cc:515] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.190855 23097 raft_consensus.cc:2393] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86f6c62fa9a94b679e852571485aa293 in current term 2: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:40.192072 23770 leader_election.cc:290] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.194171 23916 leader_election.cc:290] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.194093 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:40.194840 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.196681 23248 raft_consensus.cc:3060] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:40.197333 23212 leader_election.cc:336] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.199215 23751 leader_election.cc:290] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.200409 23866 leader_election.cc:290] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.203871 23888 leader_election.cc:290] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:40.204558 23888 raft_consensus.cc:493] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.205060 23888 raft_consensus.cc:515] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.205780 23751 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.206343 23751 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.207209 23919 raft_consensus.cc:493] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.207852 23919 raft_consensus.cc:515] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.208702 23248 raft_consensus.cc:2468] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:40.212493 23066 leader_election.cc:304] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:40.212971 23212 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:40.216399 23914 raft_consensus.cc:493] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.217062 23866 raft_consensus.cc:2749] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.217219 23914 raft_consensus.cc:515] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:40.220505 23212 leader_election.cc:336] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.210173 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.221802 23916 raft_consensus.cc:2804] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.227623 23916 raft_consensus.cc:697] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:40.221918 23866 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.228432 23866 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.228703 23916 consensus_queue.cc:237] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.209172 23751 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.223172 23914 leader_election.cc:290] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.230623 23866 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.231756 23212 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.225126 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.232548 23248 raft_consensus.cc:2468] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:40.233052 23212 leader_election.cc:304] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
W20260709 13:08:40.222648 23064 leader_election.cc:336] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.240242 23064 leader_election.cc:336] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.240527 23140 leader_election.cc:304] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
W20260709 13:08:40.241107 23064 leader_election.cc:336] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.241667 23064 leader_election.cc:336] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.242416 23914 raft_consensus.cc:2804] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.242847 23914 raft_consensus.cc:493] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.243204 23914 raft_consensus.cc:3060] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.247963 23920 raft_consensus.cc:2804] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.248517 23770 raft_consensus.cc:2749] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.248534 23920 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.250749 23920 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.262179 23918 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.276783 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:40.277655 23170 raft_consensus.cc:2468] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:40.279260 23920 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.279426 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:40.281358 23212 leader_election.cc:336] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.247288 23064 leader_election.cc:336] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.283237 23064 leader_election.cc:336] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.283838 23064 leader_election.cc:336] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.284271 23064 leader_election.cc:304] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:40.285144 23645 raft_consensus.cc:2749] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:40.285490 23064 leader_election.cc:336] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.286322 23064 leader_election.cc:336] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.286427 23919 leader_election.cc:290] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
W20260709 13:08:40.287096 23064 leader_election.cc:336] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.287842 23917 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.291960 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.292734 23248 raft_consensus.cc:3060] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.293099 23920 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.303082 23248 raft_consensus.cc:2468] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:40.304803 23140 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
W20260709 13:08:40.305334 23212 leader_election.cc:336] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.305707 23887 raft_consensus.cc:2804] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.306241 23887 raft_consensus.cc:697] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
W20260709 13:08:40.306327 23064 leader_election.cc:336] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.306910 23064 leader_election.cc:336] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.307303 23064 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:40.307214 23887 consensus_queue.cc:237] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.308197 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.309041 23242 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.309701 23645 raft_consensus.cc:2749] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.315474 23908 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:40.317922 23063 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.323022 23063 leader_election.cc:304] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.324903 23922 raft_consensus.cc:2804] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.324996 23063 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:40.325722 23922 raft_consensus.cc:697] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:40.317008 23753 raft_consensus.cc:493] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.323756 23751 raft_consensus.cc:2804] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.326694 23753 raft_consensus.cc:515] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.327642 23908 tablet_bootstrap.cc:492] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:40.328511 23908 ts_tablet_manager.cc:1403] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.422s	user 0.128s	sys 0.130s
I20260709 13:08:40.328897 23753 leader_election.cc:290] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.327073 23751 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.329618 23751 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.329888 23919 raft_consensus.cc:2749] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.332300 23918 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.320952 23888 leader_election.cc:290] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
W20260709 13:08:40.333629 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 49944.9us
I20260709 13:08:40.334041 23892 raft_consensus.cc:493] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.344022 23246 raft_consensus.cc:2468] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:40.331403 23908 raft_consensus.cc:359] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.348588 23645 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.348724 23908 raft_consensus.cc:740] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:40.349251 23645 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.334614 23892 raft_consensus.cc:515] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.350564 23211 leader_election.cc:304] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:40.354175 23645 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:40.341813 23753 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.355069 23100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.355763 23100 raft_consensus.cc:2468] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:40.356194 23892 leader_election.cc:290] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.357302 23914 raft_consensus.cc:515] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.357676 23866 raft_consensus.cc:2749] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.358386 23242 raft_consensus.cc:2468] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:40.355090 23753 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.360628 23211 leader_election.cc:304] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:40.361503 22923 catalog_manager.cc:5697] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.359475 23914 leader_election.cc:290] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.363154 23917 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.363924 23866 raft_consensus.cc:2749] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.361429 23066 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:40.362269 23908 consensus_queue.cc:260] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.366577 23138 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
W20260709 13:08:40.373061 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 48151.9us
I20260709 13:08:40.380067 23066 leader_election.cc:304] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.383373 23923 raft_consensus.cc:2804] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.379705 23922 consensus_queue.cc:237] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.384128 23923 raft_consensus.cc:697] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:40.385176 23923 consensus_queue.cc:237] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.392122 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990e32f21d80459799b74a21dfa0be97" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:40.389055 23926 raft_consensus.cc:2804] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.392848 23170 raft_consensus.cc:3060] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.394556 23908 ts_tablet_manager.cc:1434] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:08:40.395754 23908 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:40.398909 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.399953 23246 raft_consensus.cc:2468] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:40.400069 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:40.400786 23166 raft_consensus.cc:2468] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.405233 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7630566d5f604f289dbfa8aae3cabf2f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.405978 23246 raft_consensus.cc:3060] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:40.406400 23211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 45861.3us
I20260709 13:08:40.409155 23211 leader_election.cc:304] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.410020 23866 raft_consensus.cc:2804] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.410430 23866 raft_consensus.cc:493] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.410854 23866 raft_consensus.cc:3060] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.413359 23926 raft_consensus.cc:697] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:40.413511 23916 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.414633 23916 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:40.415937 23064 leader_election.cc:336] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.418092 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.403676 23917 raft_consensus.cc:2804] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.418957 23242 raft_consensus.cc:2468] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.419036 23917 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.419508 23917 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.418200 23167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:40.419828 23645 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.420159 23167 raft_consensus.cc:2468] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.420397 23645 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.422079 23927 raft_consensus.cc:493] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.422844 23645 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.422649 23927 raft_consensus.cc:515] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.421038 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:40.424595 23166 raft_consensus.cc:2468] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.424927 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.424901 23066 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:40.425838 23242 raft_consensus.cc:2468] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.426322 23645 raft_consensus.cc:2804] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.426712 23645 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.427050 23645 raft_consensus.cc:3060] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:40.430497 23212 leader_election.cc:336] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.414913 23926 consensus_queue.cc:237] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.434605 23753 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.418368 23916 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.435995 23066 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:40.438241 23212 leader_election.cc:304] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:40.439893 23170 raft_consensus.cc:2468] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:40.387485 23751 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:40.441584 23064 leader_election.cc:336] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.457715 23140 leader_election.cc:304] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:40.444514 23211 leader_election.cc:304] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
W20260709 13:08:40.458325 23064 leader_election.cc:336] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.446571 23645 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.447695 23138 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
W20260709 13:08:40.459148 23064 leader_election.cc:336] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.459247 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 62919.1us
I20260709 13:08:40.451426 23246 raft_consensus.cc:2468] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:40.453676 23063 leader_election.cc:304] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.463964 23063 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.455962 23916 raft_consensus.cc:2804] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.455778 23753 raft_consensus.cc:2749] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.465814 23888 raft_consensus.cc:2804] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.463200 23914 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.466475 23892 raft_consensus.cc:2804] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.495347 23645 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.472599 23916 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.517637 23921 raft_consensus.cc:2749] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:40.519301 23925 log.cc:927] Time spent T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:08:40.515100 23928 raft_consensus.cc:2804] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.492856 23888 raft_consensus.cc:493] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.496394 23892 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.500591 23923 raft_consensus.cc:2804] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:40.539685 23211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 75172.8us
I20260709 13:08:40.540633 23923 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.541275 23923 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.516474 23916 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.515700 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:40.500976 23914 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.539616 23892 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.524849 23888 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.565833 23751 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:40.523900 23928 raft_consensus.cc:493] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
W20260709 13:08:40.571297 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 107402us
I20260709 13:08:40.566325 22918 catalog_manager.cc:5697] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 2 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.572127 23063 leader_election.cc:304] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.573297 23063 leader_election.cc:304] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.532598 23927 leader_election.cc:290] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:40.565167 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 107553us
I20260709 13:08:40.576206 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d338f57c69b44220a6c31510e829a8f6" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.580101 23246 raft_consensus.cc:3060] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.581228 23140 leader_election.cc:304] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
W20260709 13:08:40.570174 23212 leader_election.cc:336] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.581905 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:40.570677 23094 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.577446 23928 raft_consensus.cc:3060] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.576462 23926 raft_consensus.cc:2804] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.578150 23922 raft_consensus.cc:2804] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.589299 23914 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
W20260709 13:08:40.585093 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 120481us
W20260709 13:08:40.601851 23064 leader_election.cc:336] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.599156 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.608108 23093 raft_consensus.cc:2468] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:40.584318 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.609546 23097 raft_consensus.cc:2468] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:40.609627 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.610420 23099 raft_consensus.cc:2468] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 1.
I20260709 13:08:40.614718 23892 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.602844 23926 raft_consensus.cc:493] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.624478 23926 raft_consensus.cc:3060] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.626859 23892 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.614805 23866 raft_consensus.cc:515] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.618007 23922 raft_consensus.cc:697] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:40.621143 23246 raft_consensus.cc:2468] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:40.622745 23094 raft_consensus.cc:2468] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 2.
I20260709 13:08:40.584460 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.628520 23922 consensus_queue.cc:237] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.628943 23936 raft_consensus.cc:2804] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.629078 23242 raft_consensus.cc:2468] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 1.
I20260709 13:08:40.629604 23936 raft_consensus.cc:697] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:40.630554 23936 consensus_queue.cc:237] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.637207 23866 leader_election.cc:290] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:40.621485 23064 leader_election.cc:336] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.640012 23064 leader_election.cc:336] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.644665 23916 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.645753 23066 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.647228 23915 raft_consensus.cc:2804] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.647840 23915 raft_consensus.cc:697] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:40.647756 23066 leader_election.cc:304] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:40.648953 23915 consensus_queue.cc:237] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.649412 23934 raft_consensus.cc:2804] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:40.646716 23064 leader_election.cc:336] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.660048 23916 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
W20260709 13:08:40.673656 23064 leader_election.cc:336] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.650080 23934 raft_consensus.cc:493] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.700142 23923 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:40.701987 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 114472us
I20260709 13:08:40.698324 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.709465 23242 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.713632 23908 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:08:40.716554 23064 leader_election.cc:336] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.697340 23934 raft_consensus.cc:3060] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:40.724920 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 67889.9us
I20260709 13:08:40.738102 23908 tablet_bootstrap.cc:492] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:40.730573 23928 raft_consensus.cc:515] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.739122 23908 ts_tablet_manager.cc:1403] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.344s	user 0.017s	sys 0.003s
I20260709 13:08:40.740644 23928 leader_election.cc:290] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.742352 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.742340 23908 raft_consensus.cc:359] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.705480 23917 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.744096 23170 raft_consensus.cc:2393] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 2: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
I20260709 13:08:40.743772 23246 raft_consensus.cc:3060] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.745003 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:40.745853 23094 raft_consensus.cc:2393] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 2: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:40.746223 23892 raft_consensus.cc:493] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.746748 23892 raft_consensus.cc:515] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.748198 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:40.748857 23099 raft_consensus.cc:2468] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
I20260709 13:08:40.749951 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:40.750547 23174 raft_consensus.cc:3060] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.752311 23892 leader_election.cc:290] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.755332 23923 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:40.757023 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:40.757839 23248 raft_consensus.cc:2468] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 1.
W20260709 13:08:40.757745 23138 leader_election.cc:336] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.759399 23140 leader_election.cc:304] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
W20260709 13:08:40.759778 23138 leader_election.cc:336] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.723752 23926 raft_consensus.cc:515] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.759438 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:40.760470 23928 raft_consensus.cc:2804] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.761093 23165 raft_consensus.cc:2393] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 62ed7ae0721746edb91c7e53a9dba2ed in current term 2: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
W20260709 13:08:40.761508 23138 leader_election.cc:336] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.760912 23928 raft_consensus.cc:493] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.763698 23928 raft_consensus.cc:3060] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.763953 23926 leader_election.cc:290] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
W20260709 13:08:40.767110 23064 leader_election.cc:336] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.767248 23888 raft_consensus.cc:515] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.745051 23917 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.771184 23063 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:40.771433 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c538e12e094914a765975898fe54e1" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:40.773417 23212 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.773715 23165 raft_consensus.cc:3060] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.774454 23940 raft_consensus.cc:2804] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.772110 23922 raft_consensus.cc:2749] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.774721 23212 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.774892 23940 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.775707 23940 raft_consensus.cc:3060] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.775712 23866 raft_consensus.cc:2804] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.776494 23866 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.776921 23866 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.779805 23064 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:40.743263 23908 raft_consensus.cc:740] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:40.781032 23908 consensus_queue.cc:260] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.781843 23923 raft_consensus.cc:2749] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.786963 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:40.783018 23138 leader_election.cc:304] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:40.784041 23888 leader_election.cc:290] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:40.787659 23166 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.788532 23917 raft_consensus.cc:2749] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:40.789588 23138 leader_election.cc:336] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.792421 14293 ts_tablet_manager.cc:600] Registering tablets (37/45 complete)
I20260709 13:08:40.793359 23174 raft_consensus.cc:2468] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 2.
I20260709 13:08:40.793402 23246 raft_consensus.cc:2468] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:40.794310 23908 ts_tablet_manager.cc:1434] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.005s
I20260709 13:08:40.796846 23908 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:40.797416 23242 raft_consensus.cc:2468] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:40.825534 23066 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.797050 23140 leader_election.cc:304] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:40.827320 23212 leader_election.cc:304] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.828788 23892 raft_consensus.cc:2804] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.828527 23888 raft_consensus.cc:2804] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.829339 23892 raft_consensus.cc:697] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:40.829525 23888 raft_consensus.cc:697] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:40.830852 23920 raft_consensus.cc:2804] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.830474 23888 consensus_queue.cc:237] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.831295 23920 raft_consensus.cc:493] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.831888 23920 raft_consensus.cc:3060] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.830372 23892 consensus_queue.cc:237] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.835371 23246 raft_consensus.cc:1275] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:40.836330 23212 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
W20260709 13:08:40.840728 23064 consensus_peers.cc:597] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:40.841434 23064 leader_election.cc:336] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.849792 23923 consensus_queue.cc:1048] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:40.852523 23940 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.855070 23940 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.855216 23920 raft_consensus.cc:515] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:40.855903 23064 leader_election.cc:336] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.857378 23138 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:40.857640 23920 leader_election.cc:290] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.860821 23933 raft_consensus.cc:2804] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.861477 23933 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:08:40.861958 23933 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.862123 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:40.863040 23099 raft_consensus.cc:2393] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 2: Already voted for candidate 62ed7ae0721746edb91c7e53a9dba2ed in this term.
I20260709 13:08:40.860544 23866 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.866881 23941 raft_consensus.cc:2804] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.867519 23941 raft_consensus.cc:697] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:40.868492 23941 consensus_queue.cc:237] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.870640 23928 raft_consensus.cc:515] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.890091 23933 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.892457 23933 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:40.896401 23211 leader_election.cc:304] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:40.897398 23770 raft_consensus.cc:2804] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.897933 23770 raft_consensus.cc:697] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
W20260709 13:08:40.898061 23064 consensus_peers.cc:597] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:40.864240 23934 raft_consensus.cc:515] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:40.876192 23242 raft_consensus.cc:1275] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:40.898873 23770 consensus_queue.cc:237] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:40.874221 23166 raft_consensus.cc:2468] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
W20260709 13:08:40.902047 23138 leader_election.cc:336] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.903697 23138 leader_election.cc:336] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.904382 23138 leader_election.cc:336] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.905033 23138 leader_election.cc:336] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.906004 23923 consensus_queue.cc:1048] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:08:40.909204 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e46155980a493dbdcd5686e8c81fd2" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.909567 23165 raft_consensus.cc:2468] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:40.913103 23934 leader_election.cc:290] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.912983 23063 leader_election.cc:304] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.913861 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217dc40b82664779b71b4261b1337e80" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:40.909895 23242 raft_consensus.cc:3060] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.914388 23934 raft_consensus.cc:2804] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.914556 23245 raft_consensus.cc:3060] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.914989 23934 raft_consensus.cc:697] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:40.915954 23934 consensus_queue.cc:237] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:40.914052 23866 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
W20260709 13:08:40.918985 23064 leader_election.cc:336] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.905407 23138 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
W20260709 13:08:40.924472 23138 leader_election.cc:336] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:40.935650 23138 leader_election.cc:336] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:40.919889 23928 leader_election.cc:290] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:40.926152 23933 raft_consensus.cc:2749] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.975224 23099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:40.975962 23099 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.979039 23242 raft_consensus.cc:2468] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:40.979943 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8054b94be5cf4afabdc62b1cb6550554" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:40.982002 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
W20260709 13:08:40.983515 23064 consensus_peers.cc:597] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.008968 23099 raft_consensus.cc:2468] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:40.985488 23063 leader_election.cc:304] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:40.996057 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:41.010474 23091 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:41.000532 23138 consensus_peers.cc:597] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.012379 23922 raft_consensus.cc:2804] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.013008 23922 raft_consensus.cc:697] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:41.013988 23922 consensus_queue.cc:237] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:41.017841 23245 raft_consensus.cc:2468] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
W20260709 13:08:41.019345 23212 leader_election.cc:336] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:41.020129 23097 raft_consensus.cc:3060] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:41.023182 23064 consensus_peers.cc:597] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.038115 23174 raft_consensus.cc:1275] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.029449 23093 raft_consensus.cc:3060] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:41.046022 23138 leader_election.cc:336] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:41.047010 23138 leader_election.cc:336] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:41.047384 23138 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
W20260709 13:08:41.048310 23138 leader_election.cc:336] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:41.048734 23933 raft_consensus.cc:2749] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:41.053057 23066 leader_election.cc:304] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:41.055123 23245 raft_consensus.cc:1275] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.056651 23926 raft_consensus.cc:2804] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.057312 23926 raft_consensus.cc:697] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:41.058346 23926 consensus_queue.cc:237] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:41.062027 23239 raft_consensus.cc:1275] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.064134 23923 consensus_queue.cc:1048] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:41.064182 23140 leader_election.cc:304] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:41.066128 23892 raft_consensus.cc:2804] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.066820 23892 raft_consensus.cc:697] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:41.068073 23915 consensus_queue.cc:1048] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:41.072494 23138 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:41.083088 23937 raft_consensus.cc:2804] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.083806 23937 raft_consensus.cc:697] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:41.083927 23097 raft_consensus.cc:2468] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 2.
I20260709 13:08:41.078531 23928 consensus_queue.cc:1048] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:08:41.089267 23138 leader_election.cc:336] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:41.089954 23138 leader_election.cc:336] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:41.086972 23937 consensus_queue.cc:237] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:41.093168 23174 raft_consensus.cc:1275] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.086474 22918 catalog_manager.cc:5697] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 2 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.096629 22918 catalog_manager.cc:5697] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 2 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:41.099401 23212 leader_election.cc:336] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:41.101588 23212 leader_election.cc:336] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:41.102721 23212 leader_election.cc:336] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:41.104504 23212 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:41.112721 23908 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:41.109931 23770 raft_consensus.cc:2804] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.116051 23770 raft_consensus.cc:697] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:41.148615 23908 tablet_bootstrap.cc:492] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:41.149654 23908 ts_tablet_manager.cc:1403] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.353s	user 0.040s	sys 0.019s
I20260709 13:08:41.068073 23892 consensus_queue.cc:237] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:41.150760 14293 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:08:41.164798 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 1.382s	user 0.355s	sys 0.013s
I20260709 13:08:41.140439 23915 consensus_queue.cc:1048] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:08:41.204929 23091 raft_consensus.cc:2468] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 2.
I20260709 13:08:41.183678 23770 consensus_queue.cc:237] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:41.222244 22923 catalog_manager.cc:5697] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.224383 22923 catalog_manager.cc:5697] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.226003 22923 catalog_manager.cc:5697] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.227466 22923 catalog_manager.cc:5697] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.235594 23908 raft_consensus.cc:359] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:41.236570 23908 raft_consensus.cc:740] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.237104 22923 catalog_manager.cc:5697] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.237380 23908 consensus_queue.cc:260] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:41.244515 23924 log.cc:927] Time spent T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:41.250000 23212 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:41.255007 23908 ts_tablet_manager.cc:1434] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.001s
I20260709 13:08:41.256434 23908 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:41.254522 22923 catalog_manager.cc:5697] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.272029 22923 catalog_manager.cc:5697] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:41.312320 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 94303.4us
W20260709 13:08:41.320087 23064 consensus_peers.cc:597] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.306924 23920 raft_consensus.cc:2804] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.330073 23920 raft_consensus.cc:697] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:41.324795 23093 raft_consensus.cc:2468] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86f6c62fa9a94b679e852571485aa293 in term 2.
I20260709 13:08:41.348601 23910 raft_consensus.cc:493] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.349318 23910 raft_consensus.cc:515] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:41.351459 23064 consensus_peers.cc:597] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:41.363175 23910 leader_election.cc:290] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
W20260709 13:08:41.367892 23211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 151550us
I20260709 13:08:41.412115 23245 raft_consensus.cc:1275] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.407256 23212 leader_election.cc:304] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e
I20260709 13:08:41.433516 23921 raft_consensus.cc:2804] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.447994 23097 raft_consensus.cc:1275] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 86f6c62fa9a94b679e852571485aa293: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:41.454430 23212 consensus_peers.cc:597] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:41.522466 23753 consensus_queue.cc:1048] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 13:08:41.531216 23944 log.cc:927] Time spent T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:08:41.535898 23916 consensus_queue.cc:1048] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:41.537663 23248 raft_consensus.cc:1275] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.521952 23920 consensus_queue.cc:237] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:41.586877 23910 raft_consensus.cc:493] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.587504 23910 raft_consensus.cc:515] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:41.590926 23170 raft_consensus.cc:1275] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.549197 23919 consensus_queue.cc:1048] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:08:41.611747 23138 consensus_peers.cc:597] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.600378 23910 leader_election.cc:290] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:41.606652 23921 raft_consensus.cc:697] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Becoming Leader. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:41.642354 23246 raft_consensus.cc:1275] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.643584 23910 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.673230 23936 consensus_queue.cc:1048] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:41.676046 23921 consensus_queue.cc:237] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:41.678642 23980 log.cc:927] Time spent T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:08:41.695811 23138 consensus_peers.cc:597] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:41.699780 23979 log.cc:927] Time spent T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:08:41.733094 23064 consensus_peers.cc:597] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:41.731000 23910 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
W20260709 13:08:41.741943 23064 consensus_peers.cc:597] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:41.748534 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 288834us
W20260709 13:08:41.751011 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 157599us
W20260709 13:08:41.751893 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 101591us
W20260709 13:08:41.787295 23212 consensus_peers.cc:597] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:41.801978 23981 log.cc:927] Time spent T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf: Append to log took a long time: real 0.205s	user 0.004s	sys 0.000s
I20260709 13:08:41.762229 23926 consensus_queue.cc:1048] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:08:41.815733 23138 consensus_peers.cc:597] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:41.816602 23138 consensus_peers.cc:597] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.817130 23138 consensus_peers.cc:597] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:41.841708 23908 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:08:41.859609 23064 consensus_peers.cc:597] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.860405 23064 consensus_peers.cc:597] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.862352 23064 consensus_peers.cc:597] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.863080 23064 consensus_peers.cc:597] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.887826 23064 consensus_peers.cc:597] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.893275 23908 tablet_bootstrap.cc:492] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:41.894326 23908 ts_tablet_manager.cc:1403] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.638s	user 0.014s	sys 0.020s
I20260709 13:08:41.895992 23910 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:41.903524 23994 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.921165 24002 log.cc:927] Time spent T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:08:41.923025 23097 raft_consensus.cc:1275] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.927836 23173 raft_consensus.cc:1275] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:41.938097 23908 raft_consensus.cc:359] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:41.938882 23908 raft_consensus.cc:740] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.939630 23908 consensus_queue.cc:260] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:41.945351 23908 ts_tablet_manager.cc:1434] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 13:08:41.931450 23994 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:41.953810 23908 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Bootstrap starting.
W20260709 13:08:41.978762 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 159077us
W20260709 13:08:41.986864 23212 consensus_peers.cc:597] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:41.987742 23212 consensus_peers.cc:597] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:41.992251 23212 consensus_peers.cc:597] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:42.004735 24003 consensus_queue.cc:1048] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:08:42.008078 23910 raft_consensus.cc:493] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.008800 23910 raft_consensus.cc:515] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:42.046139 23910 leader_election.cc:290] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
W20260709 13:08:42.076896 24014 log.cc:927] Time spent T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed: Append to log took a long time: real 0.077s	user 0.001s	sys 0.003s
I20260709 13:08:42.089572 23994 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:42.091310 23908 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:42.092486 23908 tablet_bootstrap.cc:492] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:42.093638 23248 raft_consensus.cc:1275] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:42.093225 23908 ts_tablet_manager.cc:1403] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.145s	user 0.036s	sys 0.006s
I20260709 13:08:42.099121 23908 raft_consensus.cc:359] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:42.099922 23908 raft_consensus.cc:740] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.100781 23908 consensus_queue.cc:260] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
W20260709 13:08:42.102617 23212 consensus_peers.cc:597] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.102977 23908 ts_tablet_manager.cc:1434] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:42.103926 23908 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:42.113005 23174 raft_consensus.cc:1275] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Refusing update from remote peer 86f6c62fa9a94b679e852571485aa293: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:42.115700 23138 consensus_peers.cc:597] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:42.142057 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:42.142268 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:42.141505 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
W20260709 13:08:42.148808 23064 consensus_peers.cc:597] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.149663 23064 consensus_peers.cc:597] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.150287 23064 consensus_peers.cc:597] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:42.155139 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:42.169204 22920 catalog_manager.cc:5697] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.171221 22920 catalog_manager.cc:5697] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.177490 23242 raft_consensus.cc:1275] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:42.185699 23212 consensus_peers.cc:597] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:42.186745 23212 consensus_peers.cc:597] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.187290 23212 consensus_peers.cc:597] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.187981 23212 consensus_peers.cc:597] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.204262 23242 raft_consensus.cc:1275] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:42.231436 23753 consensus_queue.cc:1048] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:42.250969 23887 consensus_queue.cc:1048] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:42.252127 23975 consensus_queue.cc:1048] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:42.256197 23967 consensus_queue.cc:1048] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:42.291606 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:42.303295 23908 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:42.306304 23908 tablet_bootstrap.cc:492] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:42.307227 23908 ts_tablet_manager.cc:1403] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.204s	user 0.029s	sys 0.018s
I20260709 13:08:42.307086 23248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
W20260709 13:08:42.310006 23138 consensus_peers.cc:597] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.319689 23240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:42.322361 23908 raft_consensus.cc:359] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:42.323315 23908 raft_consensus.cc:740] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.324049 23905 leader_election.cc:304] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:42.324266 23908 consensus_queue.cc:260] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:42.325496 23994 raft_consensus.cc:2749] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.306954 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:42.327296 23100 raft_consensus.cc:1275] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 86f6c62fa9a94b679e852571485aa293: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:42.327747 23242 raft_consensus.cc:2393] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 2: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
I20260709 13:08:42.328071 23908 ts_tablet_manager.cc:1434] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:08:42.329684 23908 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:42.337342 23926 consensus_queue.cc:1048] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:42.390086 23212 consensus_peers.cc:597] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.390892 23097 raft_consensus.cc:1275] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 86f6c62fa9a94b679e852571485aa293: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:42.390941 23212 consensus_peers.cc:597] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:42.393770 22918 catalog_manager.cc:5697] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 2 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.400995 22918 catalog_manager.cc:5697] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 2 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:42.463393 24024 log.cc:927] Time spent T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:42.426420 23921 consensus_queue.cc:1048] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 13:08:42.484031 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 57174.5us
W20260709 13:08:42.499495 23138 consensus_peers.cc:597] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.500351 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 189776us
I20260709 13:08:42.514726 23918 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.511603 23941 consensus_queue.cc:1048] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:08:42.552819 24032 log.cc:927] Time spent T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:08:42.551358 24031 log.cc:927] Time spent T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:08:42.558372 23918 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:42.594147 23927 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.613798 23927 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:42.616183 23927 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:42.600639 23905 leader_election.cc:304] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:42.628551 23918 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:42.637429 23910 raft_consensus.cc:2749] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.638350 23905 leader_election.cc:304] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:42.652288 23910 raft_consensus.cc:3060] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:42.668829 23908 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:42.682703 23908 tablet_bootstrap.cc:492] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:42.683388 23908 ts_tablet_manager.cc:1403] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.354s	user 0.018s	sys 0.003s
I20260709 13:08:42.687125 23908 raft_consensus.cc:359] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:42.688086 23908 raft_consensus.cc:740] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.689061 23908 consensus_queue.cc:260] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:42.691429 23908 ts_tablet_manager.cc:1434] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:08:42.694789 23908 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Bootstrap starting.
W20260709 13:08:42.700537 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 142506us
W20260709 13:08:42.748319 23064 leader_election.cc:336] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:42.756515 23064 leader_election.cc:336] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:42.758826 22920 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46916 (request call id 89) took 1573 ms. Trace:
I20260709 13:08:42.759289 22920 rpcz_store.cc:276] 0709 13:08:41.185624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.185797 (+   173us) service_pool.cc:224] Handling call
0709 13:08:42.758752 (+1572955us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.347818 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.348715 (+   897us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.348763 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:08:42.348787 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:42.412694 (+ 63907us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.418374 (+  5680us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.418414 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:42.418916 (+   502us) tablet.cc:701] Row locks acquired
0709 13:08:42.418944 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:08:42.419162 (+   218us) write_op.cc:270] Start()
0709 13:08:42.426715 (+  7553us) write_op.cc:276] Timestamp: P: 1783602522419105 usec, L: 0
0709 13:08:42.429958 (+  3243us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.493772 (+ 63814us) log.cc:844] Serialized 928 byte log entry
0709 13:08:42.654709 (+160937us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.659113 (+  4404us) write_op.cc:301] APPLY: starting
0709 13:08:42.659753 (+   640us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.659904 (+   151us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.660008 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:42.660357 (+   349us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:42.660553 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:42.660606 (+    53us) write_op.cc:312] APPLY: finished
0709 13:08:42.660810 (+   204us) log.cc:844] Serialized 28 byte log entry
0709 13:08:42.660985 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.661081 (+    96us) write_op.cc:454] Released schema lock
0709 13:08:42.661126 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:42.661503 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.661535 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65804,"reported_tablets":3,"spinlock_wait_cycles":27904,"child_traces":[["op",{"apply.queue_time_us":1893,"apply.run_cpu_time_us":1851,"apply.run_wall_time_us":2372,"num_ops":2,"prepare.queue_time_us":168814,"prepare.run_cpu_time_us":4399,"prepare.run_wall_time_us":149366,"replication_time_us":224580,"thread_start_us":102043,"threads_started":1}]]}
I20260709 13:08:42.754719 23910 raft_consensus.cc:2749] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.781708 23174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:42.782485 23174 raft_consensus.cc:2468] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:42.783412 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:42.784154 23170 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:42.783469 23094 raft_consensus.cc:1275] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 86f6c62fa9a94b679e852571485aa293: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:42.800806 23138 consensus_peers.cc:597] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.828320 23138 consensus_peers.cc:597] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.830205 23138 consensus_peers.cc:597] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:42.830571 23138 consensus_peers.cc:597] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.831364 23063 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:42.834765 23063 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:42.843286 23918 raft_consensus.cc:2804] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.834932 22923 catalog_manager.cc:5697] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.859963 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:42.861863 24034 consensus_queue.cc:1048] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:42.843781 23918 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.866776 23918 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.846841 22923 catalog_manager.cc:5697] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.844046 23969 raft_consensus.cc:2804] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:42.871351 23212 consensus_peers.cc:597] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.878955 23969 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.891829 23969 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.894091 23918 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:42.879505 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:42.895376 23903 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:42.917680 23910 raft_consensus.cc:2749] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.938795 23903 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:42.940707 23910 raft_consensus.cc:2749] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.944540 23969 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:42.949010 23918 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:42.951510 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:42.952414 23165 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.953394 23969 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
W20260709 13:08:42.957806 23064 leader_election.cc:336] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:42.958402 23064 leader_election.cc:336] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:42.958093 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:42.965919 23166 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.971974 23908 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:42.973097 23908 tablet_bootstrap.cc:492] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:42.975154 23908 ts_tablet_manager.cc:1403] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.282s	user 0.022s	sys 0.014s
I20260709 13:08:42.978874 23908 raft_consensus.cc:359] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:42.979713 23908 raft_consensus.cc:740] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.980635 23908 consensus_queue.cc:260] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:42.984011 23908 ts_tablet_manager.cc:1434] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:42.985123 23908 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:43.017305 23908 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:43.033030 23908 tablet_bootstrap.cc:492] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:43.033839 23908 ts_tablet_manager.cc:1403] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.008s
I20260709 13:08:43.038523 23908 raft_consensus.cc:359] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:43.039496 23908 raft_consensus.cc:740] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.041054 23908 consensus_queue.cc:260] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:43.041718 23910 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.042246 23910 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:43.043418 23908 ts_tablet_manager.cc:1434] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:43.044371 23908 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:43.044399 23910 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:43.046442 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
W20260709 13:08:43.022285 23212 consensus_peers.cc:597] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:43.046644 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:43.001617 22918 catalog_manager.cc:5697] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.049597 23905 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:43.053649 22918 catalog_manager.cc:5697] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.068444 23910 raft_consensus.cc:2749] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:43.075479 22918 catalog_manager.cc:5697] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 reported cstate change: term changed from 1 to 2, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 86f6c62fa9a94b679e852571485aa293 (127.13.245.68). New cstate: current_term: 2 leader_uuid: "86f6c62fa9a94b679e852571485aa293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.030145 23165 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 3.
I20260709 13:08:43.112424 23063 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:43.119987 23969 raft_consensus.cc:2804] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:43.120559 23969 raft_consensus.cc:697] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:43.121515 23969 consensus_queue.cc:237] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:43.098803 23166 raft_consensus.cc:2468] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 3.
I20260709 13:08:43.161983 23063 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e
I20260709 13:08:43.172194 23966 raft_consensus.cc:2804] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:43.172806 23966 raft_consensus.cc:697] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:43.173801 23966 consensus_queue.cc:237] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:43.206650 23908 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:43.217360 23908 tablet_bootstrap.cc:492] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:43.218328 23908 ts_tablet_manager.cc:1403] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.174s	user 0.018s	sys 0.001s
I20260709 13:08:43.263530 23908 raft_consensus.cc:359] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:43.264452 23908 raft_consensus.cc:740] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.267306 23908 consensus_queue.cc:260] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:43.288640 23908 ts_tablet_manager.cc:1434] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:08:43.291028 23908 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Bootstrap starting.
W20260709 13:08:44.319700 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 1.04033e+06us
I20260709 13:08:44.323342 22923 catalog_manager.cc:5697] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 3, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 3 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.338105 23170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36548 (request call id 269) took 1019 ms. Trace:
I20260709 13:08:44.338637 23170 rpcz_store.cc:276] 0709 13:08:43.318615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.318748 (+   133us) service_pool.cc:224] Handling call
0709 13:08:44.337293 (+1018545us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800896498. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:08:44.337550 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.337749 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.337774 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.337816 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:44.337843 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.337910 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.338030 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3994368}
I20260709 13:08:44.350802 24037 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8204df5095446cb973e600aa7696bf)
I20260709 13:08:44.351572 24037 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.356227 24037 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:44.358973 24085 raft_consensus.cc:493] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.359730 24085 raft_consensus.cc:515] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.362284 24085 leader_election.cc:290] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:44.362774 24085 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.363246 24085 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:44.366209 24085 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:44.367566 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.370859 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.371793 23242 raft_consensus.cc:2393] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164704f999554466a68662962540809e in current term 2: Already voted for candidate bb8204df5095446cb973e600aa7696bf in this term.
I20260709 13:08:44.373005 23994 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.373643 23994 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:44.374071 24085 raft_consensus.cc:493] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.374712 24085 raft_consensus.cc:515] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.376405 23994 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:44.377082 24085 leader_election.cc:290] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:44.377203 23994 raft_consensus.cc:493] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.377915 23994 raft_consensus.cc:515] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.381017 23091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.380113 23994 leader_election.cc:290] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:44.383172 23972 raft_consensus.cc:493] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86f6c62fa9a94b679e852571485aa293)
I20260709 13:08:44.383838 23972 raft_consensus.cc:515] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.386221 23972 leader_election.cc:290] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:44.386905 23096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b575cdcb4fac42e984e4dc708fcad605" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.388644 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b575cdcb4fac42e984e4dc708fcad605" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.388913 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.389645 24084 raft_consensus.cc:493] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86f6c62fa9a94b679e852571485aa293)
I20260709 13:08:44.390239 24084 raft_consensus.cc:515] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:44.390760 23905 leader_election.cc:304] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:44.392446 23994 raft_consensus.cc:2749] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.395295 24082 raft_consensus.cc:493] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8204df5095446cb973e600aa7696bf)
I20260709 13:08:44.396111 24082 raft_consensus.cc:515] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:44.398386 24082 leader_election.cc:290] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:44.401836 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.401855 24084 leader_election.cc:290] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:44.409122 24037 raft_consensus.cc:493] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62ed7ae0721746edb91c7e53a9dba2ed)
I20260709 13:08:44.409773 24037 raft_consensus.cc:515] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.412066 24037 leader_election.cc:290] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:44.415473 23097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.418571 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.419268 23166 raft_consensus.cc:2468] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 1.
I20260709 13:08:44.420754 23972 raft_consensus.cc:493] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86f6c62fa9a94b679e852571485aa293)
I20260709 13:08:44.421213 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360366783c4b4b5f91f38c323f304f3a" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.421370 23972 raft_consensus.cc:515] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.422070 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.422833 23166 raft_consensus.cc:2368] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164704f999554466a68662962540809e for earlier term 2. Current term is 3.
I20260709 13:08:44.423380 24037 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 62ed7ae0721746edb91c7e53a9dba2ed)
I20260709 13:08:44.423736 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.428308 23170 raft_consensus.cc:1275] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:44.431486 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e899ea012af5427ca26140b778e6b811" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.433334 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.434731 23902 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:44.435981 24084 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86f6c62fa9a94b679e852571485aa293)
I20260709 13:08:44.436261 23902 leader_election.cc:400] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Vote denied by peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419) with higher term. Message: Invalid argument: T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164704f999554466a68662962540809e for earlier term 2. Current term is 3.
I20260709 13:08:44.436650 23902 leader_election.cc:403] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.436720 24084 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.437768 23902 leader_election.cc:304] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.438927 23918 consensus_queue.cc:1048] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:44.439730 23994 raft_consensus.cc:2804] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:44.440173 23994 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.440529 23994 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.443768 24003 raft_consensus.cc:493] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86f6c62fa9a94b679e852571485aa293)
I20260709 13:08:44.444074 24084 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:44.444381 24003 raft_consensus.cc:515] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.446614 24003 leader_election.cc:290] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:44.424093 23972 leader_election.cc:290] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:44.424067 24037 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.456234 24037 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:44.458060 24085 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.458891 23169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36568 (request call id 301) took 1141 ms. Trace:
I20260709 13:08:44.462941 24087 raft_consensus.cc:2749] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.463416 23212 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111) [suppressed 328 similar messages]
W20260709 13:08:44.466114 22954 debug-util.cc:398] Leaking SignalData structure 0x7b080005d1a0 after lost signal to thread 14296
W20260709 13:08:44.467927 22954 debug-util.cc:398] Leaking SignalData structure 0x7b08000582a0 after lost signal to thread 22957
I20260709 13:08:44.469223 23092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.469816 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19758a128eb4647906943d8a455fea1" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.473788 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161f6ffe19a04f97acb85cc3152a8234" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.480647 24085 raft_consensus.cc:2749] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419) with higher term. Message: Invalid argument: T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164704f999554466a68662962540809e for earlier term 2. Current term is 3.
I20260709 13:08:44.483246 23887 raft_consensus.cc:493] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86f6c62fa9a94b679e852571485aa293)
I20260709 13:08:44.483909 23887 raft_consensus.cc:515] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.492188 23241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.493319 23242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e414b2459e7d4897b74262e9f85a84aa" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.497483 24084 raft_consensus.cc:493] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8204df5095446cb973e600aa7696bf)
I20260709 13:08:44.498052 24084 raft_consensus.cc:515] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.500269 24084 leader_election.cc:290] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:44.501555 23908 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:44.502609 23908 tablet_bootstrap.cc:492] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:44.502462 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e899ea012af5427ca26140b778e6b811" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.503334 23908 ts_tablet_manager.cc:1403] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 1.213s	user 0.027s	sys 0.005s
I20260709 13:08:44.459323 23169 rpcz_store.cc:276] 0709 13:08:43.316970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.318211 (+  1241us) service_pool.cc:224] Handling call
0709 13:08:44.458123 (+1139912us) spinlock_profiling.cc:243] Waited 967 us on lock 0x7b5800896498. stack: 00007fcf78c38343 00007fcf78c38240 00007fcf785c71d4 00007fcf82305304 00007fcf82305299 00007fcf78af2db1 00007fcf78c32b71 00007fcf78c32a22 00007fcf81b4bc09 00007fcf80ca5ee0 00007fcf80d6f0ab 00007fcf80d6f131 00007fcf80d30fc0 00007fcf80d1b929 00007fcf80d1b3d2 00007fcf7a292bd4
0709 13:08:44.458355 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.458537 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.458563 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.458614 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:44.458645 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.458703 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.458808 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223488}
W20260709 13:08:44.504856 22954 debug-util.cc:398] Leaking SignalData structure 0x7b08002368e0 after lost signal to thread 23124
W20260709 13:08:44.510556 22954 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad080 after lost signal to thread 23198
I20260709 13:08:44.510412 23908 raft_consensus.cc:359] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.511219 23908 raft_consensus.cc:740] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
W20260709 13:08:44.505453 14293 thread.cc:641] rpc worker (service pool kudu.consensus.ConsensusService) Time spent creating pthread: real 1.303s	user 0.014s	sys 0.022s
I20260709 13:08:44.486413 23887 leader_election.cc:290] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:44.481519 24085 raft_consensus.cc:493] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.439003 23902 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.511997 23908 consensus_queue.cc:260] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.516018 24085 raft_consensus.cc:515] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.517459 23170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0056709a01f04a2da19e224ab0d378a1" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.539325 23066 leader_election.cc:304] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.523941 23977 raft_consensus.cc:493] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62ed7ae0721746edb91c7e53a9dba2ed)
I20260709 13:08:44.540184 24085 leader_election.cc:290] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:44.540778 24085 raft_consensus.cc:493] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.540525 23977 raft_consensus.cc:515] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:44.541239 24085 raft_consensus.cc:515] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.542733 23977 leader_election.cc:290] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
W20260709 13:08:44.512240 14293 thread.cc:608] rpc worker (service pool kudu.consensus.ConsensusService) Time spent starting thread: real 1.310s	user 0.014s	sys 0.022s
I20260709 13:08:44.525202 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b7fb9731dd45f2a99ae81ca62d6889" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.549834 23240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.533686 23918 raft_consensus.cc:493] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8204df5095446cb973e600aa7696bf)
I20260709 13:08:44.550432 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.550729 23918 raft_consensus.cc:515] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:44.553133 23918 leader_election.cc:290] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:44.543226 24085 leader_election.cc:290] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:44.555783 24085 raft_consensus.cc:3060] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.556005 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.530568 23169 raft_consensus.cc:1275] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:44.559374 24084 consensus_queue.cc:1048] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:44.511976 22954 debug-util.cc:398] Leaking SignalData structure 0x7b08002470a0 after lost signal to thread 23272
I20260709 13:08:44.562978 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56145698faa64689af33cb5ae7097cb1" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.540186 23926 raft_consensus.cc:2749] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.529430 23212 leader_election.cc:336] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:08:44.564972 23212 leader_election.cc:336] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.565367 23212 leader_election.cc:304] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:44.566131 23977 raft_consensus.cc:2749] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.536401 24087 raft_consensus.cc:493] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.567305 23212 leader_election.cc:336] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.567245 24087 raft_consensus.cc:515] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:44.567829 23212 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:44.568588 23977 raft_consensus.cc:2749] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.569974 24087 leader_election.cc:290] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
W20260709 13:08:44.570842 23902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 131932us
I20260709 13:08:44.579810 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02c6bae4c084ae98cc464607f90c24b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.582490 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadbc16bab774234818801bd6d29d63f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.584848 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33472d9d8b514a79b3645d0aa02749c2" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.586894 23902 leader_election.cc:304] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.587420 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a73b5f8f04698bf33b4c6f5ffea8b" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.588377 23902 leader_election.cc:304] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.589321 24095 raft_consensus.cc:2749] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.590090 24095 raft_consensus.cc:2749] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.573077 23908 ts_tablet_manager.cc:1434] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.004s
I20260709 13:08:44.590152 22923 catalog_manager.cc:5697] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 3, leader changed from 164704f999554466a68662962540809e (127.13.245.65) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 3 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.591857 23908 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:44.575722 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56145698faa64689af33cb5ae7097cb1" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.595201 23066 leader_election.cc:304] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.596108 23926 raft_consensus.cc:2749] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.625885 23994 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:44.640852 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 83617.9us
I20260709 13:08:44.642210 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33472d9d8b514a79b3645d0aa02749c2" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.652279 23903 leader_election.cc:304] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.661332 23211 leader_election.cc:304] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.661149 24093 raft_consensus.cc:2749] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.662662 23977 raft_consensus.cc:2749] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:44.664412 23064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 66894.9us
I20260709 13:08:44.664834 23211 leader_election.cc:304] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.666833 23921 raft_consensus.cc:2749] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.682830 23138 leader_election.cc:336] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.683799 23138 leader_election.cc:304] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:44.686703 23936 raft_consensus.cc:2749] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.688012 23994 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:44.688939 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:44.691478 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:44.684060 24093 raft_consensus.cc:493] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.694450 24093 raft_consensus.cc:515] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.697930 23902 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.699746 24093 leader_election.cc:290] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:44.700366 24093 raft_consensus.cc:2749] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.702621 23138 consensus_peers.cc:597] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.703366 23138 leader_election.cc:336] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.704279 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.703801 23138 leader_election.cc:304] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:44.705401 23887 raft_consensus.cc:2749] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.706056 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a6c80cc6f84dbbafe4921c5a9a2bd5" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.707675 23905 leader_election.cc:304] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:44.709136 23994 raft_consensus.cc:2749] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.710232 23138 leader_election.cc:336] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.712020 23138 leader_election.cc:304] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:44.713321 23887 raft_consensus.cc:2749] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.730108 24085 raft_consensus.cc:2749] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.729377 23138 leader_election.cc:336] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.738716 23138 leader_election.cc:304] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8204df5095446cb973e600aa7696bf; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:44.739851 23887 raft_consensus.cc:2749] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.752151 23064 consensus_peers.cc:597] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:44.758833 24085 raft_consensus.cc:493] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.759523 24085 raft_consensus.cc:515] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.763131 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.769347 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d923431752a8412fb70574e65cdb555e" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.777191 23902 leader_election.cc:304] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
W20260709 13:08:44.778177 23064 consensus_peers.cc:597] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:44.778311 23994 raft_consensus.cc:2749] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.779831 23064 leader_election.cc:336] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.780334 23064 leader_election.cc:304] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
W20260709 13:08:44.781428 23064 leader_election.cc:336] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.781951 23064 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:44.782558 24084 raft_consensus.cc:2749] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.784366 23926 raft_consensus.cc:2749] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:44.786914 23064 consensus_peers.cc:597] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.787691 23064 consensus_peers.cc:597] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.788151 23064 leader_election.cc:336] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.771396 24085 leader_election.cc:290] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:44.797621 23064 leader_election.cc:304] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.801455 23926 raft_consensus.cc:2749] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.802657 23064 consensus_peers.cc:597] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:44.803325 23064 consensus_peers.cc:597] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:44.810367 23064 consensus_peers.cc:597] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:44.814200 23908 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:44.814670 24085 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.815250 24085 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:44.817512 24085 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:44.819186 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.821666 23908 tablet_bootstrap.cc:492] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:44.822108 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.825963 23908 ts_tablet_manager.cc:1403] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.234s	user 0.021s	sys 0.010s
I20260709 13:08:44.826650 23902 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.827946 24085 raft_consensus.cc:2749] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.829226 23908 raft_consensus.cc:359] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.830029 23908 raft_consensus.cc:740] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.830936 23908 consensus_queue.cc:260] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:44.834120 23908 ts_tablet_manager.cc:1434] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:44.835029 23908 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Bootstrap starting.
W20260709 13:08:44.845299 23064 consensus_peers.cc:597] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:44.852090 24085 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.852766 24085 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.856187 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.861644 23240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.862687 23908 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:44.863942 23905 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293
I20260709 13:08:44.864249 24085 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:44.869935 23994 raft_consensus.cc:2749] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.870049 24085 raft_consensus.cc:493] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.871519 23908 tablet_bootstrap.cc:492] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:44.870922 24085 raft_consensus.cc:515] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:44.868866 23064 consensus_peers.cc:597] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:44.874825 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.875361 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.877002 23902 leader_election.cc:304] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164704f999554466a68662962540809e; no voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.877949 24093 raft_consensus.cc:2749] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.879106 24085 leader_election.cc:290] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:44.880681 23908 ts_tablet_manager.cc:1403] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.003s
I20260709 13:08:44.885469 23908 raft_consensus.cc:359] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.886665 23908 raft_consensus.cc:740] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.887465 23908 consensus_queue.cc:260] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.889734 23908 ts_tablet_manager.cc:1434] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:08:44.890637 23908 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:44.908128 23866 raft_consensus.cc:493] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 62ed7ae0721746edb91c7e53a9dba2ed)
I20260709 13:08:44.908825 23866 raft_consensus.cc:515] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:44.911150 23866 leader_election.cc:290] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:44.915482 24084 raft_consensus.cc:493] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8204df5095446cb973e600aa7696bf)
I20260709 13:08:44.916131 24084 raft_consensus.cc:515] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:44.919437 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed56e7a911d48c097f25c20e39f2385" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86f6c62fa9a94b679e852571485aa293" is_pre_election: true
I20260709 13:08:44.919946 24084 leader_election.cc:290] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:44.920166 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14623ec43e74ec68cdc611737321081" candidate_uuid: "86f6c62fa9a94b679e852571485aa293" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:44.932309 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed56e7a911d48c097f25c20e39f2385" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:44.935670 23063 leader_election.cc:304] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf
I20260709 13:08:44.936825 23926 raft_consensus.cc:2749] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:44.937711 23212 leader_election.cc:336] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:08:44.938225 23212 leader_election.cc:304] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:44.943765 23947 raft_consensus.cc:2749] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:44.947654 23138 consensus_peers.cc:597] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:44.950732 23064 consensus_peers.cc:597] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:44.960297 23908 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:44.961577 23908 tablet_bootstrap.cc:492] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:44.962332 23908 ts_tablet_manager.cc:1403] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.002s
I20260709 13:08:44.965516 23908 raft_consensus.cc:359] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
W20260709 13:08:44.972860 23064 consensus_peers.cc:597] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:44.974934 23212 consensus_peers.cc:597] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:44.977420 23908 raft_consensus.cc:740] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
W20260709 13:08:44.986532 23064 consensus_peers.cc:597] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:44.988386 23908 consensus_queue.cc:260] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:44.996802 23908 ts_tablet_manager.cc:1434] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:08:44.998353 23908 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.054306 23908 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.059921 23908 tablet_bootstrap.cc:492] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.060839 23908 ts_tablet_manager.cc:1403] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.005s
I20260709 13:08:45.064110 23908 raft_consensus.cc:359] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:45.064931 23908 raft_consensus.cc:740] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.065723 23908 consensus_queue.cc:260] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:45.074066 23908 ts_tablet_manager.cc:1434] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:08:45.075104 23908 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Bootstrap starting.
W20260709 13:08:45.100993 23064 consensus_peers.cc:597] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:45.108495 23064 consensus_peers.cc:597] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:45.120445 23908 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.121683 23908 tablet_bootstrap.cc:492] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.122442 23908 ts_tablet_manager.cc:1403] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.002s
I20260709 13:08:45.125770 23908 raft_consensus.cc:359] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:45.126616 23908 raft_consensus.cc:740] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.127436 23908 consensus_queue.cc:260] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:45.131395 23908 ts_tablet_manager.cc:1434] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:45.132396 23908 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.157953 23908 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.159070 23908 tablet_bootstrap.cc:492] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.159825 23908 ts_tablet_manager.cc:1403] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.006s
I20260709 13:08:45.164587 23908 raft_consensus.cc:359] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:45.165424 23908 raft_consensus.cc:740] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.166476 23908 consensus_queue.cc:260] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:45.169240 23908 ts_tablet_manager.cc:1434] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:08:45.170176 23908 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.191118 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:41281
I20260709 13:08:45.211411 24139 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:41281 every 8 connection(s)
I20260709 13:08:45.242882 23908 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.247246 23908 tablet_bootstrap.cc:492] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.248296 23908 ts_tablet_manager.cc:1403] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.014s
I20260709 13:08:45.251632 23908 raft_consensus.cc:359] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:45.252529 23908 raft_consensus.cc:740] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.253501 23908 consensus_queue.cc:260] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:45.256373 23908 ts_tablet_manager.cc:1434] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:45.257386 23908 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.264086 24110 raft_consensus.cc:3060] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:45.296459 23212 consensus_peers.cc:597] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:45.297346 23212 consensus_peers.cc:597] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:45.311264 24108 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:45.318747 23138 consensus_peers.cc:597] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:45.344617 23212 consensus_peers.cc:597] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:45.366641 23212 consensus_peers.cc:597] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:45.369536 23908 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.370756 23908 tablet_bootstrap.cc:492] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.371486 23908 ts_tablet_manager.cc:1403] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.114s	user 0.033s	sys 0.024s
I20260709 13:08:45.374235 24109 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:45.380005 23064 consensus_peers.cc:597] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:45.381767 23064 consensus_peers.cc:597] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:45.387784 23908 raft_consensus.cc:359] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:45.388711 23908 raft_consensus.cc:740] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.389474 23908 consensus_queue.cc:260] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:45.404500 23908 ts_tablet_manager.cc:1434] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:08:45.413411 23908 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.421557 24143 heartbeater.cc:344] Connected to a master server at 127.13.245.126:41123
I20260709 13:08:45.422322 24143 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:45.424369 24073 raft_consensus.cc:3060] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.431139 24110 raft_consensus.cc:3060] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.439575 24143 heartbeater.cc:507] Master 127.13.245.126:41123 requested a full tablet report, sending...
I20260709 13:08:45.500305 24109 raft_consensus.cc:1240] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Rejecting Update request from peer 62ed7ae0721746edb91c7e53a9dba2ed for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:45.503254 24083 consensus_queue.cc:1059] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.504312 24149 raft_consensus.cc:3055] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:45.504724 24149 raft_consensus.cc:740] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:45.505605 24149 consensus_queue.cc:260] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:45.507093 24149 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:45.513523 23138 consensus_peers.cc:597] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:45.539592 24096 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.555284 24098 raft_consensus.cc:3060] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.562400 23908 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.563987 23908 tablet_bootstrap.cc:492] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Bootstrap complete.
W20260709 13:08:45.563783 23138 consensus_peers.cc:597] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:45.567862 23064 consensus_peers.cc:597] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:45.568919 23908 ts_tablet_manager.cc:1403] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.156s	user 0.029s	sys 0.006s
I20260709 13:08:45.582355 23908 raft_consensus.cc:359] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:45.582983 23908 raft_consensus.cc:740] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.583729 23908 consensus_queue.cc:260] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:45.592651 24109 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.597113 23908 ts_tablet_manager.cc:1434] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:08:45.598891 23908 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.681501 23908 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.682626 23908 tablet_bootstrap.cc:492] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.683391 23908 ts_tablet_manager.cc:1403] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.085s	user 0.027s	sys 0.002s
I20260709 13:08:45.686305 23908 raft_consensus.cc:359] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:45.687022 23908 raft_consensus.cc:740] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.687825 23908 consensus_queue.cc:260] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:45.689751 22918 ts_manager.cc:194] Re-registered known tserver with Master: 164704f999554466a68662962540809e (127.13.245.65:41281)
I20260709 13:08:45.690294 23908 ts_tablet_manager.cc:1434] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:45.693169 23908 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.723694 23908 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.724956 23908 tablet_bootstrap.cc:492] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.725800 23908 ts_tablet_manager.cc:1403] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.004s
I20260709 13:08:45.729096 23908 raft_consensus.cc:359] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:45.729946 23908 raft_consensus.cc:740] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.730919 23908 consensus_queue.cc:260] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:45.733456 23908 ts_tablet_manager.cc:1434] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:45.734382 23908 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.769517 23908 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.770915 23908 tablet_bootstrap.cc:492] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.771764 23908 ts_tablet_manager.cc:1403] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.003s
I20260709 13:08:45.774992 23908 raft_consensus.cc:359] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:45.775879 23908 raft_consensus.cc:740] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.776845 23908 consensus_queue.cc:260] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:45.779424 23908 ts_tablet_manager.cc:1434] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:45.780426 23908 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:45.805411 23908 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.806466 23908 tablet_bootstrap.cc:492] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:45.807238 23908 ts_tablet_manager.cc:1403] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.012s
I20260709 13:08:45.810071 23908 raft_consensus.cc:359] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:45.815198 23908 raft_consensus.cc:740] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.820044 23908 consensus_queue.cc:260] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:45.822321 23908 ts_tablet_manager.cc:1434] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:08:45.823262 23908 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Bootstrap starting.
W20260709 13:08:45.862162 23212 consensus_peers.cc:597] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:45.870029 22918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44290
I20260709 13:08:45.891047 24143 heartbeater.cc:499] Master 127.13.245.126:41123 was elected leader, sending a full tablet report...
W20260709 13:08:45.986328 23138 consensus_peers.cc:597] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:46.020015 23212 consensus_peers.cc:597] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:46.042207 23908 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.043496 23908 tablet_bootstrap.cc:492] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.044332 23908 ts_tablet_manager.cc:1403] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.221s	user 0.034s	sys 0.032s
I20260709 13:08:46.047411 23908 raft_consensus.cc:359] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.059092 23908 raft_consensus.cc:740] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.060313 23908 consensus_queue.cc:260] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.062704 23908 ts_tablet_manager.cc:1434] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:08:46.064090 23908 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Bootstrap starting.
W20260709 13:08:46.088645 23138 consensus_peers.cc:597] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:46.135932 23908 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.137051 23908 tablet_bootstrap.cc:492] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.137919 23908 ts_tablet_manager.cc:1403] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.004s
I20260709 13:08:46.140765 23908 raft_consensus.cc:359] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.141495 23908 raft_consensus.cc:740] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.142184 23908 consensus_queue.cc:260] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.167858 23908 ts_tablet_manager.cc:1434] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:08:46.168960 23908 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.211033 23908 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.212307 23908 tablet_bootstrap.cc:492] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Bootstrap complete.
W20260709 13:08:46.213317 23212 consensus_peers.cc:597] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:46.213373 23908 ts_tablet_manager.cc:1403] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.008s
I20260709 13:08:46.217218 23908 raft_consensus.cc:359] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.217942 23908 raft_consensus.cc:740] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.218688 23908 consensus_queue.cc:260] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.224927 23908 ts_tablet_manager.cc:1434] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:46.225931 23908 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.261373 23908 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.262668 23908 tablet_bootstrap.cc:492] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.263530 23908 ts_tablet_manager.cc:1403] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.000s
I20260709 13:08:46.266868 23908 raft_consensus.cc:359] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.267935 23908 raft_consensus.cc:740] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.268714 23908 consensus_queue.cc:260] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.270753 24096 raft_consensus.cc:3060] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.272478 23908 ts_tablet_manager.cc:1434] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:08:46.273584 23908 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.365757 23908 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.366954 23908 tablet_bootstrap.cc:492] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.367806 23908 ts_tablet_manager.cc:1403] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.013s
I20260709 13:08:46.375066 23908 raft_consensus.cc:359] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.376076 23908 raft_consensus.cc:740] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.376904 23908 consensus_queue.cc:260] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.379748 23908 ts_tablet_manager.cc:1434] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:08:46.381628 23908 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.417338 24157 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62ed7ae0721746edb91c7e53a9dba2ed)
I20260709 13:08:46.418048 24157 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.420384 24157 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:46.423740 24109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e" is_pre_election: true
I20260709 13:08:46.424729 24109 raft_consensus.cc:2393] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf in current term 2: Already voted for candidate 164704f999554466a68662962540809e in this term.
I20260709 13:08:46.425635 24085 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.426141 24085 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.428718 23908 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.428591 23092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:46.429539 23092 raft_consensus.cc:2468] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:46.429915 23908 tablet_bootstrap.cc:492] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.430721 23908 ts_tablet_manager.cc:1403] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.006s
I20260709 13:08:46.432168 23138 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:46.433844 24011 raft_consensus.cc:2804] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:46.433821 23908 raft_consensus.cc:359] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:46.434492 24011 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 62ed7ae0721746edb91c7e53a9dba2ed)
I20260709 13:08:46.434926 24011 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.444154 24085 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:46.434803 23908 raft_consensus.cc:740] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.448340 23908 consensus_queue.cc:260] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:46.450932 23908 ts_tablet_manager.cc:1434] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:08:46.452616 23092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" is_pre_election: true
I20260709 13:08:46.453501 23092 raft_consensus.cc:2468] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:46.458714 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf" is_pre_election: true
I20260709 13:08:46.467298 23908 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.464459 23903 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:46.468936 24085 raft_consensus.cc:2804] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:46.469358 24085 raft_consensus.cc:493] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.469764 24085 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.476666 24011 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.493010 23166 raft_consensus.cc:2468] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:46.503739 24085 raft_consensus.cc:515] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.507012 23092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:46.507725 23092 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.508888 24011 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:46.515972 24085 leader_election.cc:290] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:46.520015 23166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:46.520701 23166 raft_consensus.cc:3060] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.524333 23092 raft_consensus.cc:2468] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:46.528033 24073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "164704f999554466a68662962540809e"
I20260709 13:08:46.528892 24073 raft_consensus.cc:2368] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf for earlier term 2. Current term is 3.
I20260709 13:08:46.530242 23166 raft_consensus.cc:2468] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:46.530484 23908 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.532418 23908 tablet_bootstrap.cc:492] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.533011 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef6a4ccfc2494489563699b0216088" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:46.533226 23908 ts_tablet_manager.cc:1403] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.002s
I20260709 13:08:46.533826 23095 raft_consensus.cc:2368] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf for earlier term 2. Current term is 3.
I20260709 13:08:46.534601 23902 leader_election.cc:304] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:46.537247 23908 raft_consensus.cc:359] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.537976 23908 raft_consensus.cc:740] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.538893 23908 consensus_queue.cc:260] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.540153 24085 raft_consensus.cc:2804] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:46.541469 23908 ts_tablet_manager.cc:1434] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:08:46.543458 23908 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.547757 23138 leader_election.cc:400] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Vote denied by peer 164704f999554466a68662962540809e (127.13.245.65:41281) with higher term. Message: Invalid argument: T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf for earlier term 2. Current term is 3.
I20260709 13:08:46.548213 23138 leader_election.cc:403] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.548863 24011 raft_consensus.cc:2749] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 164704f999554466a68662962540809e (127.13.245.65:41281) with higher term. Message: Invalid argument: T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf for earlier term 2. Current term is 3.
I20260709 13:08:46.550840 23138 leader_election.cc:400] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Vote denied by peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151) with higher term. Message: Invalid argument: T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8204df5095446cb973e600aa7696bf for earlier term 2. Current term is 3.
I20260709 13:08:46.580039 24109 raft_consensus.cc:3060] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.608327 24085 raft_consensus.cc:697] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 3 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:46.612464 24085 consensus_queue.cc:237] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.613157 23908 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.614540 23908 tablet_bootstrap.cc:492] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.615325 23908 ts_tablet_manager.cc:1403] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.072s	user 0.035s	sys 0.024s
I20260709 13:08:46.619513 23908 raft_consensus.cc:359] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:46.620477 23908 raft_consensus.cc:740] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.621531 23908 consensus_queue.cc:260] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:46.627194 23908 ts_tablet_manager.cc:1434] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:08:46.628165 23908 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.652827 22918 catalog_manager.cc:5697] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e reported cstate change: term changed from 1 to 3, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 3 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.677506 24109 raft_consensus.cc:3060] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.686869 23908 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.688333 23908 tablet_bootstrap.cc:492] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.689193 23908 ts_tablet_manager.cc:1403] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.004s
I20260709 13:08:46.692415 23908 raft_consensus.cc:359] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.693274 23908 raft_consensus.cc:740] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.694198 23908 consensus_queue.cc:260] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.696702 23908 ts_tablet_manager.cc:1434] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:46.697876 23908 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.751605 23908 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.752803 23908 tablet_bootstrap.cc:492] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.753623 23908 ts_tablet_manager.cc:1403] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.017s
I20260709 13:08:46.775733 23908 raft_consensus.cc:359] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.776693 23908 raft_consensus.cc:740] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.777644 23908 consensus_queue.cc:260] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:46.779978 23908 ts_tablet_manager.cc:1434] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:08:46.781003 23908 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.785550 24096 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:46.793655 23064 consensus_peers.cc:597] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:46.812558 24109 raft_consensus.cc:3060] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.856367 23908 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.857527 23908 tablet_bootstrap.cc:492] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.858271 23908 ts_tablet_manager.cc:1403] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.004s
I20260709 13:08:46.864714 23908 raft_consensus.cc:359] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.866042 23908 raft_consensus.cc:740] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.866997 23908 consensus_queue.cc:260] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.868578 23908 ts_tablet_manager.cc:1434] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:46.868520 24096 raft_consensus.cc:3060] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.869674 23908 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.929489 23908 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.931669 23908 tablet_bootstrap.cc:492] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.932420 23908 ts_tablet_manager.cc:1403] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.009s
I20260709 13:08:46.935284 23908 raft_consensus.cc:359] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.936064 23908 raft_consensus.cc:740] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.949555 23908 consensus_queue.cc:260] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:46.952037 23908 ts_tablet_manager.cc:1434] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:08:46.952924 23908 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:46.977351 23908 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.978226 23908 tablet_bootstrap.cc:492] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:46.978947 23908 ts_tablet_manager.cc:1403] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 13:08:46.983530 23908 raft_consensus.cc:359] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:46.984261 23908 raft_consensus.cc:740] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.984933 23908 consensus_queue.cc:260] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:46.987104 23908 ts_tablet_manager.cc:1434] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:08:46.988426 23908 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:47.018564 23908 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.019627 23908 tablet_bootstrap.cc:492] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:47.020380 23908 ts_tablet_manager.cc:1403] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.008s
I20260709 13:08:47.023449 24096 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.038172 23908 raft_consensus.cc:359] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:47.038877 23908 raft_consensus.cc:740] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.042214 23908 consensus_queue.cc:260] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:47.044565 23908 ts_tablet_manager.cc:1434] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:08:47.045702 23908 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:47.076659 23908 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.077744 23908 tablet_bootstrap.cc:492] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:47.078516 23908 ts_tablet_manager.cc:1403] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.009s
I20260709 13:08:47.081349 23908 raft_consensus.cc:359] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:47.082038 23908 raft_consensus.cc:740] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.082746 23908 consensus_queue.cc:260] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:47.085155 23908 ts_tablet_manager.cc:1434] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:47.086035 23908 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:47.108116 23092 raft_consensus.cc:1275] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:47.112360 24085 consensus_queue.cc:1048] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.131420 23908 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.133262 23908 tablet_bootstrap.cc:492] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:47.134166 23908 ts_tablet_manager.cc:1403] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.001s
I20260709 13:08:47.137372 23908 raft_consensus.cc:359] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:47.138944 23908 raft_consensus.cc:740] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.140676 23908 consensus_queue.cc:260] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:47.161746 23908 ts_tablet_manager.cc:1434] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 13:08:47.162808 23908 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:47.164881 23173 raft_consensus.cc:1275] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:47.179050 24206 consensus_queue.cc:1048] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:47.200445 23908 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.203709 23908 tablet_bootstrap.cc:492] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:47.204514 23908 ts_tablet_manager.cc:1403] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.013s
I20260709 13:08:47.209798 23908 raft_consensus.cc:359] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:47.210556 23908 raft_consensus.cc:740] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.211277 23908 consensus_queue.cc:260] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } }
I20260709 13:08:47.219365 23908 ts_tablet_manager.cc:1434] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:08:47.226399 23908 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Bootstrap starting.
I20260709 13:08:47.252550 24096 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.274581 24109 raft_consensus.cc:3060] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.277505 23908 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.279295 23908 tablet_bootstrap.cc:492] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Bootstrap complete.
I20260709 13:08:47.280143 23908 ts_tablet_manager.cc:1403] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.019s
I20260709 13:08:47.283926 23908 raft_consensus.cc:359] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:47.284802 23908 raft_consensus.cc:740] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164704f999554466a68662962540809e, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.285727 23908 consensus_queue.cc:260] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:47.288556 23908 ts_tablet_manager.cc:1434] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:08:47.593016 24096 raft_consensus.cc:3060] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:47.793031 23138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:41281, user_credentials={real_user=slave}} blocked reactor thread for 144508us
I20260709 13:08:48.011053 24109 raft_consensus.cc:3060] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:48.107659 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 61138.2us
W20260709 13:08:48.147782 23066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 70274.1us
W20260709 13:08:52.362812 23063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.67:43419, user_credentials={real_user=slave}} blocked reactor thread for 122865us
W20260709 13:08:52.960304 23140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.68:44019, user_credentials={real_user=slave}} blocked reactor thread for 51345.1us
W20260709 13:08:54.332207 23212 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:44151, user_credentials={real_user=slave}} blocked reactor thread for 76192.4us
I20260709 13:08:55.285841 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:55.348874 23093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34744
I20260709 13:08:55.349946 23093 raft_consensus.cc:606] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:55.354023 23093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
mode: GRACEFUL
new_leader_uuid: "bb8204df5095446cb973e600aa7696bf"
 from {username='slave'} at 127.0.0.1:34744
I20260709 13:08:55.354671 23093 raft_consensus.cc:606] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Received request to transfer leadership to TS bb8204df5095446cb973e600aa7696bf
I20260709 13:08:55.357708 23093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76f52067e0764d909423286098ad3c7c"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34744
I20260709 13:08:55.358454 23093 raft_consensus.cc:606] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:55.361446 23093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34744
I20260709 13:08:55.361925 23093 raft_consensus.cc:606] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:55.377786 23239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95cb3974c72b4e05a01a96155e84d50c"
dest_uuid: "86f6c62fa9a94b679e852571485aa293"
mode: GRACEFUL
new_leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:08:55.378338 23239 raft_consensus.cc:606] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Received request to transfer leadership to TS 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:55.381036 23093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34744
I20260709 13:08:55.381560 23093 raft_consensus.cc:606] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:55.402422 23173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318"
dest_uuid: "bb8204df5095446cb973e600aa7696bf"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:08:55.402984 23173 raft_consensus.cc:606] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:55.405700 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:08:55.407966 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:55.445714 24238 raft_consensus.cc:993] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293: : Instructing follower 62ed7ae0721746edb91c7e53a9dba2ed to start an election
I20260709 13:08:55.446420 24230 raft_consensus.cc:1081] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Signalling peer 62ed7ae0721746edb91c7e53a9dba2ed to start an election
I20260709 13:08:55.447723 23093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95cb3974c72b4e05a01a96155e84d50c"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
 from {username='slave'} at 127.0.0.1:38704
I20260709 13:08:55.448167 23093 raft_consensus.cc:493] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.448428 23093 raft_consensus.cc:3060] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.454944 23093 raft_consensus.cc:515] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:55.457342 23093 leader_election.cc:290] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:55.458516 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95cb3974c72b4e05a01a96155e84d50c" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:55.458592 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95cb3974c72b4e05a01a96155e84d50c" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:55.459575 23165 raft_consensus.cc:3060] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.459491 23239 raft_consensus.cc:3055] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.460245 23239 raft_consensus.cc:740] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:55.461082 23239 consensus_queue.cc:260] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:55.462633 23239 raft_consensus.cc:3060] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.469308 23165 raft_consensus.cc:2468] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:55.469494 23239 raft_consensus.cc:2468] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 2.
I20260709 13:08:55.471138 23066 leader_election.cc:304] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:55.472290 24235 raft_consensus.cc:2804] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.472718 24235 raft_consensus.cc:697] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:55.473532 24235 consensus_queue.cc:237] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:55.485019 22922 catalog_manager.cc:5697] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 1 to 2, leader changed from 86f6c62fa9a94b679e852571485aa293 (127.13.245.68) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 2 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.678447 24235 raft_consensus.cc:993] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.679196 24246 raft_consensus.cc:1081] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.681003 24110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35008
I20260709 13:08:55.681787 24110 raft_consensus.cc:493] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.682199 24110 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.682890 24246 raft_consensus.cc:993] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed: : Instructing follower bb8204df5095446cb973e600aa7696bf to start an election
I20260709 13:08:55.683465 24246 raft_consensus.cc:1081] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Signalling peer bb8204df5095446cb973e600aa7696bf to start an election
I20260709 13:08:55.685518 23165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66"
dest_uuid: "bb8204df5095446cb973e600aa7696bf"
 from {username='slave'} at 127.0.0.1:36548
I20260709 13:08:55.686161 23165 raft_consensus.cc:493] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.686502 23165 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.691092 24110 raft_consensus.cc:515] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.694307 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:55.694550 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c24c5fe50b420cb84b427a38c4b550" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:55.695041 23093 raft_consensus.cc:3055] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.695120 23173 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.695396 23093 raft_consensus.cc:740] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:55.696373 23093 consensus_queue.cc:260] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.697522 23093 raft_consensus.cc:3060] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.697499 23165 raft_consensus.cc:515] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:55.701421 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:55.702000 23239 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.703334 23173 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 4.
I20260709 13:08:55.704643 23902 leader_election.cc:304] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:55.705426 24245 raft_consensus.cc:2804] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:55.705492 24110 leader_election.cc:290] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [CANDIDATE]: Term 4 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:55.705578 23093 raft_consensus.cc:2468] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 4.
I20260709 13:08:55.707038 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "bb8204df5095446cb973e600aa7696bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:55.707721 23095 raft_consensus.cc:3055] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.707984 23095 raft_consensus.cc:740] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:55.708784 23095 consensus_queue.cc:260] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:55.709722 23095 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.710100 23239 raft_consensus.cc:2468] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:55.711449 23165 leader_election.cc:290] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:55.711910 23140 leader_election.cc:304] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:55.713120 24233 raft_consensus.cc:2804] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.717772 23095 raft_consensus.cc:2468] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8204df5095446cb973e600aa7696bf in term 2.
I20260709 13:08:55.719147 24233 raft_consensus.cc:697] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Leader. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:55.727875 24245 raft_consensus.cc:697] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 4 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:55.726431 24233 consensus_queue.cc:237] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:55.729239 24245 consensus_queue.cc:237] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.745021 24235 raft_consensus.cc:993] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.744540 22922 catalog_manager.cc:5697] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf reported cstate change: term changed from 1 to 2, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to bb8204df5095446cb973e600aa7696bf (127.13.245.67). New cstate: current_term: 2 leader_uuid: "bb8204df5095446cb973e600aa7696bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.745579 24235 raft_consensus.cc:1081] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.745822 22923 catalog_manager.cc:5697] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e reported cstate change: term changed from 3 to 4, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 4 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.747931 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35008
I20260709 13:08:55.748476 24073 raft_consensus.cc:493] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.748824 24073 raft_consensus.cc:3060] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.757983 24073 raft_consensus.cc:515] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:55.760526 24073 leader_election.cc:290] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:55.761075 23240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:55.761662 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90401217dded44f3bbae100f43bd7c9d" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:55.761778 23240 raft_consensus.cc:3060] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.767845 23095 raft_consensus.cc:3055] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.768400 23095 raft_consensus.cc:740] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:55.769263 23095 consensus_queue.cc:260] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:55.770404 23095 raft_consensus.cc:3060] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.777866 23240 raft_consensus.cc:2468] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:55.780354 24224 raft_consensus.cc:993] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.780674 23905 leader_election.cc:304] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:55.781795 24245 raft_consensus.cc:2804] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.781958 24246 raft_consensus.cc:1081] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.782208 23095 raft_consensus.cc:2468] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:55.782371 24245 raft_consensus.cc:697] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 2 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:55.783529 24245 consensus_queue.cc:237] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:55.785801 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76f52067e0764d909423286098ad3c7c"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35008
I20260709 13:08:55.786434 24073 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.786837 24073 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.794196 24073 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:55.796731 24073 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:55.798898 24258 raft_consensus.cc:993] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.799014 23240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:55.799425 24258 raft_consensus.cc:1081] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.799803 23240 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.800812 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f52067e0764d909423286098ad3c7c" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:55.801460 23095 raft_consensus.cc:3055] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:55.801537 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34994
I20260709 13:08:55.801795 23095 raft_consensus.cc:740] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:55.802115 24073 raft_consensus.cc:493] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.802474 24073 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.802624 23095 consensus_queue.cc:260] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:55.804103 23095 raft_consensus.cc:3060] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.806493 23240 raft_consensus.cc:2468] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:55.807811 23905 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:55.808832 24245 raft_consensus.cc:2804] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:55.809301 24245 raft_consensus.cc:697] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 3 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:55.810294 24245 consensus_queue.cc:237] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:55.812772 23095 raft_consensus.cc:2468] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:55.812374 24073 raft_consensus.cc:515] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.815953 24073 leader_election.cc:290] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:55.816541 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:55.816907 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da902f60c2e24fd5806973f54afb6318" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:55.818166 23093 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.818202 23173 raft_consensus.cc:3055] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:55.818696 23173 raft_consensus.cc:740] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:55.807785 22923 catalog_manager.cc:5697] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e reported cstate change: term changed from 1 to 2, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 2 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.823709 23173 consensus_queue.cc:260] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.825006 23173 raft_consensus.cc:3060] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.826856 23093 raft_consensus.cc:2468] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:55.829727 23903 leader_election.cc:304] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:55.831580 24256 raft_consensus.cc:2804] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:55.833520 24246 raft_consensus.cc:993] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.834136 24224 raft_consensus.cc:1081] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:55.836241 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35008
I20260709 13:08:55.836788 24096 raft_consensus.cc:493] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.837103 24096 raft_consensus.cc:3060] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.843042 23173 raft_consensus.cc:2468] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:55.851430 24096 raft_consensus.cc:515] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.854925 24256 raft_consensus.cc:697] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 3 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:55.856186 24256 consensus_queue.cc:237] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.858177 23240 raft_consensus.cc:1275] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.859809 24246 consensus_queue.cc:1048] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:55.865444 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:55.866114 23093 raft_consensus.cc:3055] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.866443 23093 raft_consensus.cc:740] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:55.867410 23093 consensus_queue.cc:260] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.868696 23093 raft_consensus.cc:3060] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.872633 23165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d68f7978d614f7e9d3dd87066f10091" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:55.864873 24096 leader_election.cc:290] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:55.873541 23165 raft_consensus.cc:3060] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.878171 23093 raft_consensus.cc:2468] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:55.879973 23903 leader_election.cc:304] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:55.881450 24263 raft_consensus.cc:2804] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.882095 24263 raft_consensus.cc:697] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 2 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:55.883234 24263 consensus_queue.cc:237] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:55.885437 23173 raft_consensus.cc:1275] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.887096 24224 consensus_queue.cc:1048] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.898236 23165 raft_consensus.cc:2468] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:55.941430 22923 catalog_manager.cc:5697] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e reported cstate change: term changed from 2 to 3, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 3 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.945775 22923 catalog_manager.cc:5697] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e reported cstate change: term changed from 2 to 3, leader changed from bb8204df5095446cb973e600aa7696bf (127.13.245.67) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 3 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.983913 22923 catalog_manager.cc:5697] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e reported cstate change: term changed from 1 to 2, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 2 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.128373 23093 raft_consensus.cc:1275] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 4 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:56.129773 24256 consensus_queue.cc:1048] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.145236 23169 raft_consensus.cc:1275] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 4 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:56.146685 24263 consensus_queue.cc:1048] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.247071 23169 raft_consensus.cc:1275] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:56.248379 24263 consensus_queue.cc:1048] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.260718 23095 raft_consensus.cc:1275] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:56.263119 24263 consensus_queue.cc:1048] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.263559 23093 raft_consensus.cc:1275] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:56.269323 24263 consensus_queue.cc:1048] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.283200 23239 raft_consensus.cc:1275] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:56.284885 24245 consensus_queue.cc:1048] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.293033 23169 raft_consensus.cc:1275] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:56.294799 24263 consensus_queue.cc:1048] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.312175 23093 raft_consensus.cc:1275] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:56.314030 24233 consensus_queue.cc:1048] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.326224 23094 raft_consensus.cc:1275] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:56.327921 24266 consensus_queue.cc:1048] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:56.335696 23240 raft_consensus.cc:1275] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer bb8204df5095446cb973e600aa7696bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:56.342586 24242 consensus_queue.cc:1048] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:56.407104 23093 raft_consensus.cc:1275] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:56.408921 24263 consensus_queue.cc:1048] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.409207 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.430756 23240 raft_consensus.cc:1275] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:56.433557 24245 consensus_queue.cc:1048] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.477150 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.526960 23240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b"
dest_uuid: "86f6c62fa9a94b679e852571485aa293"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:08:56.527515 23240 raft_consensus.cc:606] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:56.530361 23093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34744
I20260709 13:08:56.530928 23093 raft_consensus.cc:606] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:56.534165 23240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b"
dest_uuid: "86f6c62fa9a94b679e852571485aa293"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:08:56.534793 23240 raft_consensus.cc:606] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:56.537518 23240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24"
dest_uuid: "86f6c62fa9a94b679e852571485aa293"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:08:56.538200 23240 raft_consensus.cc:606] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:56.540789 23173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f"
dest_uuid: "bb8204df5095446cb973e600aa7696bf"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:08:56.541308 23173 raft_consensus.cc:606] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:56.544184 23093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34744
I20260709 13:08:56.544703 23093 raft_consensus.cc:606] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:56.545674 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:56.547298 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:56.656205 24230 raft_consensus.cc:993] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.658385 24230 raft_consensus.cc:1081] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.660370 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35004
I20260709 13:08:56.661118 24073 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.661516 24073 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.668308 24073 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:56.670215 24073 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:56.671123 23240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:56.671532 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351248e1da24069a4599e9fdc8b3e6b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:56.671814 23240 raft_consensus.cc:3055] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:56.672201 23240 raft_consensus.cc:740] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:56.672199 23093 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.673210 23240 consensus_queue.cc:260] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:56.674491 23240 raft_consensus.cc:3060] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.680248 23093 raft_consensus.cc:2468] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:56.681566 23903 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:56.682490 24266 raft_consensus.cc:2804] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:56.682861 23240 raft_consensus.cc:2468] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:56.682895 24266 raft_consensus.cc:697] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 3 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:56.684894 24266 consensus_queue.cc:237] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:56.695998 22918 catalog_manager.cc:5697] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e reported cstate change: term changed from 2 to 3, leader changed from 86f6c62fa9a94b679e852571485aa293 (127.13.245.68) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 3 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.800800 24238 raft_consensus.cc:993] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.801450 24241 raft_consensus.cc:1081] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.802906 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35004
I20260709 13:08:56.803511 24073 raft_consensus.cc:493] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.803884 24073 raft_consensus.cc:3060] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.811764 24073 raft_consensus.cc:515] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:56.814698 24073 leader_election.cc:290] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:56.815277 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:56.815985 23239 raft_consensus.cc:3055] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:56.816298 23239 raft_consensus.cc:740] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:56.817070 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7798deb16e0346c697b7b8e23415d63b" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:56.817714 23093 raft_consensus.cc:3060] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.817109 23239 consensus_queue.cc:260] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:56.819279 23239 raft_consensus.cc:3060] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.823519 23093 raft_consensus.cc:2468] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:56.824877 23239 raft_consensus.cc:2468] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:56.824750 23903 leader_election.cc:304] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:56.825840 24266 raft_consensus.cc:2804] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:56.826323 24266 raft_consensus.cc:697] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 2 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:56.827256 24266 consensus_queue.cc:237] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:56.840886 22918 catalog_manager.cc:5697] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e reported cstate change: term changed from 1 to 2, leader changed from 86f6c62fa9a94b679e852571485aa293 (127.13.245.68) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 2 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.884395 24246 raft_consensus.cc:993] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.884894 24224 raft_consensus.cc:1081] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.886353 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35008
I20260709 13:08:56.886844 24073 raft_consensus.cc:493] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.887183 24073 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.895243 24073 raft_consensus.cc:515] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:56.898437 24238 raft_consensus.cc:993] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.899148 24241 raft_consensus.cc:1081] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.900650 24073 leader_election.cc:290] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:56.900681 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35004
I20260709 13:08:56.901432 24096 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.901324 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:56.901681 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e95d2f411234daa8343913c7fd7da28" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:56.901911 24096 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.902056 23093 raft_consensus.cc:3055] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:56.902323 23169 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.902467 23093 raft_consensus.cc:740] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:56.903563 23093 consensus_queue.cc:260] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:56.904847 23093 raft_consensus.cc:3060] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.910773 23169 raft_consensus.cc:2468] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:56.911929 23902 leader_election.cc:304] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, bb8204df5095446cb973e600aa7696bf; no voters: 
I20260709 13:08:56.913259 24256 raft_consensus.cc:2804] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:56.913760 24256 raft_consensus.cc:697] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 3 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:56.914721 24256 consensus_queue.cc:237] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:56.919130 23093 raft_consensus.cc:2468] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:56.927043 24096 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:56.927927 22918 catalog_manager.cc:5697] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e reported cstate change: term changed from 2 to 3, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 3 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.948642 24096 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:56.949734 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:56.950253 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc9b7bc403743f781fa69a6b3b60b24" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:56.950467 23093 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.950919 23239 raft_consensus.cc:3055] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:56.951270 23239 raft_consensus.cc:740] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:56.952070 23239 consensus_queue.cc:260] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:56.953132 23239 raft_consensus.cc:3060] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.956596 23093 raft_consensus.cc:2468] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:56.958377 23903 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:56.959200 24256 raft_consensus.cc:2804] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:56.959682 24256 raft_consensus.cc:697] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 3 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:56.960419 24224 raft_consensus.cc:993] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.960901 24224 raft_consensus.cc:1081] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.960568 24256 consensus_queue.cc:237] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:56.964227 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35008
I20260709 13:08:56.964787 24073 raft_consensus.cc:493] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.965148 24073 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.968717 23239 raft_consensus.cc:2468] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:56.972630 24073 raft_consensus.cc:515] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:56.976116 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:56.976251 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f061f1bc80274cada8b20297e47bd6f3" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:56.976707 23169 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.976881 23095 raft_consensus.cc:3055] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:56.977310 23095 raft_consensus.cc:740] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:56.978071 23095 consensus_queue.cc:260] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:56.979209 23095 raft_consensus.cc:3060] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.982610 22918 catalog_manager.cc:5697] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e reported cstate change: term changed from 2 to 3, leader changed from 86f6c62fa9a94b679e852571485aa293 (127.13.245.68) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 3 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.986677 23095 raft_consensus.cc:2468] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 4.
I20260709 13:08:56.987231 24073 leader_election.cc:290] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 4 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:56.988134 23169 raft_consensus.cc:2468] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 4.
I20260709 13:08:56.987947 23903 leader_election.cc:304] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:56.989647 24256 raft_consensus.cc:2804] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:56.990352 24256 raft_consensus.cc:697] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 4 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:56.991271 24256 consensus_queue.cc:237] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:56.998293 24284 raft_consensus.cc:993] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:56.999692 24284 raft_consensus.cc:1081] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:57.003731 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34994
I20260709 13:08:57.004313 24073 raft_consensus.cc:493] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.004724 24073 raft_consensus.cc:3060] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.016708 22918 catalog_manager.cc:5697] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e reported cstate change: term changed from 3 to 4, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 4 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.021303 24073 raft_consensus.cc:515] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:57.023527 24073 leader_election.cc:290] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Requested vote from peers 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151), bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419)
I20260709 13:08:57.025840 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:57.025887 23169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddaae9615745fc941db7ae1a92044f" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:57.026459 23095 raft_consensus.cc:3060] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.026566 23169 raft_consensus.cc:3055] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:57.027056 23169 raft_consensus.cc:740] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:57.027886 23169 consensus_queue.cc:260] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:57.030095 23169 raft_consensus.cc:3060] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.033077 23095 raft_consensus.cc:2468] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:57.035077 23903 leader_election.cc:304] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:57.037274 24256 raft_consensus.cc:2804] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:57.037961 24256 raft_consensus.cc:697] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 2 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:57.038589 23169 raft_consensus.cc:2468] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:57.039973 24256 consensus_queue.cc:237] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } }
I20260709 13:08:57.056037 22918 catalog_manager.cc:5697] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e reported cstate change: term changed from 1 to 2, leader changed from bb8204df5095446cb973e600aa7696bf (127.13.245.67) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 2 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.091356 23239 raft_consensus.cc:1275] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.092885 24256 consensus_queue.cc:1048] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.128703 23095 raft_consensus.cc:1275] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.131572 24266 consensus_queue.cc:1048] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:57.251397 23095 raft_consensus.cc:1275] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:57.252833 24266 consensus_queue.cc:1048] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:57.269586 23240 raft_consensus.cc:1275] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:57.273208 24245 consensus_queue.cc:1048] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:57.380458 23095 raft_consensus.cc:1275] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.381974 24245 consensus_queue.cc:1048] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.392802 23173 raft_consensus.cc:1275] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.394807 24256 consensus_queue.cc:1048] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.412279 23093 raft_consensus.cc:1275] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 4 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:57.417230 24307 consensus_queue.cc:1048] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:57.432449 23173 raft_consensus.cc:1275] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 4 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:57.434432 24307 consensus_queue.cc:1048] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.448536 23093 raft_consensus.cc:1275] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.452795 24245 consensus_queue.cc:1048] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.456099 23095 raft_consensus.cc:1275] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:57.457998 24307 consensus_queue.cc:1048] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:57.471692 23165 raft_consensus.cc:1275] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:57.481950 24266 consensus_queue.cc:1048] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:57.497959 23239 raft_consensus.cc:1275] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.500377 24256 consensus_queue.cc:1048] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.548544 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:57.598024 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:57.644204 23165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66"
dest_uuid: "bb8204df5095446cb973e600aa7696bf"
mode: GRACEFUL
new_leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:08:57.644855 23165 raft_consensus.cc:606] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Received request to transfer leadership to TS 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:08:57.647441 23239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9"
dest_uuid: "86f6c62fa9a94b679e852571485aa293"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:08:57.648025 23239 raft_consensus.cc:606] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:57.649152 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:57.650561 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:57.792546 24292 raft_consensus.cc:993] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf: : Instructing follower 62ed7ae0721746edb91c7e53a9dba2ed to start an election
I20260709 13:08:57.793277 24284 raft_consensus.cc:1081] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Signalling peer 62ed7ae0721746edb91c7e53a9dba2ed to start an election
I20260709 13:08:57.795302 23092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
 from {username='slave'} at 127.0.0.1:38706
I20260709 13:08:57.796097 23092 raft_consensus.cc:493] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.796523 23092 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.799755 24241 raft_consensus.cc:993] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:57.800590 24230 raft_consensus.cc:1081] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:57.802317 24073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35004
I20260709 13:08:57.802925 24073 raft_consensus.cc:493] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.803267 24073 raft_consensus.cc:3060] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.808772 23092 raft_consensus.cc:515] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:57.810525 24073 raft_consensus.cc:515] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:57.812040 23092 leader_election.cc:290] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 election: Requested vote from peers bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419), 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019)
I20260709 13:08:57.816495 24073 leader_election.cc:290] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:57.816838 23239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:57.817559 23239 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.819871 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:57.820531 23243 raft_consensus.cc:3055] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:57.820887 23243 raft_consensus.cc:740] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86f6c62fa9a94b679e852571485aa293, State: Running, Role: LEADER
I20260709 13:08:57.821692 23243 consensus_queue.cc:260] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:57.822921 23092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91ac3261d049d1ab7aaa70e0c081e9" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:57.820436 23173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac7fd6cff4fa3ae2823a5c93a8c66" candidate_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8204df5095446cb973e600aa7696bf"
I20260709 13:08:57.824038 23173 raft_consensus.cc:3055] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:57.824373 23173 raft_consensus.cc:740] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb8204df5095446cb973e600aa7696bf, State: Running, Role: LEADER
I20260709 13:08:57.824787 23243 raft_consensus.cc:3060] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.823793 23092 raft_consensus.cc:3060] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.825178 23173 consensus_queue.cc:260] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:57.826570 23173 raft_consensus.cc:3060] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.837739 23239 raft_consensus.cc:2468] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 3.
I20260709 13:08:57.838112 23243 raft_consensus.cc:2468] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:57.838557 23092 raft_consensus.cc:2468] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 2.
I20260709 13:08:57.841135 23066 leader_election.cc:304] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62ed7ae0721746edb91c7e53a9dba2ed, 86f6c62fa9a94b679e852571485aa293; no voters: 
I20260709 13:08:57.841537 23903 leader_election.cc:304] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:57.842073 24246 raft_consensus.cc:2804] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:57.842659 24246 raft_consensus.cc:697] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Becoming Leader. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:57.842684 24245 raft_consensus.cc:2804] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:57.843782 24245 raft_consensus.cc:697] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 2 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:57.843956 24246 consensus_queue.cc:237] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:08:57.844906 24245 consensus_queue.cc:237] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:57.846495 23173 raft_consensus.cc:2468] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62ed7ae0721746edb91c7e53a9dba2ed in term 3.
I20260709 13:08:57.867935 22923 catalog_manager.cc:5697] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed reported cstate change: term changed from 2 to 3, leader changed from bb8204df5095446cb973e600aa7696bf (127.13.245.67) to 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66). New cstate: current_term: 3 leader_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.869966 22918 catalog_manager.cc:5697] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e reported cstate change: term changed from 1 to 2, leader changed from 86f6c62fa9a94b679e852571485aa293 (127.13.245.68) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 2 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.258500 23173 raft_consensus.cc:1275] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:58.262427 23095 raft_consensus.cc:1275] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:58.263317 24328 consensus_queue.cc:1048] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8204df5095446cb973e600aa7696bf" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:58.265568 24256 consensus_queue.cc:1048] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:58.272140 23247 raft_consensus.cc:1275] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Refusing update from remote peer 62ed7ae0721746edb91c7e53a9dba2ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:58.275813 24330 consensus_queue.cc:1048] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:58.292279 23240 raft_consensus.cc:1275] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:58.302167 24266 consensus_queue.cc:1048] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:58.651859 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:58.711344 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:58.750543 23093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7c80de33300430e9f3578384080ff53"
dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
mode: GRACEFUL
new_leader_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:34744
I20260709 13:08:58.751466 23093 raft_consensus.cc:606] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Received request to transfer leadership to TS 164704f999554466a68662962540809e
I20260709 13:08:58.753005 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:58.754573 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:58.787117 24331 raft_consensus.cc:993] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed: : Instructing follower 164704f999554466a68662962540809e to start an election
I20260709 13:08:58.787925 24331 raft_consensus.cc:1081] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Signalling peer 164704f999554466a68662962540809e to start an election
I20260709 13:08:58.789740 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7c80de33300430e9f3578384080ff53"
dest_uuid: "164704f999554466a68662962540809e"
 from {username='slave'} at 127.0.0.1:35008
I20260709 13:08:58.790513 24096 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.790908 24096 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.799124 24096 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:58.801256 24096 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Requested vote from peers 86f6c62fa9a94b679e852571485aa293 (127.13.245.68:44019), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:08:58.802280 23243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86f6c62fa9a94b679e852571485aa293"
I20260709 13:08:58.802771 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c80de33300430e9f3578384080ff53" candidate_uuid: "164704f999554466a68662962540809e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62ed7ae0721746edb91c7e53a9dba2ed"
I20260709 13:08:58.803112 23243 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.803421 23095 raft_consensus.cc:3055] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.803764 23095 raft_consensus.cc:740] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 62ed7ae0721746edb91c7e53a9dba2ed, State: Running, Role: LEADER
I20260709 13:08:58.804792 23095 consensus_queue.cc:260] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:58.806322 23095 raft_consensus.cc:3060] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.814754 23095 raft_consensus.cc:2468] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:58.814774 23243 raft_consensus.cc:2468] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164704f999554466a68662962540809e in term 3.
I20260709 13:08:58.816689 23903 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed; no voters: 
I20260709 13:08:58.817605 24266 raft_consensus.cc:2804] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.818156 24266 raft_consensus.cc:697] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 3 LEADER]: Becoming Leader. State: Replica: 164704f999554466a68662962540809e, State: Running, Role: LEADER
I20260709 13:08:58.819268 24266 consensus_queue.cc:237] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:08:58.832084 22920 catalog_manager.cc:5697] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e reported cstate change: term changed from 2 to 3, leader changed from 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66) to 164704f999554466a68662962540809e (127.13.245.65). New cstate: current_term: 3 leader_uuid: "164704f999554466a68662962540809e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.330345 23095 raft_consensus.cc:1275] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:59.331805 24245 consensus_queue.cc:1048] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:59.352288 23240 raft_consensus.cc:1275] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Refusing update from remote peer 164704f999554466a68662962540809e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:59.358664 24349 consensus_queue.cc:1048] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:59.755690 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:59.796344 14293 tablet_server.cc:179] TabletServer@127.13.245.65:41281 shutting down...
W20260709 13:08:59.813689 23138 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 92 similar messages]
W20260709 13:08:59.828007 23138 consensus_peers.cc:597] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.829027 23138 consensus_peers.cc:597] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.843436 23212 consensus_peers.cc:597] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.843657 23138 consensus_peers.cc:597] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.854346 23212 consensus_peers.cc:597] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.860903 23138 consensus_peers.cc:597] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.861666 23064 consensus_peers.cc:597] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.864286 23064 consensus_peers.cc:597] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.864916 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:59.865972 14293 tablet_replica.cc:333] stopping tablet replica
W20260709 13:08:59.866683 23138 consensus_peers.cc:597] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.867298 14293 raft_consensus.cc:2243] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:08:59.868578 23903 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.870579 14293 raft_consensus.cc:2272] T 9cddaae9615745fc941db7ae1a92044f P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.874352 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.875209 14293 raft_consensus.cc:2243] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.875828 14293 raft_consensus.cc:2272] T e19758a128eb4647906943d8a455fea1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:59.876443 23064 consensus_peers.cc:597] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.878823 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.880051 14293 raft_consensus.cc:2243] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.880888 14293 raft_consensus.cc:2272] T 36e46155980a493dbdcd5686e8c81fd2 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.884419 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.885413 14293 raft_consensus.cc:2243] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.886122 14293 raft_consensus.cc:2272] T 41361b7bb5d44f2ba006fb10f2c275d8 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.889719 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.890887 14293 raft_consensus.cc:2243] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.891636 14293 raft_consensus.cc:2272] T b0c538e12e094914a765975898fe54e1 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.895736 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.897034 14293 raft_consensus.cc:2243] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.897722 14293 raft_consensus.cc:2272] T c068aa5e483f41e783c5498945e63250 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.901877 14293 tablet_replica.cc:333] stopping tablet replica
W20260709 13:08:59.901805 23064 consensus_peers.cc:597] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.903435 14293 raft_consensus.cc:2243] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:59.905332 14293 raft_consensus.cc:2272] T c8c24c5fe50b420cb84b427a38c4b550 P 164704f999554466a68662962540809e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.908717 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.909814 14293 raft_consensus.cc:2243] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.910480 14293 raft_consensus.cc:2272] T 990e32f21d80459799b74a21dfa0be97 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.913672 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.914340 14293 raft_consensus.cc:2243] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.914898 14293 raft_consensus.cc:2272] T d338f57c69b44220a6c31510e829a8f6 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.918005 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.918994 14293 raft_consensus.cc:2243] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:59.919950 14293 raft_consensus.cc:2272] T 1351248e1da24069a4599e9fdc8b3e6b P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.923509 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.924669 14293 raft_consensus.cc:2243] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.925292 14293 raft_consensus.cc:2272] T 08e6c94513d545df957ae3d6c984123b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.928795 14293 tablet_replica.cc:333] stopping tablet replica
W20260709 13:08:59.928987 23064 consensus_peers.cc:597] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.929873 14293 raft_consensus.cc:2243] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.930768 14293 raft_consensus.cc:2272] T e414b2459e7d4897b74262e9f85a84aa P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.934257 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.935030 14293 raft_consensus.cc:2243] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.935701 14293 raft_consensus.cc:2272] T 217dc40b82664779b71b4261b1337e80 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.938639 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.939483 14293 raft_consensus.cc:2243] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.940056 14293 raft_consensus.cc:2272] T 43a804057f5f4d50bb94ce2f719a663a P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.943493 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.944190 14293 raft_consensus.cc:2243] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.944728 14293 raft_consensus.cc:2272] T ca470edbc9134307a2189c750afa9f07 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.947845 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.948941 14293 raft_consensus.cc:2243] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.949645 14293 raft_consensus.cc:2272] T 161f6ffe19a04f97acb85cc3152a8234 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.953284 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.954494 14293 raft_consensus.cc:2243] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:59.955943 14293 raft_consensus.cc:2272] T 0d68f7978d614f7e9d3dd87066f10091 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:59.956740 23138 consensus_peers.cc:597] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.960286 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.961778 14293 raft_consensus.cc:2243] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:59.965215 14293 raft_consensus.cc:2272] T 76f52067e0764d909423286098ad3c7c P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:59.967639 23212 consensus_peers.cc:597] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.969354 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.970453 14293 raft_consensus.cc:2243] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.971418 14293 raft_consensus.cc:2272] T f02c6bae4c084ae98cc464607f90c24b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.974261 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.974922 14293 raft_consensus.cc:2243] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.975493 14293 raft_consensus.cc:2272] T dc4702f1cac747e4bb14d663d83e58ca P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.979278 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.980330 14293 raft_consensus.cc:2243] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.981014 14293 raft_consensus.cc:2272] T 6248ccc292244da38810b46798b3843f P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.984092 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.984781 14293 raft_consensus.cc:2243] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.985271 14293 raft_consensus.cc:2272] T 33472d9d8b514a79b3645d0aa02749c2 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.989687 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.990777 14293 raft_consensus.cc:2243] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:59.991319 14293 raft_consensus.cc:2272] T 2433c50320714f4288969a94d5e1bf12 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:59.994233 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:59.995038 14293 raft_consensus.cc:2243] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:59.996445 14293 raft_consensus.cc:2272] T 6e95d2f411234daa8343913c7fd7da28 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:59.999779 23064 consensus_peers.cc:597] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.000309 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.001128 14293 raft_consensus.cc:2243] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.001700 14293 raft_consensus.cc:2272] T 360366783c4b4b5f91f38c323f304f3a P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.006112 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.006959 14293 raft_consensus.cc:2243] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.008412 14293 raft_consensus.cc:2272] T 8fc9b7bc403743f781fa69a6b3b60b24 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.011858 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.012514 14293 raft_consensus.cc:2243] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.013104 14293 raft_consensus.cc:2272] T a14623ec43e74ec68cdc611737321081 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.016182 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.017112 14293 raft_consensus.cc:2243] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.018478 14293 raft_consensus.cc:2272] T 90401217dded44f3bbae100f43bd7c9d P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.022341 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.023877 14293 raft_consensus.cc:2243] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:00.024132 23064 consensus_peers.cc:597] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.024552 14293 raft_consensus.cc:2272] T 8054b94be5cf4afabdc62b1cb6550554 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:00.028018 23064 consensus_peers.cc:597] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.028481 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.029227 14293 raft_consensus.cc:2243] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.029716 14293 raft_consensus.cc:2272] T be29e709cce745f3b2421a0de2d75730 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.032792 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.033401 14293 raft_consensus.cc:2243] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.034014 14293 raft_consensus.cc:2272] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.036693 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.037352 14293 raft_consensus.cc:2243] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.037813 14293 raft_consensus.cc:2272] T 0056709a01f04a2da19e224ab0d378a1 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.040874 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.041541 14293 raft_consensus.cc:2243] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.042075 14293 raft_consensus.cc:2272] T dadbc16bab774234818801bd6d29d63f P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.045217 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.046162 14293 raft_consensus.cc:2243] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.047022 14293 raft_consensus.cc:2272] T 820d0fdc714544b1bb07aacd6c176a0b P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.050544 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.051596 14293 raft_consensus.cc:2243] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.052196 14293 raft_consensus.cc:2272] T d923431752a8412fb70574e65cdb555e P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.055225 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.056134 14293 raft_consensus.cc:2243] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.057284 14293 raft_consensus.cc:2272] T 33ef6a4ccfc2494489563699b0216088 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.060320 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.061045 14293 raft_consensus.cc:2243] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.062233 14293 raft_consensus.cc:2272] T 7798deb16e0346c697b7b8e23415d63b P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.065085 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.065761 14293 raft_consensus.cc:2243] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.066231 14293 raft_consensus.cc:2272] T 7630566d5f604f289dbfa8aae3cabf2f P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.068593 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.069259 14293 raft_consensus.cc:2243] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.070242 14293 raft_consensus.cc:2272] T dc91ac3261d049d1ab7aaa70e0c081e9 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.073822 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.074750 14293 raft_consensus.cc:2243] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:09:00.074831 23212 consensus_peers.cc:597] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.076013 14293 raft_consensus.cc:2272] T da902f60c2e24fd5806973f54afb6318 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.079007 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.079847 14293 raft_consensus.cc:2243] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.080793 14293 raft_consensus.cc:2272] T d7c80de33300430e9f3578384080ff53 P 164704f999554466a68662962540809e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.085297 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.086483 14293 raft_consensus.cc:2243] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.087232 14293 raft_consensus.cc:2272] T b575cdcb4fac42e984e4dc708fcad605 P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.090425 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.091089 14293 raft_consensus.cc:2243] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.092394 14293 raft_consensus.cc:2272] T f061f1bc80274cada8b20297e47bd6f3 P 164704f999554466a68662962540809e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.095613 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.096230 14293 raft_consensus.cc:2243] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.096758 14293 raft_consensus.cc:2272] T 98752a0b59b54debad030db8c47b501d P 164704f999554466a68662962540809e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.099203 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:00.099877 14293 raft_consensus.cc:2243] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.100389 14293 raft_consensus.cc:2272] T 40b7fb9731dd45f2a99ae81ca62d6889 P 164704f999554466a68662962540809e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:00.108304 23212 consensus_peers.cc:597] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.109117 23212 consensus_peers.cc:597] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.112175 23064 consensus_peers.cc:597] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.114116 23138 consensus_peers.cc:597] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.119175 23064 consensus_peers.cc:597] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.119937 23138 consensus_peers.cc:597] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.129845 23138 consensus_peers.cc:597] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.144459 23212 consensus_peers.cc:597] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.145391 23212 consensus_peers.cc:597] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.189385 14293 tablet_server.cc:196] TabletServer@127.13.245.65:41281 shutdown complete.
W20260709 13:09:00.257632 23138 consensus_peers.cc:597] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.290632 23212 consensus_peers.cc:597] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.310339 14293 tablet_server.cc:179] TabletServer@127.13.245.66:0 shutting down...
W20260709 13:09:00.320143 23138 consensus_peers.cc:597] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.331759 23138 consensus_peers.cc:597] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.378867 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:00.380225 14293 tablet_replica.cc:333] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.381927 14293 raft_consensus.cc:2243] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.384019 14293 raft_consensus.cc:2272] T 08e6c94513d545df957ae3d6c984123b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.387893 14293 tablet_replica.cc:333] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.389084 14293 raft_consensus.cc:2243] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.389788 14293 raft_consensus.cc:2272] T 1351248e1da24069a4599e9fdc8b3e6b P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.394553 14293 tablet_replica.cc:333] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.395738 14293 raft_consensus.cc:2243] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.398469 14293 raft_consensus.cc:2272] T 990e32f21d80459799b74a21dfa0be97 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.402098 14293 tablet_replica.cc:333] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.403208 14293 raft_consensus.cc:2243] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.403950 14293 raft_consensus.cc:2272] T c8c24c5fe50b420cb84b427a38c4b550 P 62ed7ae0721746edb91c7e53a9dba2ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.407384 14293 tablet_replica.cc:333] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.408385 14293 raft_consensus.cc:2243] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.408991 14293 raft_consensus.cc:2272] T 7c383c2bf6b74c63a4d6713bf94c339c P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.412232 14293 tablet_replica.cc:333] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.412926 14293 raft_consensus.cc:2243] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.415819 14293 raft_consensus.cc:2272] T 98752a0b59b54debad030db8c47b501d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.419592 14293 tablet_replica.cc:333] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.420588 14293 raft_consensus.cc:2243] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.421818 14293 raft_consensus.cc:2272] T adbc01cc61ed4eaab25d8cb87f61bdba P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.425097 14293 tablet_replica.cc:333] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.426172 14293 raft_consensus.cc:2243] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.427222 14293 raft_consensus.cc:2272] T d338f57c69b44220a6c31510e829a8f6 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:00.428977 23212 consensus_peers.cc:597] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 -> Peer 164704f999554466a68662962540809e (127.13.245.65:41281): Couldn't send request to peer 164704f999554466a68662962540809e. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.430929 14293 tablet_replica.cc:333] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.432091 14293 raft_consensus.cc:2243] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.433352 14293 raft_consensus.cc:2272] T 6248ccc292244da38810b46798b3843f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.436406 14293 tablet_replica.cc:333] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.437245 14293 raft_consensus.cc:2243] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.438298 14293 raft_consensus.cc:2272] T 33472d9d8b514a79b3645d0aa02749c2 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.442132 14293 tablet_replica.cc:333] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.443055 14293 raft_consensus.cc:2243] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.443672 14293 raft_consensus.cc:2272] T 7ed56e7a911d48c097f25c20e39f2385 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.446928 14293 tablet_replica.cc:333] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.447789 14293 raft_consensus.cc:2243] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.448388 14293 raft_consensus.cc:2272] T 6e95d2f411234daa8343913c7fd7da28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.451897 14293 tablet_replica.cc:333] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.452806 14293 raft_consensus.cc:2243] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.453944 14293 raft_consensus.cc:2272] T a14623ec43e74ec68cdc611737321081 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.457677 14293 tablet_replica.cc:333] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.458700 14293 raft_consensus.cc:2243] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.459409 14293 raft_consensus.cc:2272] T 8fc9b7bc403743f781fa69a6b3b60b24 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.462746 14293 tablet_replica.cc:333] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.463719 14293 raft_consensus.cc:2243] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.464396 14293 raft_consensus.cc:2272] T b575cdcb4fac42e984e4dc708fcad605 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.467732 14293 tablet_replica.cc:333] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.468644 14293 raft_consensus.cc:2243] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.469791 14293 raft_consensus.cc:2272] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.472821 14293 tablet_replica.cc:333] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.473760 14293 raft_consensus.cc:2243] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.474529 14293 raft_consensus.cc:2272] T d7c80de33300430e9f3578384080ff53 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:00.475780 23212 consensus_peers.cc:597] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.477494 14293 tablet_replica.cc:333] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.478538 14293 raft_consensus.cc:2243] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.479213 14293 raft_consensus.cc:2272] T f061f1bc80274cada8b20297e47bd6f3 P 62ed7ae0721746edb91c7e53a9dba2ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.482403 14293 tablet_replica.cc:333] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.483263 14293 raft_consensus.cc:2243] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.484582 14293 raft_consensus.cc:2272] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.488117 14293 tablet_replica.cc:333] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.489225 14293 raft_consensus.cc:2243] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.489872 14293 raft_consensus.cc:2272] T 0d68f7978d614f7e9d3dd87066f10091 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.493316 14293 tablet_replica.cc:333] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.494226 14293 raft_consensus.cc:2243] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:00.495486 23138 consensus_peers.cc:597] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.495514 14293 raft_consensus.cc:2272] T 481244be0dff49389d585c9e9c8d2384 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.503103 14293 tablet_replica.cc:333] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.504190 14293 raft_consensus.cc:2243] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.504784 14293 raft_consensus.cc:2272] T 9cddaae9615745fc941db7ae1a92044f P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.508104 14293 tablet_replica.cc:333] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.508859 14293 raft_consensus.cc:2243] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.509879 14293 raft_consensus.cc:2272] T b0c538e12e094914a765975898fe54e1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.512677 14293 tablet_replica.cc:333] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.513866 14293 raft_consensus.cc:2243] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.514715 14293 raft_consensus.cc:2272] T ab6a41e225bf43a8a84737c4cedbbff9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:00.514984 23212 consensus_peers.cc:597] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.520568 14293 tablet_replica.cc:333] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.522195 14293 raft_consensus.cc:2243] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.523017 14293 raft_consensus.cc:2272] T 90401217dded44f3bbae100f43bd7c9d P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.527268 14293 tablet_replica.cc:333] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
W20260709 13:09:00.535375 23212 consensus_peers.cc:597] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.543928 23212 consensus_peers.cc:597] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.545254 14293 raft_consensus.cc:2243] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.547029 14293 raft_consensus.cc:2272] T be29e709cce745f3b2421a0de2d75730 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:00.550782 23212 consensus_peers.cc:597] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.552031 14293 tablet_replica.cc:333] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.553566 14293 raft_consensus.cc:2243] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.554214 14293 raft_consensus.cc:2272] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.557960 14293 tablet_replica.cc:333] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
W20260709 13:09:00.558604 23138 consensus_peers.cc:597] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.559203 14293 raft_consensus.cc:2243] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.560039 14293 raft_consensus.cc:2272] T 8054b94be5cf4afabdc62b1cb6550554 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.563669 14293 tablet_replica.cc:333] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.564523 14293 raft_consensus.cc:2243] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.565143 14293 raft_consensus.cc:2272] T 43a804057f5f4d50bb94ce2f719a663a P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.568256 14293 tablet_replica.cc:333] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.569060 14293 raft_consensus.cc:2243] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.569658 14293 raft_consensus.cc:2272] T 8c8e0388048448ad81268fb914e7d4cc P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.572690 14293 tablet_replica.cc:333] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.573514 14293 raft_consensus.cc:2243] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.574100 14293 raft_consensus.cc:2272] T 0056709a01f04a2da19e224ab0d378a1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.577054 14293 tablet_replica.cc:333] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.577700 14293 raft_consensus.cc:2243] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.578228 14293 raft_consensus.cc:2272] T 33ef6a4ccfc2494489563699b0216088 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.580804 14293 tablet_replica.cc:333] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.581413 14293 raft_consensus.cc:2243] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.582278 14293 raft_consensus.cc:2272] T 95cb3974c72b4e05a01a96155e84d50c P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.584488 14293 tablet_replica.cc:333] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.585091 14293 raft_consensus.cc:2243] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.585598 14293 raft_consensus.cc:2272] T 76f52067e0764d909423286098ad3c7c P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.587867 14293 tablet_replica.cc:333] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.588621 14293 raft_consensus.cc:2243] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.589177 14293 raft_consensus.cc:2272] T d5bb24234c374237ae3cfd67bca1c794 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.592132 14293 tablet_replica.cc:333] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.592829 14293 raft_consensus.cc:2243] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.593386 14293 raft_consensus.cc:2272] T ba98dd70fec646a2b2d9e48e32da649d P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.596238 14293 tablet_replica.cc:333] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.597038 14293 raft_consensus.cc:2243] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.597584 14293 raft_consensus.cc:2272] T 41361b7bb5d44f2ba006fb10f2c275d8 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.600646 14293 tablet_replica.cc:333] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.601397 14293 raft_consensus.cc:2243] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.602056 14293 raft_consensus.cc:2272] T e899ea012af5427ca26140b778e6b811 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.605078 14293 tablet_replica.cc:333] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.605880 14293 raft_consensus.cc:2243] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.606410 14293 raft_consensus.cc:2272] T 56145698faa64689af33cb5ae7097cb1 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.609263 14293 tablet_replica.cc:333] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.609984 14293 raft_consensus.cc:2243] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.610613 14293 raft_consensus.cc:2272] T 7798deb16e0346c697b7b8e23415d63b P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.613687 14293 tablet_replica.cc:333] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.614544 14293 raft_consensus.cc:2243] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.615136 14293 raft_consensus.cc:2272] T dc91ac3261d049d1ab7aaa70e0c081e9 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.617923 14293 tablet_replica.cc:333] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.618680 14293 raft_consensus.cc:2243] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.619390 14293 raft_consensus.cc:2272] T da902f60c2e24fd5806973f54afb6318 P 62ed7ae0721746edb91c7e53a9dba2ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.622499 14293 tablet_replica.cc:333] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.623157 14293 raft_consensus.cc:2243] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.623716 14293 raft_consensus.cc:2272] T 8cb649bdf39d4f11b38e2a5246a82b28 P 62ed7ae0721746edb91c7e53a9dba2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.626710 14293 tablet_replica.cc:333] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed: stopping tablet replica
I20260709 13:09:00.627331 14293 raft_consensus.cc:2243] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:09:00.628393 23212 consensus_peers.cc:597] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.628576 14293 raft_consensus.cc:2272] T 217dc40b82664779b71b4261b1337e80 P 62ed7ae0721746edb91c7e53a9dba2ed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:00.636927 23212 consensus_peers.cc:597] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.639436 23138 consensus_peers.cc:597] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.647531 23212 consensus_peers.cc:597] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.746973 23212 consensus_peers.cc:597] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.761943 14293 tablet_server.cc:196] TabletServer@127.13.245.66:0 shutdown complete.
W20260709 13:09:00.785372 23138 consensus_peers.cc:597] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.841216 23138 consensus_peers.cc:597] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf -> Peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Couldn't send request to peer 62ed7ae0721746edb91c7e53a9dba2ed. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.872025 14293 tablet_server.cc:179] TabletServer@127.13.245.67:0 shutting down...
W20260709 13:09:00.884346 23211 consensus_peers.cc:597] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.908895 23211 consensus_peers.cc:597] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.939103 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:00.941015 14293 tablet_replica.cc:333] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.942615 14293 raft_consensus.cc:2243] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.943400 14293 raft_consensus.cc:2272] T e19758a128eb4647906943d8a455fea1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.946378 14293 tablet_replica.cc:333] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.947041 14293 raft_consensus.cc:2243] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.947448 14293 raft_consensus.cc:2272] T e414b2459e7d4897b74262e9f85a84aa P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.950033 14293 tablet_replica.cc:333] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.950834 14293 raft_consensus.cc:2243] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.951447 14293 raft_consensus.cc:2272] T adbc01cc61ed4eaab25d8cb87f61bdba P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:00.953418 23211 consensus_peers.cc:597] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.956139 14293 tablet_replica.cc:333] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.957651 14293 raft_consensus.cc:2243] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.958755 14293 raft_consensus.cc:2272] T 820d0fdc714544b1bb07aacd6c176a0b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.961925 14293 tablet_replica.cc:333] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.962867 14293 raft_consensus.cc:2243] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.963471 14293 raft_consensus.cc:2272] T 990e32f21d80459799b74a21dfa0be97 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.965901 14293 tablet_replica.cc:333] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.966663 14293 raft_consensus.cc:2243] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.967144 14293 raft_consensus.cc:2272] T c8c24c5fe50b420cb84b427a38c4b550 P bb8204df5095446cb973e600aa7696bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.969452 14293 tablet_replica.cc:333] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.970046 14293 raft_consensus.cc:2243] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.970463 14293 raft_consensus.cc:2272] T 7c383c2bf6b74c63a4d6713bf94c339c P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.972589 14293 tablet_replica.cc:333] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.973261 14293 raft_consensus.cc:2243] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.974363 14293 raft_consensus.cc:2272] T 40b7fb9731dd45f2a99ae81ca62d6889 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.977468 14293 tablet_replica.cc:333] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.978410 14293 raft_consensus.cc:2243] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.978991 14293 raft_consensus.cc:2272] T 98752a0b59b54debad030db8c47b501d P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.982059 14293 tablet_replica.cc:333] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
W20260709 13:09:00.982748 23211 consensus_peers.cc:597] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.982980 14293 raft_consensus.cc:2243] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.984362 14293 raft_consensus.cc:2272] T c068aa5e483f41e783c5498945e63250 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.987365 14293 tablet_replica.cc:333] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.988253 14293 raft_consensus.cc:2243] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.988829 14293 raft_consensus.cc:2272] T 6248ccc292244da38810b46798b3843f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.991642 14293 tablet_replica.cc:333] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.992596 14293 raft_consensus.cc:2243] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.993244 14293 raft_consensus.cc:2272] T 33472d9d8b514a79b3645d0aa02749c2 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.996155 14293 tablet_replica.cc:333] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:00.996796 14293 raft_consensus.cc:2243] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:00.997676 14293 raft_consensus.cc:2272] T 7ed56e7a911d48c097f25c20e39f2385 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.999871 14293 tablet_replica.cc:333] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.000509 14293 raft_consensus.cc:2243] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.000962 14293 raft_consensus.cc:2272] T 6e95d2f411234daa8343913c7fd7da28 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.003144 14293 tablet_replica.cc:333] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.003804 14293 raft_consensus.cc:2243] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.004243 14293 raft_consensus.cc:2272] T 2433c50320714f4288969a94d5e1bf12 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.006412 14293 tablet_replica.cc:333] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.007083 14293 raft_consensus.cc:2243] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.007642 14293 raft_consensus.cc:2272] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.010185 14293 tablet_replica.cc:333] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.010790 14293 raft_consensus.cc:2243] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.011320 14293 raft_consensus.cc:2272] T f061f1bc80274cada8b20297e47bd6f3 P bb8204df5095446cb973e600aa7696bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.013583 14293 tablet_replica.cc:333] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.014163 14293 raft_consensus.cc:2243] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.014587 14293 raft_consensus.cc:2272] T 0d68f7978d614f7e9d3dd87066f10091 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.016764 14293 tablet_replica.cc:333] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.017339 14293 raft_consensus.cc:2243] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.017755 14293 raft_consensus.cc:2272] T be29e709cce745f3b2421a0de2d75730 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.019953 14293 tablet_replica.cc:333] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.020548 14293 raft_consensus.cc:2243] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.021044 14293 raft_consensus.cc:2272] T 360366783c4b4b5f91f38c323f304f3a P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.023394 14293 tablet_replica.cc:333] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.024075 14293 raft_consensus.cc:2243] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.024935 14293 raft_consensus.cc:2272] T ba98dd70fec646a2b2d9e48e32da649d P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.027941 14293 tablet_replica.cc:333] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.028769 14293 raft_consensus.cc:2243] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.029845 14293 raft_consensus.cc:2272] T 36e46155980a493dbdcd5686e8c81fd2 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.032920 14293 tablet_replica.cc:333] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.033679 14293 raft_consensus.cc:2243] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.034245 14293 raft_consensus.cc:2272] T 481244be0dff49389d585c9e9c8d2384 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.037230 14293 tablet_replica.cc:333] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
W20260709 13:09:01.037950 23211 consensus_peers.cc:597] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.037974 14293 raft_consensus.cc:2243] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.039238 14293 raft_consensus.cc:2272] T dc4702f1cac747e4bb14d663d83e58ca P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.042318 14293 tablet_replica.cc:333] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.043219 14293 raft_consensus.cc:2243] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.044406 14293 raft_consensus.cc:2272] T f02c6bae4c084ae98cc464607f90c24b P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.047955 14293 tablet_replica.cc:333] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.048930 14293 raft_consensus.cc:2243] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.049863 14293 raft_consensus.cc:2272] T b0c538e12e094914a765975898fe54e1 P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.053310 14293 tablet_replica.cc:333] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.054266 14293 raft_consensus.cc:2243] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.054912 14293 raft_consensus.cc:2272] T ab6a41e225bf43a8a84737c4cedbbff9 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.058725 14293 tablet_replica.cc:333] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.059777 14293 raft_consensus.cc:2243] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.061151 14293 raft_consensus.cc:2272] T ca470edbc9134307a2189c750afa9f07 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.062986 23211 consensus_peers.cc:597] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.064466 14293 tablet_replica.cc:333] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.065500 14293 raft_consensus.cc:2243] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.066691 14293 raft_consensus.cc:2272] T 8cb649bdf39d4f11b38e2a5246a82b28 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.069916 14293 tablet_replica.cc:333] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.070585 14293 raft_consensus.cc:2243] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.071066 14293 raft_consensus.cc:2272] T 161f6ffe19a04f97acb85cc3152a8234 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.073920 14293 tablet_replica.cc:333] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.074671 14293 raft_consensus.cc:2243] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.075654 14293 raft_consensus.cc:2272] T 43a804057f5f4d50bb94ce2f719a663a P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.078459 14293 tablet_replica.cc:333] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.079576 14293 raft_consensus.cc:2243] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.080180 14293 raft_consensus.cc:2272] T 8c8e0388048448ad81268fb914e7d4cc P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.082962 14293 tablet_replica.cc:333] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.083736 14293 raft_consensus.cc:2243] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.084333 14293 raft_consensus.cc:2272] T dadbc16bab774234818801bd6d29d63f P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.086476 14293 tablet_replica.cc:333] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.087168 14293 raft_consensus.cc:2243] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.088150 14293 raft_consensus.cc:2272] T 0056709a01f04a2da19e224ab0d378a1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.090764 14293 tablet_replica.cc:333] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
W20260709 13:09:01.091275 23211 consensus_peers.cc:597] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.091393 14293 raft_consensus.cc:2243] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.092453 14293 raft_consensus.cc:2272] T 7630566d5f604f289dbfa8aae3cabf2f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.094740 14293 tablet_replica.cc:333] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.095402 14293 raft_consensus.cc:2243] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.096004 14293 raft_consensus.cc:2272] T da902f60c2e24fd5806973f54afb6318 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.098258 14293 tablet_replica.cc:333] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.098861 14293 raft_consensus.cc:2243] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.099326 14293 raft_consensus.cc:2272] T 33ef6a4ccfc2494489563699b0216088 P bb8204df5095446cb973e600aa7696bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.101533 14293 tablet_replica.cc:333] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.102136 14293 raft_consensus.cc:2243] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.102602 14293 raft_consensus.cc:2272] T 95cb3974c72b4e05a01a96155e84d50c P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.105325 14293 tablet_replica.cc:333] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.106179 14293 raft_consensus.cc:2243] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.106078 24241 raft_consensus.cc:493] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:09:01.106874 24241 raft_consensus.cc:515] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:09:01.107388 14293 raft_consensus.cc:2272] T d923431752a8412fb70574e65cdb555e P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.109020 24241 leader_election.cc:290] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:09:01.110628 14293 tablet_replica.cc:333] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.111414 14293 raft_consensus.cc:2243] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.112020 14293 raft_consensus.cc:2272] T 9cddaae9615745fc941db7ae1a92044f P bb8204df5095446cb973e600aa7696bf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.113180 23212 leader_election.cc:336] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:09:01.114009 23212 leader_election.cc:336] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111)
I20260709 13:09:01.114596 23212 leader_election.cc:304] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:09:01.114815 14293 tablet_replica.cc:333] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.115269 24241 raft_consensus.cc:2749] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.115751 14293 raft_consensus.cc:2243] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.116417 14293 raft_consensus.cc:2272] T d5bb24234c374237ae3cfd67bca1c794 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.118856 14293 tablet_replica.cc:333] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.119606 14293 raft_consensus.cc:2243] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:01.119975 23211 consensus_peers.cc:597] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.120128 14293 raft_consensus.cc:2272] T e899ea012af5427ca26140b778e6b811 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.122406 14293 tablet_replica.cc:333] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.122973 14293 raft_consensus.cc:2243] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.123934 14293 raft_consensus.cc:2272] T 56145698faa64689af33cb5ae7097cb1 P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.126111 14293 tablet_replica.cc:333] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf: stopping tablet replica
I20260709 13:09:01.126796 14293 raft_consensus.cc:2243] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.127403 14293 raft_consensus.cc:2272] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P bb8204df5095446cb973e600aa7696bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.203135 24241 raft_consensus.cc:493] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:09:01.203676 24241 raft_consensus.cc:515] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:09:01.205268 24241 leader_election.cc:290] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
W20260709 13:09:01.210073 23212 leader_election.cc:336] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:09:01.210861 23212 leader_election.cc:336] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111)
I20260709 13:09:01.211234 23212 leader_election.cc:304] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:09:01.211867 24241 raft_consensus.cc:2749] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.212805 14293 tablet_server.cc:196] TabletServer@127.13.245.67:0 shutdown complete.
W20260709 13:09:01.223790 23211 consensus_peers.cc:597] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.67:43419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.231052 24241 raft_consensus.cc:493] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:09:01.231779 24241 raft_consensus.cc:515] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:09:01.233779 24241 leader_election.cc:290] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
W20260709 13:09:01.238862 23212 leader_election.cc:336] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:09:01.239977 23212 leader_election.cc:336] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111)
I20260709 13:09:01.240355 23212 leader_election.cc:304] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:09:01.241019 24241 raft_consensus.cc:2749] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:01.244052 23211 consensus_peers.cc:597] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.67:43419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.304728 14293 tablet_server.cc:179] TabletServer@127.13.245.68:0 shutting down...
I20260709 13:09:01.358614 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:01.359450 14293 tablet_replica.cc:333] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.360282 14293 raft_consensus.cc:2243] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.361243 14293 raft_consensus.cc:2272] T e414b2459e7d4897b74262e9f85a84aa P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.363668 14293 tablet_replica.cc:333] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.364298 14293 raft_consensus.cc:2243] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.364756 14293 raft_consensus.cc:2272] T dc91ac3261d049d1ab7aaa70e0c081e9 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.367601 14293 tablet_replica.cc:333] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.368418 14293 raft_consensus.cc:2243] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.369494 14293 raft_consensus.cc:2272] T e19758a128eb4647906943d8a455fea1 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.370217 23211 consensus_peers.cc:597] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 -> Peer bb8204df5095446cb973e600aa7696bf (127.13.245.67:43419): Couldn't send request to peer bb8204df5095446cb973e600aa7696bf. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.67:43419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.371030 24241 raft_consensus.cc:493] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:09:01.371462 24241 raft_consensus.cc:515] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:09:01.372244 14293 tablet_replica.cc:333] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.373137 14293 raft_consensus.cc:2243] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.373238 24241 leader_election.cc:290] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:09:01.373709 14293 raft_consensus.cc:2272] T 820d0fdc714544b1bb07aacd6c176a0b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.377004 14293 tablet_replica.cc:333] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
W20260709 13:09:01.377641 23212 leader_election.cc:336] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:09:01.378173 14293 raft_consensus.cc:2243] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:01.378423 23212 leader_election.cc:336] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111)
I20260709 13:09:01.378927 14293 raft_consensus.cc:2272] T 08e6c94513d545df957ae3d6c984123b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.378897 23212 leader_election.cc:304] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:09:01.379820 24241 raft_consensus.cc:2749] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.382114 14293 tablet_replica.cc:333] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.382839 14293 raft_consensus.cc:2243] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.383358 14293 raft_consensus.cc:2272] T 1351248e1da24069a4599e9fdc8b3e6b P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.385813 14293 tablet_replica.cc:333] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.386480 14293 raft_consensus.cc:2243] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.387485 14293 raft_consensus.cc:2272] T 7c383c2bf6b74c63a4d6713bf94c339c P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.390017 14293 tablet_replica.cc:333] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.390707 14293 raft_consensus.cc:2243] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.391196 14293 raft_consensus.cc:2272] T 7ed56e7a911d48c097f25c20e39f2385 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.393388 14293 tablet_replica.cc:333] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.394048 14293 raft_consensus.cc:2243] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.394562 14293 raft_consensus.cc:2272] T 40b7fb9731dd45f2a99ae81ca62d6889 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.396888 14293 tablet_replica.cc:333] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.397562 14293 raft_consensus.cc:2243] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.398042 14293 raft_consensus.cc:2272] T c068aa5e483f41e783c5498945e63250 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.400264 24241 raft_consensus.cc:493] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 62ed7ae0721746edb91c7e53a9dba2ed)
I20260709 13:09:01.400738 14293 tablet_replica.cc:333] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.400789 24241 raft_consensus.cc:515] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:09:01.401513 14293 raft_consensus.cc:2243] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.402225 14293 raft_consensus.cc:2272] T adbc01cc61ed4eaab25d8cb87f61bdba P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.403232 24241 leader_election.cc:290] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:09:01.405277 14293 tablet_replica.cc:333] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.406330 14293 raft_consensus.cc:2243] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.407071 14293 raft_consensus.cc:2272] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.410017 23212 leader_election.cc:336] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:09:01.410223 14293 tablet_replica.cc:333] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
W20260709 13:09:01.410945 23212 leader_election.cc:336] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111)
I20260709 13:09:01.411278 14293 raft_consensus.cc:2243] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.411355 23212 leader_election.cc:304] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
W20260709 13:09:01.412065 23212 raft_consensus.cc:2686] T d338f57c69b44220a6c31510e829a8f6 P 86f6c62fa9a94b679e852571485aa293: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:01.412379 14293 raft_consensus.cc:2272] T 2433c50320714f4288969a94d5e1bf12 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.414597 14293 tablet_replica.cc:333] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.415211 14293 raft_consensus.cc:2243] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.415684 14293 raft_consensus.cc:2272] T a14623ec43e74ec68cdc611737321081 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.417744 14293 tablet_replica.cc:333] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.418335 14293 raft_consensus.cc:2243] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.418762 14293 raft_consensus.cc:2272] T 8fc9b7bc403743f781fa69a6b3b60b24 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.420792 14293 tablet_replica.cc:333] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.421397 14293 raft_consensus.cc:2243] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.421836 14293 raft_consensus.cc:2272] T 481244be0dff49389d585c9e9c8d2384 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.424118 14293 tablet_replica.cc:333] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.424697 14293 raft_consensus.cc:2243] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.425117 14293 raft_consensus.cc:2272] T 90401217dded44f3bbae100f43bd7c9d P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.427158 14293 tablet_replica.cc:333] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.427819 14293 raft_consensus.cc:2243] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.428659 14293 raft_consensus.cc:2272] T 31a6c80cc6f84dbbafe4921c5a9a2bd5 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.430814 14293 tablet_replica.cc:333] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.431246 24238 raft_consensus.cc:493] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:09:01.431486 14293 raft_consensus.cc:2243] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.431800 24238 raft_consensus.cc:515] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } } peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } }
I20260709 13:09:01.432583 14293 raft_consensus.cc:2272] T 8054b94be5cf4afabdc62b1cb6550554 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.433439 24241 raft_consensus.cc:493] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164704f999554466a68662962540809e)
I20260709 13:09:01.433820 24238 leader_election.cc:290] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:09:01.433945 24241 raft_consensus.cc:515] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164704f999554466a68662962540809e" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 41281 } } peers { permanent_uuid: "62ed7ae0721746edb91c7e53a9dba2ed" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 44151 } } peers { permanent_uuid: "86f6c62fa9a94b679e852571485aa293" member_type: VOTER last_known_addr { host: "127.13.245.68" port: 44019 } }
I20260709 13:09:01.435675 14293 tablet_replica.cc:333] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.436550 14293 raft_consensus.cc:2243] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.437110 24241 leader_election.cc:290] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 164704f999554466a68662962540809e (127.13.245.65:41281), 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151)
I20260709 13:09:01.437148 14293 raft_consensus.cc:2272] T ca470edbc9134307a2189c750afa9f07 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.440317 23212 leader_election.cc:336] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
I20260709 13:09:01.441140 14293 tablet_replica.cc:333] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
W20260709 13:09:01.441329 23212 leader_election.cc:336] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111)
I20260709 13:09:01.441924 23212 leader_election.cc:304] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:09:01.442296 14293 raft_consensus.cc:2243] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.442751 24241 raft_consensus.cc:2749] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.443010 14293 raft_consensus.cc:2272] T 8cb649bdf39d4f11b38e2a5246a82b28 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.448031 14293 tablet_replica.cc:333] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
W20260709 13:09:01.447940 23212 leader_election.cc:336] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164704f999554466a68662962540809e (127.13.245.65:41281): Network error: Client connection negotiation failed: client connection to 127.13.245.65:41281: connect: Connection refused (error 111)
W20260709 13:09:01.448926 23212 leader_election.cc:336] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 62ed7ae0721746edb91c7e53a9dba2ed (127.13.245.66:44151): Network error: Client connection negotiation failed: client connection to 127.13.245.66:44151: connect: Connection refused (error 111)
I20260709 13:09:01.449128 14293 raft_consensus.cc:2243] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.449353 23212 leader_election.cc:304] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86f6c62fa9a94b679e852571485aa293; no voters: 164704f999554466a68662962540809e, 62ed7ae0721746edb91c7e53a9dba2ed
I20260709 13:09:01.450081 24238 raft_consensus.cc:2749] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.450963 14293 raft_consensus.cc:2272] T 161f6ffe19a04f97acb85cc3152a8234 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.453572 14293 tablet_replica.cc:333] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.454459 14293 raft_consensus.cc:2243] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.455246 14293 raft_consensus.cc:2272] T dc4702f1cac747e4bb14d663d83e58ca P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.458380 14293 tablet_replica.cc:333] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.459208 14293 raft_consensus.cc:2243] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.459714 14293 raft_consensus.cc:2272] T f02c6bae4c084ae98cc464607f90c24b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.461732 14293 tablet_replica.cc:333] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.462265 14293 raft_consensus.cc:2243] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.462670 14293 raft_consensus.cc:2272] T 7798deb16e0346c697b7b8e23415d63b P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.464807 14293 tablet_replica.cc:333] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.465324 14293 raft_consensus.cc:2243] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.465734 14293 raft_consensus.cc:2272] T 7630566d5f604f289dbfa8aae3cabf2f P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.467801 14293 tablet_replica.cc:333] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.468326 14293 raft_consensus.cc:2243] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.469142 14293 raft_consensus.cc:2272] T 8c8e0388048448ad81268fb914e7d4cc P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.471140 14293 tablet_replica.cc:333] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.471788 14293 raft_consensus.cc:2243] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.472651 14293 raft_consensus.cc:2272] T dadbc16bab774234818801bd6d29d63f P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.474764 14293 tablet_replica.cc:333] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.475281 14293 raft_consensus.cc:2243] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.476222 14293 raft_consensus.cc:2272] T ab6a41e225bf43a8a84737c4cedbbff9 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.478328 14293 tablet_replica.cc:333] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.478856 14293 raft_consensus.cc:2243] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.479312 14293 raft_consensus.cc:2272] T 217dc40b82664779b71b4261b1337e80 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.481402 14293 tablet_replica.cc:333] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.482151 14293 raft_consensus.cc:2243] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.482693 14293 raft_consensus.cc:2272] T d923431752a8412fb70574e65cdb555e P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.484764 14293 tablet_replica.cc:333] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.485258 14293 raft_consensus.cc:2243] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.485647 14293 raft_consensus.cc:2272] T 95cb3974c72b4e05a01a96155e84d50c P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.487659 14293 tablet_replica.cc:333] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.488209 14293 raft_consensus.cc:2243] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.488636 14293 raft_consensus.cc:2272] T 76f52067e0764d909423286098ad3c7c P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.490473 14293 tablet_replica.cc:333] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.491024 14293 raft_consensus.cc:2243] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.491909 14293 raft_consensus.cc:2272] T d5bb24234c374237ae3cfd67bca1c794 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.493810 14293 tablet_replica.cc:333] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.494334 14293 raft_consensus.cc:2243] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.495172 14293 raft_consensus.cc:2272] T e899ea012af5427ca26140b778e6b811 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.497259 14293 tablet_replica.cc:333] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.497836 14293 raft_consensus.cc:2243] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.498272 14293 raft_consensus.cc:2272] T 56145698faa64689af33cb5ae7097cb1 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.500330 14293 tablet_replica.cc:333] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.500885 14293 raft_consensus.cc:2243] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.501299 14293 raft_consensus.cc:2272] T ba98dd70fec646a2b2d9e48e32da649d P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.503278 14293 tablet_replica.cc:333] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.503875 14293 raft_consensus.cc:2243] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.504300 14293 raft_consensus.cc:2272] T 36e46155980a493dbdcd5686e8c81fd2 P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.506198 14293 tablet_replica.cc:333] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.506714 14293 raft_consensus.cc:2243] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.507517 14293 raft_consensus.cc:2272] T 41361b7bb5d44f2ba006fb10f2c275d8 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.509838 14293 tablet_replica.cc:333] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.510438 14293 raft_consensus.cc:2243] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.511250 14293 raft_consensus.cc:2272] T b575cdcb4fac42e984e4dc708fcad605 P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.513411 14293 tablet_replica.cc:333] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.513981 14293 raft_consensus.cc:2243] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.514467 14293 raft_consensus.cc:2272] T 462ac7fd6cff4fa3ae2823a5c93a8c66 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.516454 14293 tablet_replica.cc:333] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.516963 14293 raft_consensus.cc:2243] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.517382 14293 raft_consensus.cc:2272] T d7c80de33300430e9f3578384080ff53 P 86f6c62fa9a94b679e852571485aa293 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.519263 14293 tablet_replica.cc:333] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.519795 14293 raft_consensus.cc:2243] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.520221 14293 raft_consensus.cc:2272] T 7a0a73b5f8f04698bf33b4c6f5ffea8b P 86f6c62fa9a94b679e852571485aa293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.522092 14293 tablet_replica.cc:333] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293: stopping tablet replica
I20260709 13:09:01.522562 14293 raft_consensus.cc:2243] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.523399 14293 raft_consensus.cc:2272] T 360366783c4b4b5f91f38c323f304f3a P 86f6c62fa9a94b679e852571485aa293 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.606360 14293 tablet_server.cc:196] TabletServer@127.13.245.68:0 shutdown complete.
I20260709 13:09:01.685539 14293 master.cc:562] Master@127.13.245.126:41123 shutting down...
I20260709 13:09:01.719805 14293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.720497 14293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.720860 14293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4aac5866e908499a855c1dc99c268744: stopping tablet replica
I20260709 13:09:01.783211 14293 master.cc:584] Master@127.13.245.126:41123 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39366 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:09:01.883690 14293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.245.126:35371
I20260709 13:09:01.885222 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:01.891650 24365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:01.891868 24364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:01.892248 24367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:01.895637 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:01.896896 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:01.897073 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:01.897214 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602541897202 us; error 0 us; skew 500 ppm
I20260709 13:09:01.897691 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:01.900377 14293 webserver.cc:533] Webserver started at http://127.13.245.126:40483/ using document root <none> and password file <none>
I20260709 13:09:01.900928 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:01.901235 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:01.901573 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:01.902841 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/master-0-root/instance:
uuid: "8ce244ffed31436e86e614a1defe4665"
format_stamp: "Formatted at 2026-07-09 13:09:01 on dist-test-slave-fc6v"
I20260709 13:09:01.907464 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:09:01.911309 24372 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:01.912308 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:01.912722 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/master-0-root
uuid: "8ce244ffed31436e86e614a1defe4665"
format_stamp: "Formatted at 2026-07-09 13:09:01 on dist-test-slave-fc6v"
I20260709 13:09:01.913156 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:01.938344 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:01.939836 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:01.985440 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.126:35371
I20260709 13:09:01.985602 24423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.126:35371 every 8 connection(s)
I20260709 13:09:01.989820 24424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.006132 24424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665: Bootstrap starting.
I20260709 13:09:02.012408 24424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.018049 24424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665: No bootstrap required, opened a new log
I20260709 13:09:02.021220 24424 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce244ffed31436e86e614a1defe4665" member_type: VOTER }
I20260709 13:09:02.021878 24424 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.022172 24424 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ce244ffed31436e86e614a1defe4665, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.022974 24424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce244ffed31436e86e614a1defe4665" member_type: VOTER }
I20260709 13:09:02.023484 24424 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:02.023764 24424 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:02.024008 24424 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.030151 24424 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce244ffed31436e86e614a1defe4665" member_type: VOTER }
I20260709 13:09:02.030836 24424 leader_election.cc:304] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ce244ffed31436e86e614a1defe4665; no voters: 
I20260709 13:09:02.032298 24424 leader_election.cc:290] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:02.032737 24427 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:02.034373 24427 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 1 LEADER]: Becoming Leader. State: Replica: 8ce244ffed31436e86e614a1defe4665, State: Running, Role: LEADER
I20260709 13:09:02.035164 24427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce244ffed31436e86e614a1defe4665" member_type: VOTER }
I20260709 13:09:02.036094 24424 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:02.041057 24429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ce244ffed31436e86e614a1defe4665. Latest consensus state: current_term: 1 leader_uuid: "8ce244ffed31436e86e614a1defe4665" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce244ffed31436e86e614a1defe4665" member_type: VOTER } }
I20260709 13:09:02.041530 24428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ce244ffed31436e86e614a1defe4665" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce244ffed31436e86e614a1defe4665" member_type: VOTER } }
I20260709 13:09:02.042076 24429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:02.042352 24428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:02.049021 24434 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:02.054745 24434 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:02.059137 14293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:02.064937 24434 catalog_manager.cc:1383] Generated new cluster ID: b4712a857f654ee2902d74432796af53
I20260709 13:09:02.065239 24434 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:02.079177 24434 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:02.080786 24434 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:02.100139 24434 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665: Generated new TSK 0
I20260709 13:09:02.100821 24434 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:02.126644 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:02.133864 24445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.135057 24446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.136960 24448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:02.140996 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:02.142333 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:02.142602 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:02.142789 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602542142761 us; error 0 us; skew 500 ppm
I20260709 13:09:02.143405 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:02.146541 14293 webserver.cc:533] Webserver started at http://127.13.245.65:41853/ using document root <none> and password file <none>
I20260709 13:09:02.147159 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:02.147401 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:02.147773 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:02.149071 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root/instance:
uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-fc6v"
I20260709 13:09:02.154687 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:02.159071 24453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.160481 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:02.160892 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-fc6v"
I20260709 13:09:02.161334 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:02.187006 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:02.188519 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:02.190372 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:02.193679 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:02.193950 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.194279 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:02.194514 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.245647 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:38755
I20260709 13:09:02.245795 24515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:38755 every 8 connection(s)
I20260709 13:09:02.251339 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:02.260619 24520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.264127 24521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:02.264901 14293 server_base.cc:1061] running on GCE node
W20260709 13:09:02.264477 24523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:02.266938 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:02.267184 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:02.267347 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602542267335 us; error 0 us; skew 500 ppm
I20260709 13:09:02.268054 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:02.271121 14293 webserver.cc:533] Webserver started at http://127.13.245.66:39465/ using document root <none> and password file <none>
I20260709 13:09:02.271831 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:02.272102 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:02.272419 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:02.273742 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-1-root/instance:
uuid: "150065cf33f74c949a60e9fd3dc57760"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-fc6v"
I20260709 13:09:02.275863 24516 heartbeater.cc:344] Connected to a master server at 127.13.245.126:35371
I20260709 13:09:02.276388 24516 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:02.277220 24516 heartbeater.cc:507] Master 127.13.245.126:35371 requested a full tablet report, sending...
I20260709 13:09:02.279796 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:02.279886 24389 ts_manager.cc:194] Registered new tserver with Master: 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755)
I20260709 13:09:02.282112 24389 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33150
I20260709 13:09:02.284790 24528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.285997 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:02.286370 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-1-root
uuid: "150065cf33f74c949a60e9fd3dc57760"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-fc6v"
I20260709 13:09:02.286687 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:02.316026 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:02.318136 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:02.320463 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:02.324035 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:02.324340 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.324642 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:02.324877 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.384743 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.66:34427
I20260709 13:09:02.384881 24590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.66:34427 every 8 connection(s)
I20260709 13:09:02.390204 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:02.398526 24594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.399529 24595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.402755 24597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:02.403400 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:02.404512 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:02.404559 24591 heartbeater.cc:344] Connected to a master server at 127.13.245.126:35371
W20260709 13:09:02.404867 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:02.405025 24591 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:02.405092 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602542405067 us; error 0 us; skew 500 ppm
I20260709 13:09:02.406049 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:02.406100 24591 heartbeater.cc:507] Master 127.13.245.126:35371 requested a full tablet report, sending...
I20260709 13:09:02.408715 24389 ts_manager.cc:194] Registered new tserver with Master: 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:02.409140 14293 webserver.cc:533] Webserver started at http://127.13.245.67:39523/ using document root <none> and password file <none>
I20260709 13:09:02.409711 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:02.409924 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:02.410215 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:02.410570 24389 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33160
I20260709 13:09:02.411499 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-2-root/instance:
uuid: "05b14d8480174a549bf0b073b61b5671"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-fc6v"
I20260709 13:09:02.416910 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:02.420347 24602 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.421152 14293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:02.421422 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-2-root
uuid: "05b14d8480174a549bf0b073b61b5671"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-fc6v"
I20260709 13:09:02.421741 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:02.437016 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:02.438691 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:02.440434 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:02.443822 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:02.444036 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.444387 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:02.444595 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.494517 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.67:40295
I20260709 13:09:02.494642 24664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.67:40295 every 8 connection(s)
I20260709 13:09:02.509690 24665 heartbeater.cc:344] Connected to a master server at 127.13.245.126:35371
I20260709 13:09:02.510233 24665 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:02.511032 24665 heartbeater.cc:507] Master 127.13.245.126:35371 requested a full tablet report, sending...
I20260709 13:09:02.513051 24389 ts_manager.cc:194] Registered new tserver with Master: 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:02.513206 14293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014919109s
I20260709 13:09:02.514612 24389 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33174
I20260709 13:09:02.541558 24389 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33182:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:02.544847 24389 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:02.627417 24630 tablet_service.cc:1511] Processing CreateTablet for tablet 28d27045940a4318ba74a8ab449a21b7 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:02.629072 24630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d27045940a4318ba74a8ab449a21b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.632634 24629 tablet_service.cc:1511] Processing CreateTablet for tablet 7348cdc242794ad7ad87db671d0df228 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:02.634361 24629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7348cdc242794ad7ad87db671d0df228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.635918 24628 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd8ffd72fcf4cf7bb76f8529d8c639b (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:02.636638 24477 tablet_service.cc:1511] Processing CreateTablet for tablet b586f33ee6434d438897d3ed7f07ecbd (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:02.637562 24628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd8ffd72fcf4cf7bb76f8529d8c639b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.638055 24477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b586f33ee6434d438897d3ed7f07ecbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.646883 24556 tablet_service.cc:1511] Processing CreateTablet for tablet 28d27045940a4318ba74a8ab449a21b7 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:02.639751 24478 tablet_service.cc:1511] Processing CreateTablet for tablet 02b9d94ad1e542f8b801427ae982c0ef (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:02.648571 24478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b9d94ad1e542f8b801427ae982c0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.648707 24625 tablet_service.cc:1511] Processing CreateTablet for tablet 54dc563ef0134d4787b805f076b4f2a5 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:02.649695 24475 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0cdaf6979241b7a38b0021098f7c1e (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:02.650225 24625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dc563ef0134d4787b805f076b4f2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.651225 24475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0cdaf6979241b7a38b0021098f7c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.641752 24553 tablet_service.cc:1511] Processing CreateTablet for tablet 02b9d94ad1e542f8b801427ae982c0ef (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:02.646956 24627 tablet_service.cc:1511] Processing CreateTablet for tablet 02b9d94ad1e542f8b801427ae982c0ef (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:02.639871 24555 tablet_service.cc:1511] Processing CreateTablet for tablet 7348cdc242794ad7ad87db671d0df228 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:02.640301 24552 tablet_service.cc:1511] Processing CreateTablet for tablet b586f33ee6434d438897d3ed7f07ecbd (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:02.653956 24627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b9d94ad1e542f8b801427ae982c0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.656597 24474 tablet_service.cc:1511] Processing CreateTablet for tablet e0a65e3df81f4d30b28f8e77897a1525 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:02.658882 24474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a65e3df81f4d30b28f8e77897a1525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.641752 24480 tablet_service.cc:1511] Processing CreateTablet for tablet 7348cdc242794ad7ad87db671d0df228 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:02.661242 24480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7348cdc242794ad7ad87db671d0df228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.636490 24479 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd8ffd72fcf4cf7bb76f8529d8c639b (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:02.663615 24479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd8ffd72fcf4cf7bb76f8529d8c639b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.643024 24554 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd8ffd72fcf4cf7bb76f8529d8c639b (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:02.643700 24481 tablet_service.cc:1511] Processing CreateTablet for tablet 28d27045940a4318ba74a8ab449a21b7 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:02.666898 24481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d27045940a4318ba74a8ab449a21b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.644361 24551 tablet_service.cc:1511] Processing CreateTablet for tablet 54dc563ef0134d4787b805f076b4f2a5 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:02.644999 24476 tablet_service.cc:1511] Processing CreateTablet for tablet 54dc563ef0134d4787b805f076b4f2a5 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:02.669912 24476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dc563ef0134d4787b805f076b4f2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.646495 24626 tablet_service.cc:1511] Processing CreateTablet for tablet b586f33ee6434d438897d3ed7f07ecbd (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:02.672199 24626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b586f33ee6434d438897d3ed7f07ecbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.648571 24556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d27045940a4318ba74a8ab449a21b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.679975 24551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dc563ef0134d4787b805f076b4f2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.681180 24552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b586f33ee6434d438897d3ed7f07ecbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.682615 24554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd8ffd72fcf4cf7bb76f8529d8c639b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.684011 24555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7348cdc242794ad7ad87db671d0df228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.685434 24553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b9d94ad1e542f8b801427ae982c0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.693984 24624 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0cdaf6979241b7a38b0021098f7c1e (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:02.695258 24473 tablet_service.cc:1511] Processing CreateTablet for tablet 16728c89bc464a06b906523e00ece3dd (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:02.697458 24473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16728c89bc464a06b906523e00ece3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.696118 24624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0cdaf6979241b7a38b0021098f7c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.701701 24623 tablet_service.cc:1511] Processing CreateTablet for tablet e0a65e3df81f4d30b28f8e77897a1525 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:02.704039 24623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a65e3df81f4d30b28f8e77897a1525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.715772 24472 tablet_service.cc:1511] Processing CreateTablet for tablet fef231923f484e1084b05db8b9a51bae (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:02.716711 24622 tablet_service.cc:1511] Processing CreateTablet for tablet 16728c89bc464a06b906523e00ece3dd (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:02.717432 24472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef231923f484e1084b05db8b9a51bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.718240 24622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16728c89bc464a06b906523e00ece3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.723704 24549 tablet_service.cc:1511] Processing CreateTablet for tablet e0a65e3df81f4d30b28f8e77897a1525 (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:02.724944 24550 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0cdaf6979241b7a38b0021098f7c1e (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:02.723062 24621 tablet_service.cc:1511] Processing CreateTablet for tablet fef231923f484e1084b05db8b9a51bae (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:02.727452 24621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef231923f484e1084b05db8b9a51bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.727058 24548 tablet_service.cc:1511] Processing CreateTablet for tablet 16728c89bc464a06b906523e00ece3dd (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:02.725566 24549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a65e3df81f4d30b28f8e77897a1525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.731487 24550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0cdaf6979241b7a38b0021098f7c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.732432 24548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16728c89bc464a06b906523e00ece3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.765527 24547 tablet_service.cc:1511] Processing CreateTablet for tablet fef231923f484e1084b05db8b9a51bae (DEFAULT_TABLE table=test-workload [id=f83f3e3a57ce4759a581d83c156ead5f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:02.767874 24547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef231923f484e1084b05db8b9a51bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.862342 24680 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:02.910737 24680 tablet_bootstrap.cc:654] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.954331 24682 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:02.956557 24681 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:02.964717 24682 tablet_bootstrap.cc:654] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.966478 24680 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:02.967114 24680 ts_tablet_manager.cc:1403] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.020s
I20260709 13:09:02.968538 24681 tablet_bootstrap.cc:654] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.970418 24680 raft_consensus.cc:359] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:02.971114 24680 raft_consensus.cc:385] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.971375 24680 raft_consensus.cc:740] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.972424 24680 consensus_queue.cc:260] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:02.975252 24682 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:02.976101 24682 ts_tablet_manager.cc:1403] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.014s
I20260709 13:09:02.978533 24665 heartbeater.cc:499] Master 127.13.245.126:35371 was elected leader, sending a full tablet report...
I20260709 13:09:02.979043 24681 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:02.979097 24680 ts_tablet_manager.cc:1434] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:09:02.979844 24681 ts_tablet_manager.cc:1403] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.006s
I20260709 13:09:02.979457 24682 raft_consensus.cc:359] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:02.980352 24682 raft_consensus.cc:385] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.980798 24682 raft_consensus.cc:740] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.980429 24680 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:02.983280 24682 consensus_queue.cc:260] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:02.983294 24681 raft_consensus.cc:359] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:02.984457 24681 raft_consensus.cc:385] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.984822 24681 raft_consensus.cc:740] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.985899 24681 consensus_queue.cc:260] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:02.989209 24680 tablet_bootstrap.cc:654] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.991930 24591 heartbeater.cc:499] Master 127.13.245.126:35371 was elected leader, sending a full tablet report...
I20260709 13:09:02.993086 24681 ts_tablet_manager.cc:1434] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 13:09:02.994302 24681 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:02.998687 24516 heartbeater.cc:499] Master 127.13.245.126:35371 was elected leader, sending a full tablet report...
I20260709 13:09:02.999312 24682 ts_tablet_manager.cc:1434] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:09:03.000562 24682 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
W20260709 13:09:03.001674 24666 tablet.cc:2406] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:03.003332 24681 tablet_bootstrap.cc:654] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.008419 24682 tablet_bootstrap.cc:654] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.018712 24681 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.019685 24681 ts_tablet_manager.cc:1403] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 13:09:03.024235 24681 raft_consensus.cc:359] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.025058 24681 raft_consensus.cc:385] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.025384 24681 raft_consensus.cc:740] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.028765 24682 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.029647 24682 ts_tablet_manager.cc:1403] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 13:09:03.031919 24681 consensus_queue.cc:260] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.034214 24681 ts_tablet_manager.cc:1434] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:09:03.035101 24681 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:03.034605 24682 raft_consensus.cc:359] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.035564 24682 raft_consensus.cc:385] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.035899 24682 raft_consensus.cc:740] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.036713 24682 consensus_queue.cc:260] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.039119 24682 ts_tablet_manager.cc:1434] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:09:03.040295 24682 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:03.042078 24681 tablet_bootstrap.cc:654] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.042232 24680 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.042820 24680 ts_tablet_manager.cc:1403] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.017s
I20260709 13:09:03.047211 24688 raft_consensus.cc:493] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.046872 24680 raft_consensus.cc:359] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.048193 24680 raft_consensus.cc:385] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.047916 24688 raft_consensus.cc:515] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.048684 24680 raft_consensus.cc:740] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.049835 24680 consensus_queue.cc:260] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
W20260709 13:09:03.053006 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:03.053884 24680 ts_tablet_manager.cc:1434] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 13:09:03.055109 24680 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:03.061892 24688 leader_election.cc:290] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.064968 24680 tablet_bootstrap.cc:654] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.072731 24682 tablet_bootstrap.cc:654] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.093775 24682 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.094539 24686 raft_consensus.cc:493] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.095235 24686 raft_consensus.cc:515] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.098975 24686 leader_election.cc:290] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:03.099045 24687 raft_consensus.cc:493] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.099941 24687 raft_consensus.cc:515] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.111419 24687 leader_election.cc:290] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.118762 24682 ts_tablet_manager.cc:1403] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.004s
I20260709 13:09:03.134121 24686 raft_consensus.cc:493] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.135110 24686 raft_consensus.cc:515] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.138423 24686 leader_election.cc:290] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:03.141963 24681 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.142867 24681 ts_tablet_manager.cc:1403] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.108s	user 0.023s	sys 0.069s
I20260709 13:09:03.147228 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.147584 24681 raft_consensus.cc:359] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.148828 24681 raft_consensus.cc:385] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.149272 24681 raft_consensus.cc:740] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
W20260709 13:09:03.149626 24531 leader_election.cc:343] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.150379 24681 consensus_queue.cc:260] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.154563 24680 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.155289 24680 ts_tablet_manager.cc:1403] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.036s
I20260709 13:09:03.156293 24681 ts_tablet_manager.cc:1434] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.013s	user 0.013s	sys 0.000s
I20260709 13:09:03.157658 24681 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:03.122910 24682 raft_consensus.cc:359] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.161592 24491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:03.161558 24682 raft_consensus.cc:385] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.163893 24682 raft_consensus.cc:740] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.164839 24682 consensus_queue.cc:260] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
W20260709 13:09:03.166275 24532 leader_election.cc:343] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.166306 24681 tablet_bootstrap.cc:654] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.168630 24532 leader_election.cc:304] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760; no voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.168637 24682 ts_tablet_manager.cc:1434] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:09:03.173534 24688 raft_consensus.cc:2749] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.159101 24680 raft_consensus.cc:359] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.174845 24680 raft_consensus.cc:385] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.175277 24680 raft_consensus.cc:740] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.177973 24680 consensus_queue.cc:260] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.179673 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.182387 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a65e3df81f4d30b28f8e77897a1525" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.183145 24566 raft_consensus.cc:2468] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 0.
I20260709 13:09:03.182682 24680 ts_tablet_manager.cc:1434] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:09:03.184751 24680 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
W20260709 13:09:03.184890 24604 leader_election.cc:343] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.187978 24604 leader_election.cc:304] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:03.189034 24686 raft_consensus.cc:2804] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.189430 24686 raft_consensus.cc:493] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.189828 24686 raft_consensus.cc:3060] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.195741 24680 tablet_bootstrap.cc:654] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.200527 24681 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.201046 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.201992 24682 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
W20260709 13:09:03.203289 24455 leader_election.cc:343] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.204873 24686 raft_consensus.cc:515] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.207571 24686 leader_election.cc:290] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:03.202360 24681 ts_tablet_manager.cc:1403] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.015s
I20260709 13:09:03.208950 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a65e3df81f4d30b28f8e77897a1525" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:03.209812 24566 raft_consensus.cc:3060] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.211959 24681 raft_consensus.cc:359] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.212942 24681 raft_consensus.cc:385] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.213385 24681 raft_consensus.cc:740] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.213404 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.214057 24491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:03.214630 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a65e3df81f4d30b28f8e77897a1525" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:03.214432 24681 consensus_queue.cc:260] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.215399 24490 raft_consensus.cc:2468] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 0.
I20260709 13:09:03.217479 24682 tablet_bootstrap.cc:654] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.217792 24681 ts_tablet_manager.cc:1434] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:03.219358 24681 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:03.221257 24680 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.221930 24680 ts_tablet_manager.cc:1403] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.006s
I20260709 13:09:03.222043 24566 raft_consensus.cc:2468] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:03.223837 24604 leader_election.cc:304] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:03.224124 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a65e3df81f4d30b28f8e77897a1525" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
W20260709 13:09:03.224362 24606 leader_election.cc:343] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.224891 24686 raft_consensus.cc:2804] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.225183 24606 leader_election.cc:304] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671; no voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.224907 24490 raft_consensus.cc:3060] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:03.225790 24456 leader_election.cc:343] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.227411 24456 leader_election.cc:304] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:03.228725 24687 raft_consensus.cc:2749] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.235674 24686 raft_consensus.cc:697] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:03.236097 24681 tablet_bootstrap.cc:654] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.234764 24680 raft_consensus.cc:359] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.237912 24680 raft_consensus.cc:385] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.237701 24686 consensus_queue.cc:237] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.239291 24705 raft_consensus.cc:2749] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.238343 24680 raft_consensus.cc:740] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.242938 24680 consensus_queue.cc:260] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.245433 24680 ts_tablet_manager.cc:1434] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:03.246596 24680 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:03.249660 24490 raft_consensus.cc:2468] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:03.253989 24706 raft_consensus.cc:493] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.254985 24680 tablet_bootstrap.cc:654] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.254839 24706 raft_consensus.cc:515] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.259388 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:03.260324 24706 leader_election.cc:290] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:03.260993 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
W20260709 13:09:03.261214 24606 leader_election.cc:343] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.261741 24566 raft_consensus.cc:2468] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 0.
I20260709 13:09:03.263403 24604 leader_election.cc:304] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.265348 24706 raft_consensus.cc:2804] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.265861 24706 raft_consensus.cc:493] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.266326 24706 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.266451 24681 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.267608 24681 ts_tablet_manager.cc:1403] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.019s
I20260709 13:09:03.270041 24682 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.270669 24682 ts_tablet_manager.cc:1403] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.001s
I20260709 13:09:03.273608 24687 raft_consensus.cc:493] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.273923 24682 raft_consensus.cc:359] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.274720 24682 raft_consensus.cc:385] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.274345 24687 raft_consensus.cc:515] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.275017 24682 raft_consensus.cc:740] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.276139 24682 consensus_queue.cc:260] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.276558 24706 raft_consensus.cc:515] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.278580 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.278750 24687 leader_election.cc:290] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.279371 24566 raft_consensus.cc:2468] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in term 0.
I20260709 13:09:03.272377 24681 raft_consensus.cc:359] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.280222 24681 raft_consensus.cc:385] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.280607 24681 raft_consensus.cc:740] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.281474 24681 consensus_queue.cc:260] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.285034 24455 leader_election.cc:304] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:03.287945 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.289673 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:03.290549 24566 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:03.290729 24456 leader_election.cc:343] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.292835 24387 catalog_manager.cc:5697] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.294261 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
W20260709 13:09:03.295861 24606 leader_election.cc:343] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.296670 24687 raft_consensus.cc:2804] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.297109 24687 raft_consensus.cc:493] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.297407 24687 raft_consensus.cc:3060] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.302390 24681 ts_tablet_manager.cc:1434] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:09:03.303342 24706 leader_election.cc:290] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:03.306236 24566 raft_consensus.cc:2468] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:03.307085 24681 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:03.307647 24604 leader_election.cc:304] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.308986 24706 raft_consensus.cc:2804] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.309727 24706 raft_consensus.cc:697] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:03.310694 24706 consensus_queue.cc:237] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.313369 24682 ts_tablet_manager.cc:1434] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.042s	user 0.015s	sys 0.018s
I20260709 13:09:03.305897 24687 raft_consensus.cc:515] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.314703 24682 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:03.316962 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:03.317517 24680 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.317648 24566 raft_consensus.cc:3060] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.318261 24680 ts_tablet_manager.cc:1403] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.004s
I20260709 13:09:03.319936 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:03.321894 24682 tablet_bootstrap.cc:654] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:03.322079 24456 leader_election.cc:343] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.320467 24687 leader_election.cc:290] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 election: Requested vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.324406 24680 raft_consensus.cc:359] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.325284 24680 raft_consensus.cc:385] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.325606 24680 raft_consensus.cc:740] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.326592 24680 consensus_queue.cc:260] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.327242 24681 tablet_bootstrap.cc:654] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.329231 24680 ts_tablet_manager.cc:1434] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:03.329229 24566 raft_consensus.cc:2468] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in term 1.
I20260709 13:09:03.330826 24680 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:03.330967 24455 leader_election.cc:304] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 05b14d8480174a549bf0b073b61b5671
I20260709 13:09:03.332321 24687 raft_consensus.cc:2804] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.332828 24687 raft_consensus.cc:697] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 LEADER]: Becoming Leader. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Running, Role: LEADER
I20260709 13:09:03.333726 24687 consensus_queue.cc:237] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.339627 24680 tablet_bootstrap.cc:654] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.355368 24681 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.355827 24682 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.356086 24681 ts_tablet_manager.cc:1403] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.015s
I20260709 13:09:03.356470 24682 ts_tablet_manager.cc:1403] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.008s
I20260709 13:09:03.359088 24388 catalog_manager.cc:5697] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.359757 24681 raft_consensus.cc:359] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.360083 24682 raft_consensus.cc:359] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.360674 24681 raft_consensus.cc:385] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.360855 24682 raft_consensus.cc:385] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.361073 24681 raft_consensus.cc:740] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.361294 24682 raft_consensus.cc:740] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.362166 24681 consensus_queue.cc:260] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.362293 24682 consensus_queue.cc:260] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.365165 24682 ts_tablet_manager.cc:1434] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:03.366238 24682 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:03.367841 24681 ts_tablet_manager.cc:1434] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:09:03.369017 24681 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:03.374063 24682 tablet_bootstrap.cc:654] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.365547 24387 catalog_manager.cc:5697] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.382459 24681 tablet_bootstrap.cc:654] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.384791 24680 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.385565 24680 ts_tablet_manager.cc:1403] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.017s
I20260709 13:09:03.389832 24706 raft_consensus.cc:493] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.390379 24706 raft_consensus.cc:515] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.392807 24706 leader_election.cc:290] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755)
I20260709 13:09:03.391752 24682 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.391660 24680 raft_consensus.cc:359] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.395445 24681 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.402740 24682 ts_tablet_manager.cc:1403] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.013s
I20260709 13:09:03.396226 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d27045940a4318ba74a8ab449a21b7" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:03.403188 24681 ts_tablet_manager.cc:1403] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.003s
I20260709 13:09:03.393743 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d27045940a4318ba74a8ab449a21b7" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.404290 24566 raft_consensus.cc:2468] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 0.
W20260709 13:09:03.404417 24606 leader_election.cc:343] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.402766 24680 raft_consensus.cc:385] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.405646 24680 raft_consensus.cc:740] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.405723 24604 leader_election.cc:304] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.406414 24682 raft_consensus.cc:359] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.406553 24680 consensus_queue.cc:260] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.406792 24681 raft_consensus.cc:359] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.407298 24682 raft_consensus.cc:385] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.407317 24706 raft_consensus.cc:2804] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.407856 24682 raft_consensus.cc:740] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.407881 24681 raft_consensus.cc:385] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.407963 24706 raft_consensus.cc:493] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.408622 24681 raft_consensus.cc:740] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.408684 24706 raft_consensus.cc:3060] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.408802 24682 consensus_queue.cc:260] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.411568 24682 ts_tablet_manager.cc:1434] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:09:03.412732 24682 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:03.417781 24680 ts_tablet_manager.cc:1434] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 13:09:03.417711 24706 raft_consensus.cc:515] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.419929 24682 tablet_bootstrap.cc:654] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.420960 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d27045940a4318ba74a8ab449a21b7" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:03.421612 24566 raft_consensus.cc:3060] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.421975 24688 raft_consensus.cc:493] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.422487 24688 raft_consensus.cc:515] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.424854 24688 leader_election.cc:290] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.426930 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:03.428503 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.429266 24640 raft_consensus.cc:2468] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 0.
I20260709 13:09:03.430648 24531 leader_election.cc:304] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:03.409896 24681 consensus_queue.cc:260] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.431838 24688 raft_consensus.cc:2804] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.432224 24688 raft_consensus.cc:493] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.432638 24688 raft_consensus.cc:3060] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:03.440200 24532 leader_election.cc:343] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.441273 24566 raft_consensus.cc:2468] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:03.441659 24687 raft_consensus.cc:493] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.442165 24687 raft_consensus.cc:515] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.442725 24604 leader_election.cc:304] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:03.443317 24680 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:03.443713 24686 raft_consensus.cc:2804] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.444254 24686 raft_consensus.cc:697] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:03.445161 24686 consensus_queue.cc:237] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.447085 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
W20260709 13:09:03.448889 24455 leader_election.cc:343] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.450132 24681 ts_tablet_manager.cc:1434] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 13:09:03.450675 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.451702 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d27045940a4318ba74a8ab449a21b7" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:03.449950 24687 leader_election.cc:290] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
W20260709 13:09:03.453615 24456 leader_election.cc:343] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.454077 24456 leader_election.cc:304] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760
W20260709 13:09:03.455367 24606 leader_election.cc:343] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.456086 24687 raft_consensus.cc:2749] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.456967 24706 leader_election.cc:290] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Requested vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755)
I20260709 13:09:03.458823 24680 tablet_bootstrap.cc:654] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.459129 24687 raft_consensus.cc:493] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.460872 24681 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:03.464442 24687 raft_consensus.cc:515] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.468793 24687 leader_election.cc:290] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.469671 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.470561 24566 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in term 0.
I20260709 13:09:03.471227 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.472298 24455 leader_election.cc:304] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:03.472595 24682 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.473675 24682 ts_tablet_manager.cc:1403] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.037s
I20260709 13:09:03.472208 24640 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in term 0.
I20260709 13:09:03.474301 24687 raft_consensus.cc:2804] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.473228 24387 catalog_manager.cc:5697] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.476111 24688 raft_consensus.cc:515] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.474800 24687 raft_consensus.cc:493] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.477072 24687 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.477404 24682 raft_consensus.cc:359] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.481940 24688 leader_election.cc:290] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.490029 24682 raft_consensus.cc:385] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.481830 24681 tablet_bootstrap.cc:654] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.490579 24682 raft_consensus.cc:740] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.484448 24680 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.491446 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:03.481994 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:03.491684 24682 consensus_queue.cc:260] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.492100 24680 ts_tablet_manager.cc:1403] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.001s
W20260709 13:09:03.493410 24532 leader_election.cc:343] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.492118 24640 raft_consensus.cc:3060] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.497846 24682 ts_tablet_manager.cc:1434] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.004s
I20260709 13:09:03.499090 24682 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:03.498801 24680 raft_consensus.cc:359] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.500229 24680 raft_consensus.cc:385] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.500725 24680 raft_consensus.cc:740] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.502002 24680 consensus_queue.cc:260] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.487483 24687 raft_consensus.cc:515] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.510665 24680 ts_tablet_manager.cc:1434] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 13:09:03.511816 24680 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:03.512574 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:03.513288 24566 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.514156 24687 leader_election.cc:290] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 election: Requested vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.514313 24681 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.515730 24681 ts_tablet_manager.cc:1403] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.012s
I20260709 13:09:03.516399 24640 raft_consensus.cc:2468] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 1.
I20260709 13:09:03.517675 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:03.518608 24639 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.520507 24681 raft_consensus.cc:359] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.521075 24682 tablet_bootstrap.cc:654] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.521359 24681 raft_consensus.cc:385] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.521804 24681 raft_consensus.cc:740] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.522643 24681 consensus_queue.cc:260] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.523141 24680 tablet_bootstrap.cc:654] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.523739 24531 leader_election.cc:304] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.525210 24688 raft_consensus.cc:2804] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.525609 24681 ts_tablet_manager.cc:1434] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:03.525821 24688 raft_consensus.cc:697] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:03.526587 24681 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:03.527012 24688 consensus_queue.cc:237] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.534937 24681 tablet_bootstrap.cc:654] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.564774 24723 raft_consensus.cc:493] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.566051 24723 raft_consensus.cc:515] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.570493 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:03.571067 24723 leader_election.cc:290] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.571476 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
W20260709 13:09:03.572211 24532 leader_election.cc:343] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.572510 24640 raft_consensus.cc:2468] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 0.
I20260709 13:09:03.574478 24531 leader_election.cc:304] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.576280 24723 raft_consensus.cc:2804] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.576853 24723 raft_consensus.cc:493] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.577301 24723 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.589789 24687 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.590483 24687 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.592954 24687 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.595151 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.595974 24565 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in term 0.
I20260709 13:09:03.597193 24566 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in term 1.
I20260709 13:09:03.599154 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.600379 24639 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in term 1.
I20260709 13:09:03.601150 24455 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:03.602228 24455 leader_election.cc:304] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:03.603224 24711 raft_consensus.cc:2804] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.603619 24711 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.603927 24711 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.606213 24723 raft_consensus.cc:515] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
W20260709 13:09:03.609328 24456 leader_election.cc:343] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.610280 24687 raft_consensus.cc:2804] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.614076 24388 catalog_manager.cc:5697] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 0 to 1, leader changed from <none> to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.622112 24711 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.628021 24686 raft_consensus.cc:493] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.628861 24686 raft_consensus.cc:515] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.632009 24686 leader_election.cc:290] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:03.633041 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:03.637184 24687 raft_consensus.cc:697] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 LEADER]: Becoming Leader. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Running, Role: LEADER
I20260709 13:09:03.639086 24687 consensus_queue.cc:237] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.648227 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:03.649030 24565 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.649360 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.650265 24566 raft_consensus.cc:2393] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05b14d8480174a549bf0b073b61b5671 in current term 1: Already voted for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in this term.
I20260709 13:09:03.651564 24604 leader_election.cc:304] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671; no voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.652982 24686 raft_consensus.cc:3060] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.666429 24686 raft_consensus.cc:2749] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.669245 24387 catalog_manager.cc:5697] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.670857 24681 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.671530 24681 ts_tablet_manager.cc:1403] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.145s	user 0.053s	sys 0.061s
I20260709 13:09:03.673483 24565 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7e2e833c5e44f8888a97ea1f857a81 in term 1.
I20260709 13:09:03.674875 24455 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:03.675962 24687 raft_consensus.cc:2804] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.676604 24687 raft_consensus.cc:697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 LEADER]: Becoming Leader. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Running, Role: LEADER
I20260709 13:09:03.677647 24680 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.678308 24680 ts_tablet_manager.cc:1403] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.167s	user 0.038s	sys 0.083s
I20260709 13:09:03.677857 24687 consensus_queue.cc:237] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.674932 24681 raft_consensus.cc:359] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.679527 24681 raft_consensus.cc:385] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.679859 24681 raft_consensus.cc:740] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.680701 24681 consensus_queue.cc:260] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.683449 24723 leader_election.cc:290] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.685077 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:03.685966 24639 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.687418 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
W20260709 13:09:03.689244 24532 leader_election.cc:343] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.697376 24680 raft_consensus.cc:359] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.698217 24680 raft_consensus.cc:385] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.698494 24680 raft_consensus.cc:740] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.699311 24680 consensus_queue.cc:260] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.698565 24681 ts_tablet_manager.cc:1434] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:09:03.700583 24682 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.701120 24682 ts_tablet_manager.cc:1403] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.202s	user 0.032s	sys 0.041s
I20260709 13:09:03.701272 24681 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760: Bootstrap starting.
I20260709 13:09:03.701869 24680 ts_tablet_manager.cc:1434] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 13:09:03.702838 24680 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:03.699967 24639 raft_consensus.cc:2468] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 1.
I20260709 13:09:03.707471 24531 leader_election.cc:304] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:03.708377 24681 tablet_bootstrap.cc:654] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.708174 24682 raft_consensus.cc:359] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.708818 24723 raft_consensus.cc:2804] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.709031 24682 raft_consensus.cc:385] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.709364 24682 raft_consensus.cc:740] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.709407 24723 raft_consensus.cc:697] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:03.709800 24680 tablet_bootstrap.cc:654] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.710711 24723 consensus_queue.cc:237] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.721190 24386 catalog_manager.cc:5697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.722388 24681 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760: No bootstrap required, opened a new log
I20260709 13:09:03.723253 24681 ts_tablet_manager.cc:1403] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:09:03.725363 24686 consensus_queue.cc:1048] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:03.725512 24687 raft_consensus.cc:493] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.731276 24687 raft_consensus.cc:515] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:03.734547 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d27045940a4318ba74a8ab449a21b7" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.734867 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d27045940a4318ba74a8ab449a21b7" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.735756 24566 raft_consensus.cc:2393] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b7e2e833c5e44f8888a97ea1f857a81 in current term 1: Already voted for candidate 05b14d8480174a549bf0b073b61b5671 in this term.
I20260709 13:09:03.739188 24680 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.740070 24680 ts_tablet_manager.cc:1403] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.000s
I20260709 13:09:03.739197 24681 raft_consensus.cc:359] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.740815 24681 raft_consensus.cc:385] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.741259 24681 raft_consensus.cc:740] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.742621 24455 leader_election.cc:304] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:03.743148 24680 raft_consensus.cc:359] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.743934 24680 raft_consensus.cc:385] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.744220 24680 raft_consensus.cc:740] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.744706 24682 consensus_queue.cc:260] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.745445 24680 consensus_queue.cc:260] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.742652 24681 consensus_queue.cc:260] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.747900 24680 ts_tablet_manager.cc:1434] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:09:03.748369 24606 consensus_peers.cc:597] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.749037 24681 ts_tablet_manager.cc:1434] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:09:03.749092 24680 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671: Bootstrap starting.
I20260709 13:09:03.749437 24731 raft_consensus.cc:3060] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.756820 24680 tablet_bootstrap.cc:654] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.769359 24706 consensus_queue.cc:1048] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:03.774783 24687 leader_election.cc:290] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:03.775645 24738 consensus_queue.cc:1048] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:03.778719 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:03.785432 24738 raft_consensus.cc:493] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.786556 24738 raft_consensus.cc:515] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.788157 24686 consensus_queue.cc:1048] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:03.791002 24456 leader_election.cc:343] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.791361 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:03.798260 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:03.799278 24639 raft_consensus.cc:2393] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b7e2e833c5e44f8888a97ea1f857a81 in current term 1: Already voted for candidate 150065cf33f74c949a60e9fd3dc57760 in this term.
I20260709 13:09:03.801808 24456 leader_election.cc:304] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:03.809394 24738 leader_election.cc:290] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.811226 24738 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.812232 24388 catalog_manager.cc:5697] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 0 to 1, leader changed from <none> to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.822506 24682 ts_tablet_manager.cc:1434] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.000s
I20260709 13:09:03.824806 24738 raft_consensus.cc:2749] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.847383 24711 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 election: Requested vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:03.824898 24682 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
W20260709 13:09:03.865473 24456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.245.67:40295, user_credentials={real_user=slave}} blocked reactor thread for 63787.8us
I20260709 13:09:03.868535 24746 consensus_queue.cc:1048] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:03.877671 24731 raft_consensus.cc:2749] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.879103 24682 tablet_bootstrap.cc:654] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.886617 24680 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671: No bootstrap required, opened a new log
I20260709 13:09:03.887321 24680 ts_tablet_manager.cc:1403] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671: Time spent bootstrapping tablet: real 0.138s	user 0.044s	sys 0.080s
I20260709 13:09:03.891781 24680 raft_consensus.cc:359] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.892604 24680 raft_consensus.cc:385] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.892951 24680 raft_consensus.cc:740] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.893945 24680 consensus_queue.cc:260] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.896858 24680 ts_tablet_manager.cc:1434] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:03.905887 24682 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.906524 24682 ts_tablet_manager.cc:1403] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.005s
I20260709 13:09:03.909053 24706 consensus_queue.cc:1048] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:03.909619 24682 raft_consensus.cc:359] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.910359 24682 raft_consensus.cc:385] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.910645 24682 raft_consensus.cc:740] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.911401 24682 consensus_queue.cc:260] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.913811 24682 ts_tablet_manager.cc:1434] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:03.915302 24682 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:03.922269 24682 tablet_bootstrap.cc:654] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.930500 24705 consensus_queue.cc:1048] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:03.945768 24682 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: No bootstrap required, opened a new log
I20260709 13:09:03.946542 24682 ts_tablet_manager.cc:1403] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.012s
I20260709 13:09:03.949388 24682 raft_consensus.cc:359] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.949973 24682 raft_consensus.cc:385] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.950204 24682 raft_consensus.cc:740] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.950829 24682 consensus_queue.cc:260] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:03.952548 24682 ts_tablet_manager.cc:1434] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:04.000279 24723 consensus_queue.cc:1048] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.010973 24490 raft_consensus.cc:3060] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.021334 24756 consensus_queue.cc:1048] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:04.057426 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:04.059211 24705 raft_consensus.cc:493] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.059794 24705 raft_consensus.cc:515] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.061647 24705 leader_election.cc:290] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:04.062682 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:04.062798 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:04.063501 24490 raft_consensus.cc:2468] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 0.
I20260709 13:09:04.063733 24565 raft_consensus.cc:2468] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 0.
I20260709 13:09:04.064677 24606 leader_election.cc:304] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:04.065469 24705 raft_consensus.cc:2804] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:04.065843 24705 raft_consensus.cc:493] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.066085 24705 raft_consensus.cc:3060] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.069828 24731 consensus_queue.cc:1048] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.073149 24705 raft_consensus.cc:515] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.075330 24705 leader_election.cc:290] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:04.076531 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:04.076644 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:04.077380 24565 raft_consensus.cc:3060] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.077457 24490 raft_consensus.cc:3060] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.082948 24738 consensus_queue.cc:1048] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.087075 24705 raft_consensus.cc:493] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.087602 24757 raft_consensus.cc:493] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.088192 24757 raft_consensus.cc:515] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.087337 24565 raft_consensus.cc:2468] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:04.087757 24705 raft_consensus.cc:515] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.091822 24490 raft_consensus.cc:2468] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:04.092239 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:04.093065 24640 raft_consensus.cc:2468] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 0.
I20260709 13:09:04.093284 24606 leader_election.cc:304] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:04.094280 24686 raft_consensus.cc:2804] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:04.094782 24686 raft_consensus.cc:697] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:04.095203 24705 leader_election.cc:290] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:04.095279 24491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:04.095467 24531 leader_election.cc:304] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:04.095697 24686 consensus_queue.cc:237] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.098578 24491 raft_consensus.cc:2468] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 0.
I20260709 13:09:04.098922 24756 raft_consensus.cc:2804] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:04.099364 24756 raft_consensus.cc:493] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.099747 24756 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.096590 24757 leader_election.cc:290] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:04.097540 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:04.097728 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:04.101786 24606 leader_election.cc:304] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:04.102327 24490 raft_consensus.cc:2468] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 0.
I20260709 13:09:04.104393 24705 raft_consensus.cc:2804] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:04.105010 24705 raft_consensus.cc:493] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.106848 24705 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.114547 24738 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.113986 24388 catalog_manager.cc:5697] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.121058 24756 raft_consensus.cc:515] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.121600 24705 raft_consensus.cc:515] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.122645 24565 raft_consensus.cc:2393] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05b14d8480174a549bf0b073b61b5671 in current term 1: Already voted for candidate 150065cf33f74c949a60e9fd3dc57760 in this term.
I20260709 13:09:04.125555 24705 leader_election.cc:290] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:04.126598 24490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:04.127274 24490 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.128324 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:04.129189 24565 raft_consensus.cc:2393] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 05b14d8480174a549bf0b073b61b5671 in current term 1: Already voted for candidate 150065cf33f74c949a60e9fd3dc57760 in this term.
I20260709 13:09:04.130522 24756 leader_election.cc:290] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:04.132550 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:04.132951 24705 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.133533 24640 raft_consensus.cc:2393] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 150065cf33f74c949a60e9fd3dc57760 in current term 1: Already voted for candidate 05b14d8480174a549bf0b073b61b5671 in this term.
I20260709 13:09:04.133545 24705 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.132414 24491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:04.136247 24705 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:04.136169 24490 raft_consensus.cc:2468] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:04.136475 24532 leader_election.cc:304] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760; no voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:04.137503 24756 raft_consensus.cc:2749] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:04.137874 24606 leader_election.cc:304] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:04.142163 24705 raft_consensus.cc:2804] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:04.143378 24640 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.143513 24705 raft_consensus.cc:697] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:04.145088 24705 consensus_queue.cc:237] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.138846 24491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" is_pre_election: true
I20260709 13:09:04.139216 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:04.151407 24604 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671; no voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:04.156911 24686 raft_consensus.cc:2749] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:04.158545 24738 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:04.159801 24389 catalog_manager.cc:5697] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.196889 24738 raft_consensus.cc:493] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.197530 24738 raft_consensus.cc:515] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:04.199478 24738 leader_election.cc:290] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:04.200392 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:04.200703 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:04.202811 24456 leader_election.cc:304] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:04.203747 24738 raft_consensus.cc:2749] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:04.204804 24756 consensus_queue.cc:1048] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.215883 24757 consensus_queue.cc:1048] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.310334 24491 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.383865 14293 ts_manager.cc:295] Set tserver state for 3b7e2e833c5e44f8888a97ea1f857a81 to MAINTENANCE_MODE
I20260709 13:09:04.384729 14293 tablet_server.cc:179] TabletServer@127.13.245.65:0 shutting down...
W20260709 13:09:04.406831 24606 consensus_peers.cc:597] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.415985 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:04.417068 14293 tablet_replica.cc:333] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.417770 14293 raft_consensus.cc:2243] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.418427 14293 raft_consensus.cc:2272] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.420989 14293 tablet_replica.cc:333] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.421602 14293 raft_consensus.cc:2243] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.422050 14293 raft_consensus.cc:2272] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.424700 14293 tablet_replica.cc:333] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.425345 14293 raft_consensus.cc:2243] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.425781 14293 raft_consensus.cc:2272] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.428656 14293 tablet_replica.cc:333] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.429260 14293 raft_consensus.cc:2243] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.430100 14293 raft_consensus.cc:2272] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.432744 14293 tablet_replica.cc:333] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.433552 14293 raft_consensus.cc:2243] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.434449 14293 raft_consensus.cc:2272] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.436708 14293 tablet_replica.cc:333] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.437229 14293 raft_consensus.cc:2243] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.437589 14293 raft_consensus.cc:2272] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.439957 14293 tablet_replica.cc:333] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.440491 14293 raft_consensus.cc:2243] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.441322 14293 raft_consensus.cc:2272] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.443497 14293 tablet_replica.cc:333] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.444104 14293 raft_consensus.cc:2243] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.444535 14293 raft_consensus.cc:2272] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.446645 14293 tablet_replica.cc:333] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.447181 14293 raft_consensus.cc:2243] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.447597 14293 raft_consensus.cc:2272] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.449406 14293 tablet_replica.cc:333] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: stopping tablet replica
I20260709 13:09:04.449916 14293 raft_consensus.cc:2243] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.450304 14293 raft_consensus.cc:2272] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.481988 14293 tablet_server.cc:196] TabletServer@127.13.245.65:0 shutdown complete.
W20260709 13:09:04.500315 24532 consensus_peers.cc:597] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.553786 24606 consensus_peers.cc:597] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.581954 24606 consensus_peers.cc:597] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.672032 24606 consensus_peers.cc:597] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.674780 24686 consensus_queue.cc:1048] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.688961 24706 consensus_queue.cc:1048] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:04.769110 24606 consensus_peers.cc:597] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.803320 24532 consensus_peers.cc:597] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.934216 24606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111) [suppressed 140 similar messages]
W20260709 13:09:05.058604 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:05.581305 24705 raft_consensus.cc:493] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
I20260709 13:09:05.581975 24705 raft_consensus.cc:515] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.583849 24705 leader_election.cc:290] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:05.585073 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:05.587517 24688 raft_consensus.cc:493] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
W20260709 13:09:05.587625 24606 leader_election.cc:336] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.588227 24606 leader_election.cc:304] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671; no voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:05.588182 24688 raft_consensus.cc:515] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.589164 24705 raft_consensus.cc:2749] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.590457 24688 leader_election.cc:290] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:05.591696 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
I20260709 13:09:05.592463 24640 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 1.
I20260709 13:09:05.593701 24531 leader_election.cc:304] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:05.594411 24688 raft_consensus.cc:2804] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:05.594800 24688 raft_consensus.cc:493] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
I20260709 13:09:05.595184 24688 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:05.595085 24532 leader_election.cc:336] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.601740 24688 raft_consensus.cc:515] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.603678 24688 leader_election.cc:290] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:05.605090 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:05.605919 24640 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:05.608326 24532 leader_election.cc:336] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.614073 24640 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:05.616144 24531 leader_election.cc:304] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:05.617278 24688 raft_consensus.cc:2804] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:05.617779 24688 raft_consensus.cc:697] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:05.618685 24688 consensus_queue.cc:237] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.625851 24388 catalog_manager.cc:5697] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 1 to 2, leader changed from 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.644639 24688 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
I20260709 13:09:05.645375 24688 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.647248 24688 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:05.648564 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
W20260709 13:09:05.651437 24532 leader_election.cc:336] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.651944 24532 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760; no voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:05.652783 24688 raft_consensus.cc:2749] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.662948 24705 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
I20260709 13:09:05.663786 24705 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.665719 24705 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:05.667013 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:05.667763 24565 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:05.668890 24604 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:05.669723 24705 raft_consensus.cc:2804] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:05.669999 24606 leader_election.cc:336] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.670053 24705 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
I20260709 13:09:05.670619 24705 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:05.676476 24705 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.678257 24705 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:05.679494 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:05.680284 24565 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:05.682435 24606 leader_election.cc:336] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.686764 24565 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 2.
I20260709 13:09:05.687995 24604 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:05.688769 24705 raft_consensus.cc:2804] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:05.689329 24705 raft_consensus.cc:697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:05.690119 24705 consensus_queue.cc:237] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.698206 24388 catalog_manager.cc:5697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 1 to 2, leader changed from 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65) to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.759508 24688 raft_consensus.cc:493] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
I20260709 13:09:05.760144 24688 raft_consensus.cc:515] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.762380 24688 leader_election.cc:290] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:05.763705 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05b14d8480174a549bf0b073b61b5671" is_pre_election: true
W20260709 13:09:05.766762 24532 leader_election.cc:336] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.767153 24532 leader_election.cc:304] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760; no voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:05.767951 24688 raft_consensus.cc:2749] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.899287 24706 raft_consensus.cc:493] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
I20260709 13:09:05.899915 24706 raft_consensus.cc:515] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.901847 24706 leader_election.cc:290] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:05.903088 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760" is_pre_election: true
I20260709 13:09:05.903959 24565 raft_consensus.cc:2468] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 1.
I20260709 13:09:05.904896 24604 leader_election.cc:304] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:05.905598 24706 raft_consensus.cc:2804] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:05.906028 24706 raft_consensus.cc:493] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3b7e2e833c5e44f8888a97ea1f857a81)
W20260709 13:09:05.906075 24606 leader_election.cc:336] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.906417 24706 raft_consensus.cc:3060] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:05.912160 24706 raft_consensus.cc:515] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.913854 24706 leader_election.cc:290] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:05.915158 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef231923f484e1084b05db8b9a51bae" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:05.915856 24565 raft_consensus.cc:3060] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:05.918047 24606 leader_election.cc:336] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111)
I20260709 13:09:05.922899 24565 raft_consensus.cc:2468] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 2.
I20260709 13:09:05.924291 24604 leader_election.cc:304] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 3b7e2e833c5e44f8888a97ea1f857a81
I20260709 13:09:05.925123 24706 raft_consensus.cc:2804] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:05.925614 24706 raft_consensus.cc:697] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:05.926355 24706 consensus_queue.cc:237] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:05.934010 24388 catalog_manager.cc:5697] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 1 to 2, leader changed from 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65) to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:06.059947 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:06.067242 24640 raft_consensus.cc:1275] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:06.069197 24688 consensus_queue.cc:1048] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:06.084509 24532 consensus_peers.cc:597] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:06.302816 24606 consensus_peers.cc:597] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:06.315160 24565 raft_consensus.cc:1275] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:06.316627 24705 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:06.319885 24564 raft_consensus.cc:1275] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:06.322500 24705 consensus_queue.cc:1048] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:06.340794 24606 consensus_peers.cc:597] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:06.975999 24532 consensus_peers.cc:597] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.054579 24606 consensus_peers.cc:597] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.061040 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:07.166141 24606 consensus_peers.cc:597] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.250762 24606 consensus_peers.cc:597] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.264201 24606 consensus_peers.cc:597] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.517001 24606 consensus_peers.cc:597] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.592504 24532 consensus_peers.cc:597] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:08.089905 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:08.485898 24532 consensus_peers.cc:597] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:08.793351 24606 consensus_peers.cc:597] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:08.827900 24606 consensus_peers.cc:597] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:09.254805 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:09.550643 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.560442 24795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.560626 24796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.569322 14293 server_base.cc:1061] running on GCE node
W20260709 13:09:09.569360 24798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.571666 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.571938 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.572149 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602549572130 us; error 0 us; skew 500 ppm
I20260709 13:09:09.572786 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.576426 14293 webserver.cc:533] Webserver started at http://127.13.245.65:41853/ using document root <none> and password file <none>
I20260709 13:09:09.577072 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.577320 14293 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:09.581782 14293 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:09:09.587131 24803 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.588122 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:09:09.588474 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-fc6v"
I20260709 13:09:09.588999 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.609263 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.610775 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.613323 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.619807 24810 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:09:09.649279 24606 consensus_peers.cc:597] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.663199 24532 consensus_peers.cc:597] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.684834 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:09:09.685321 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.067s	user 0.004s	sys 0.000s
I20260709 13:09:09.685662 14293 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:09:09.693573 24810 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.714082 24810 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.715183 24810 tablet_bootstrap.cc:492] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.716116 24810 ts_tablet_manager.cc:1403] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:09:09.719600 24810 raft_consensus.cc:359] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.720721 24810 raft_consensus.cc:740] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.721566 24810 consensus_queue.cc:260] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.724678 24810 ts_tablet_manager.cc:1434] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:09:09.725559 24810 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.744477 24810 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.745604 24810 tablet_bootstrap.cc:492] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.746338 24810 ts_tablet_manager.cc:1403] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.002s
I20260709 13:09:09.749481 24810 raft_consensus.cc:359] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.750313 24810 raft_consensus.cc:740] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.751173 24810 consensus_queue.cc:260] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
W20260709 13:09:09.752344 24606 consensus_peers.cc:597] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.753911 24810 ts_tablet_manager.cc:1434] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:09.755111 24810 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.763897 14293 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:09:09.764405 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.079s	user 0.072s	sys 0.007s
W20260709 13:09:09.765986 24606 consensus_peers.cc:597] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.774304 24606 consensus_peers.cc:597] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.775046 24810 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.776121 24810 tablet_bootstrap.cc:492] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.776935 24810 ts_tablet_manager.cc:1403] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:09:09.781169 24810 raft_consensus.cc:359] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.782083 24810 raft_consensus.cc:740] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.782931 24810 consensus_queue.cc:260] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.785642 24810 ts_tablet_manager.cc:1434] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:09:09.786651 24810 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.806334 24810 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.807582 24810 tablet_bootstrap.cc:492] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.808743 24810 ts_tablet_manager.cc:1403] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.004s
I20260709 13:09:09.811923 24810 raft_consensus.cc:359] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.812875 24810 raft_consensus.cc:740] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.813880 24810 consensus_queue.cc:260] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.816133 24810 ts_tablet_manager.cc:1434] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:09.816923 24810 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.833078 24810 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.834007 24810 tablet_bootstrap.cc:492] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.834862 24810 ts_tablet_manager.cc:1403] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:09:09.837391 24810 raft_consensus.cc:359] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:09.837664 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:38755
I20260709 13:09:09.837826 24872 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:38755 every 8 connection(s)
I20260709 13:09:09.838157 24810 raft_consensus.cc:740] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.839161 24810 consensus_queue.cc:260] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } }
I20260709 13:09:09.841005 24810 ts_tablet_manager.cc:1434] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:09.842088 24810 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.844221 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:09.864073 24810 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.865638 24810 tablet_bootstrap.cc:492] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.866641 24810 ts_tablet_manager.cc:1403] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.006s
I20260709 13:09:09.871182 24810 raft_consensus.cc:359] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.872083 24810 raft_consensus.cc:740] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.873021 24810 consensus_queue.cc:260] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.876713 24810 ts_tablet_manager.cc:1434] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.006s
I20260709 13:09:09.877327 24873 heartbeater.cc:344] Connected to a master server at 127.13.245.126:35371
I20260709 13:09:09.877748 24810 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.877949 24873 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:09.879271 24873 heartbeater.cc:507] Master 127.13.245.126:35371 requested a full tablet report, sending...
I20260709 13:09:09.889032 24389 ts_manager.cc:194] Re-registered known tserver with Master: 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755)
I20260709 13:09:09.889410 24639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
mode: GRACEFUL
new_leader_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:09:09.890442 24639 raft_consensus.cc:606] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Received request to transfer leadership to TS 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:09.894337 24639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
mode: GRACEFUL
new_leader_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:09:09.895318 24639 raft_consensus.cc:606] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Received request to transfer leadership to TS 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:09.900380 24810 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.902154 24810 tablet_bootstrap.cc:492] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.903112 24810 ts_tablet_manager.cc:1403] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.004s
I20260709 13:09:09.907181 24810 raft_consensus.cc:359] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.908900 24810 raft_consensus.cc:740] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.909418 24389 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33186
I20260709 13:09:09.909730 24810 consensus_queue.cc:260] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.910044 24639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
mode: GRACEFUL
new_leader_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:09:09.910784 24639 raft_consensus.cc:606] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Received request to transfer leadership to TS 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:09.912257 24810 ts_tablet_manager.cc:1434] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:09:09.913326 24810 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.913362 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:09.913970 24873 heartbeater.cc:499] Master 127.13.245.126:35371 was elected leader, sending a full tablet report...
I20260709 13:09:09.914136 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:09.914990 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:09.930467 24810 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.931526 24810 tablet_bootstrap.cc:492] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.932363 24810 ts_tablet_manager.cc:1403] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:09:09.935176 24810 raft_consensus.cc:359] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.935863 24810 raft_consensus.cc:740] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.936437 24810 consensus_queue.cc:260] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.938344 24810 ts_tablet_manager.cc:1434] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:09.939313 24810 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
W20260709 13:09:09.952749 24420 debug-util.cc:398] Leaking SignalData structure 0x7b0800174120 after lost signal to thread 14296
W20260709 13:09:09.954967 24420 debug-util.cc:398] Leaking SignalData structure 0x7b0800102520 after lost signal to thread 24590
I20260709 13:09:09.955250 24810 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.956270 24810 tablet_bootstrap.cc:492] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.956938 24810 ts_tablet_manager.cc:1403] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:09:09.959266 24810 raft_consensus.cc:359] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.960003 24810 raft_consensus.cc:740] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.960700 24810 consensus_queue.cc:260] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.962644 24810 ts_tablet_manager.cc:1434] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:09.963793 24810 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap starting.
I20260709 13:09:09.983479 24810 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:09.984618 24810 tablet_bootstrap.cc:492] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Bootstrap complete.
I20260709 13:09:09.985316 24810 ts_tablet_manager.cc:1403] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:09:09.987608 24810 raft_consensus.cc:359] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.988385 24810 raft_consensus.cc:740] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7e2e833c5e44f8888a97ea1f857a81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.989245 24810 consensus_queue.cc:260] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:09.996587 24810 ts_tablet_manager.cc:1434] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:09:10.146812 24886 raft_consensus.cc:993] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671: : Instructing follower 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:10.147840 24791 raft_consensus.cc:1081] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Signalling peer 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:10.150698 24564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:35718
I20260709 13:09:10.151435 24564 raft_consensus.cc:493] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.151881 24564 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.161684 24564 raft_consensus.cc:515] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.164335 24564 leader_election.cc:290] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:10.165823 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:10.165563 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:10.166678 24639 raft_consensus.cc:3055] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.167080 24639 raft_consensus.cc:740] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:10.167164 24846 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.168193 24639 consensus_queue.cc:260] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.169458 24639 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.176453 24847 raft_consensus.cc:3060] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.179229 24639 raft_consensus.cc:2468] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:10.181464 24531 leader_election.cc:304] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:10.181704 24846 raft_consensus.cc:2468] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:10.182852 24784 raft_consensus.cc:2804] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.187166 24784 raft_consensus.cc:697] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:10.189388 24784 consensus_queue.cc:237] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.204015 24389 catalog_manager.cc:5697] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 1 to 2, leader changed from 05b14d8480174a549bf0b073b61b5671 (127.13.245.67) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.255323 24886 raft_consensus.cc:993] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671: : Instructing follower 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:10.255951 24886 raft_consensus.cc:1081] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Signalling peer 150065cf33f74c949a60e9fd3dc57760 to start an election
W20260709 13:09:10.257012 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:10.259696 24564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:35718
I20260709 13:09:10.260535 24564 raft_consensus.cc:493] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.260972 24564 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.271132 24564 raft_consensus.cc:515] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.274816 24847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:10.275558 24564 leader_election.cc:290] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:10.275533 24847 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.276288 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:10.276911 24639 raft_consensus.cc:3055] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.277251 24639 raft_consensus.cc:740] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:10.278270 24639 consensus_queue.cc:260] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.279873 24639 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.285528 24847 raft_consensus.cc:2468] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:10.287079 24532 leader_election.cc:304] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:10.288218 24784 raft_consensus.cc:2804] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.288790 24784 raft_consensus.cc:697] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:10.289613 24639 raft_consensus.cc:2468] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:10.289911 24784 consensus_queue.cc:237] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.300709 24389 catalog_manager.cc:5697] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 1 to 2, leader changed from 05b14d8480174a549bf0b073b61b5671 (127.13.245.67) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.416122 24886 raft_consensus.cc:993] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671: : Instructing follower 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:10.416711 24791 raft_consensus.cc:1081] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Signalling peer 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:10.417614 24847 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.418498 24564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:35718
I20260709 13:09:10.419100 24564 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.419463 24564 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.426064 24564 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.429502 24564 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 3 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:10.429404 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:10.430716 24846 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.439404 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:10.440302 24639 raft_consensus.cc:3055] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:10.440627 24639 raft_consensus.cc:740] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:10.442039 24639 consensus_queue.cc:260] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.444540 24639 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.448545 24846 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 3.
I20260709 13:09:10.450508 24532 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:10.451503 24784 raft_consensus.cc:2804] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:10.452076 24784 raft_consensus.cc:697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 3 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:10.453240 24784 consensus_queue.cc:237] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:10.455900 24639 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 3.
I20260709 13:09:10.465062 24389 catalog_manager.cc:5697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 2 to 3, leader changed from 05b14d8480174a549bf0b073b61b5671 (127.13.245.67) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 3 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.587443 24846 raft_consensus.cc:1275] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.589262 24887 consensus_queue.cc:1048] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.604974 24639 raft_consensus.cc:1275] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.611073 24784 consensus_queue.cc:1048] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.774006 24639 raft_consensus.cc:1275] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.775945 24902 consensus_queue.cc:1048] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.776464 24846 raft_consensus.cc:1275] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.778224 24902 consensus_queue.cc:1048] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.871794 24846 raft_consensus.cc:1275] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:10.873636 24902 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.879474 24639 raft_consensus.cc:1275] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:10.881953 24902 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:10.925134 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:10.948283 24565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
mode: GRACEFUL
new_leader_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:34844
I20260709 13:09:10.949008 24565 raft_consensus.cc:606] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Received request to transfer leadership to TS 05b14d8480174a549bf0b073b61b5671
I20260709 13:09:10.953392 24565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
mode: GRACEFUL
new_leader_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:34844
I20260709 13:09:10.954334 24565 raft_consensus.cc:606] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Received request to transfer leadership to TS 05b14d8480174a549bf0b073b61b5671
I20260709 13:09:10.956058 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:10.956909 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:10.957808 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:11.224666 24784 raft_consensus.cc:993] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760: : Instructing follower 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:11.225263 24902 raft_consensus.cc:1081] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Signalling peer 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:11.227385 24639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:33772
I20260709 13:09:11.228061 24639 raft_consensus.cc:493] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.228421 24639 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.237367 24639 raft_consensus.cc:515] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:11.239429 24639 leader_election.cc:290] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:11.240633 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:11.240899 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:11.241652 24846 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.241786 24564 raft_consensus.cc:3055] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.242427 24564 raft_consensus.cc:740] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:11.243346 24564 consensus_queue.cc:260] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:11.244776 24564 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.251106 24846 raft_consensus.cc:2468] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 2.
I20260709 13:09:11.251377 24564 raft_consensus.cc:2468] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 2.
I20260709 13:09:11.252847 24606 leader_election.cc:304] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:11.254242 24791 raft_consensus.cc:2804] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.254745 24791 raft_consensus.cc:697] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:11.256160 24791 consensus_queue.cc:237] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
W20260709 13:09:11.258306 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:11.267185 24387 catalog_manager.cc:5697] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 1 to 2, leader changed from 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66) to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.434340 24784 raft_consensus.cc:993] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760: : Instructing follower 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:11.435030 24902 raft_consensus.cc:1081] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Signalling peer 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:11.437290 24639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:33772
I20260709 13:09:11.438048 24639 raft_consensus.cc:493] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.438431 24639 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.445660 24639 raft_consensus.cc:515] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:11.449323 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:11.450733 24846 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.454443 24639 leader_election.cc:290] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 3 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:11.455826 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:11.456683 24564 raft_consensus.cc:3055] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:11.457103 24564 raft_consensus.cc:740] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:11.458314 24564 consensus_queue.cc:260] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:11.460156 24564 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.464501 24846 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 3.
I20260709 13:09:11.466046 24606 leader_election.cc:304] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:11.466952 24791 raft_consensus.cc:2804] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:11.467476 24791 raft_consensus.cc:697] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:11.468612 24791 consensus_queue.cc:237] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:11.472760 24564 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 3.
I20260709 13:09:11.479987 24387 catalog_manager.cc:5697] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 2 to 3, leader changed from 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66) to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.757859 24564 raft_consensus.cc:1275] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.759572 24886 consensus_queue.cc:1048] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.774513 24847 raft_consensus.cc:1275] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.787976 24791 consensus_queue.cc:1048] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:11.940750 24564 raft_consensus.cc:1275] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:11.942246 24919 consensus_queue.cc:1048] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.955297 24847 raft_consensus.cc:1275] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:11.958523 24920 consensus_queue.cc:1048] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:11.969722 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:11.985497 24639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
mode: GRACEFUL
new_leader_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:09:11.986112 24639 raft_consensus.cc:606] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Received request to transfer leadership to TS 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:11.989620 24564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
mode: GRACEFUL
new_leader_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:34844
I20260709 13:09:11.990427 24564 raft_consensus.cc:606] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Received request to transfer leadership to TS 05b14d8480174a549bf0b073b61b5671
I20260709 13:09:11.994217 24639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a65e3df81f4d30b28f8e77897a1525"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
mode: GRACEFUL
new_leader_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:09:11.994973 24639 raft_consensus.cc:606] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Received request to transfer leadership to TS 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:11.996452 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:11.997035 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:11.997730 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:12.060935 24886 raft_consensus.cc:993] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671: : Instructing follower 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:12.061702 24920 raft_consensus.cc:1081] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Signalling peer 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:12.063570 24564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:35718
I20260709 13:09:12.064289 24564 raft_consensus.cc:493] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.064692 24564 raft_consensus.cc:3060] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.073894 24564 raft_consensus.cc:515] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.076524 24564 leader_election.cc:290] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:12.077750 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:12.077783 24847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b9d94ad1e542f8b801427ae982c0ef" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:12.078775 24639 raft_consensus.cc:3055] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.079182 24639 raft_consensus.cc:740] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:12.079234 24847 raft_consensus.cc:3060] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.080407 24639 consensus_queue.cc:260] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.082018 24639 raft_consensus.cc:3060] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.088897 24847 raft_consensus.cc:2468] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:12.090582 24532 leader_election.cc:304] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:12.090845 24639 raft_consensus.cc:2468] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:12.091676 24902 raft_consensus.cc:2804] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.092885 24902 raft_consensus.cc:697] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:12.093954 24902 consensus_queue.cc:237] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.103446 24387 catalog_manager.cc:5697] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 1 to 2, leader changed from 05b14d8480174a549bf0b073b61b5671 (127.13.245.67) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.171567 24886 raft_consensus.cc:993] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671: : Instructing follower 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:12.172253 24920 raft_consensus.cc:1081] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Signalling peer 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:12.174109 24564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a65e3df81f4d30b28f8e77897a1525"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:35718
I20260709 13:09:12.174764 24564 raft_consensus.cc:493] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.175138 24564 raft_consensus.cc:3060] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.183868 24564 raft_consensus.cc:515] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.186045 24564 leader_election.cc:290] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:12.187088 24847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a65e3df81f4d30b28f8e77897a1525" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:12.187167 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a65e3df81f4d30b28f8e77897a1525" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:12.187959 24847 raft_consensus.cc:3060] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.188030 24639 raft_consensus.cc:3055] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.188520 24639 raft_consensus.cc:740] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:12.189489 24639 consensus_queue.cc:260] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.191136 24639 raft_consensus.cc:3060] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.194435 24847 raft_consensus.cc:2468] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:12.195779 24532 leader_election.cc:304] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:12.196520 24902 raft_consensus.cc:2804] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.197036 24902 raft_consensus.cc:697] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:12.198028 24902 consensus_queue.cc:237] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.200028 24639 raft_consensus.cc:2468] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 2.
I20260709 13:09:12.209422 24387 catalog_manager.cc:5697] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 1 to 2, leader changed from 05b14d8480174a549bf0b073b61b5671 (127.13.245.67) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:12.259497 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:12.456267 24902 raft_consensus.cc:993] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760: : Instructing follower 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:12.456949 24902 raft_consensus.cc:1081] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Signalling peer 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:12.458870 24639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:33772
I20260709 13:09:12.459470 24639 raft_consensus.cc:493] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.459904 24639 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.466529 24639 raft_consensus.cc:515] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.468528 24639 leader_election.cc:290] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 3 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:12.469827 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:12.470044 24847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0cdaf6979241b7a38b0021098f7c1e" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:12.470680 24564 raft_consensus.cc:3055] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.470820 24847 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.471014 24564 raft_consensus.cc:740] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:12.472039 24564 consensus_queue.cc:260] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.473114 24564 raft_consensus.cc:3060] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.480863 24564 raft_consensus.cc:2468] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 3.
I20260709 13:09:12.481096 24847 raft_consensus.cc:2468] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 3.
I20260709 13:09:12.482431 24604 leader_election.cc:304] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:12.483273 24920 raft_consensus.cc:2804] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.483868 24920 raft_consensus.cc:697] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:12.484596 24920 consensus_queue.cc:237] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:12.495227 24387 catalog_manager.cc:5697] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 2 to 3, leader changed from 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66) to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.510092 24847 raft_consensus.cc:1275] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.511708 24926 consensus_queue.cc:1048] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.528319 24639 raft_consensus.cc:1275] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.530344 24902 consensus_queue.cc:1048] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.672369 24847 raft_consensus.cc:1275] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.673714 24926 consensus_queue.cc:1048] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.683779 24639 raft_consensus.cc:1275] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.685570 24902 consensus_queue.cc:1048] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.864594 24846 raft_consensus.cc:1275] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:12.865999 24886 consensus_queue.cc:1048] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:12.876632 24564 raft_consensus.cc:1275] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:12.878517 24886 consensus_queue.cc:1048] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:13.004791 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:13.012869 24564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
mode: GRACEFUL
new_leader_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:34844
I20260709 13:09:13.013482 24564 raft_consensus.cc:606] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 3 LEADER]: Received request to transfer leadership to TS 05b14d8480174a549bf0b073b61b5671
I20260709 13:09:13.016470 24564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
mode: GRACEFUL
new_leader_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:34844
I20260709 13:09:13.017012 24564 raft_consensus.cc:606] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Received request to transfer leadership to TS 05b14d8480174a549bf0b073b61b5671
I20260709 13:09:13.019714 24639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
mode: GRACEFUL
new_leader_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:09:13.020329 24639 raft_consensus.cc:606] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Received request to transfer leadership to TS 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:13.021811 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:13.022468 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:13.023129 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:13.064440 24936 raft_consensus.cc:993] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760: : Instructing follower 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:13.065116 24902 raft_consensus.cc:1081] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Signalling peer 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:13.066885 24639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:33772
I20260709 13:09:13.067509 24639 raft_consensus.cc:493] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:13.067970 24639 raft_consensus.cc:3060] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.076627 24639 raft_consensus.cc:515] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.079713 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:13.080117 24639 leader_election.cc:290] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:13.080504 24846 raft_consensus.cc:3060] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.081252 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dc563ef0134d4787b805f076b4f2a5" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:13.081951 24564 raft_consensus.cc:3055] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:13.082218 24564 raft_consensus.cc:740] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:13.083091 24564 consensus_queue.cc:260] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.084625 24564 raft_consensus.cc:3060] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.089933 24846 raft_consensus.cc:2468] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 2.
I20260709 13:09:13.090794 24564 raft_consensus.cc:2468] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 2.
I20260709 13:09:13.091370 24606 leader_election.cc:304] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:13.092374 24886 raft_consensus.cc:2804] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:13.092831 24886 raft_consensus.cc:697] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:13.093744 24886 consensus_queue.cc:237] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.105476 24387 catalog_manager.cc:5697] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 1 to 2, leader changed from 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66) to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.214322 24791 raft_consensus.cc:993] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671: : Instructing follower 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:13.214967 24791 raft_consensus.cc:1081] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Signalling peer 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:13.216791 24564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:35718
I20260709 13:09:13.217321 24564 raft_consensus.cc:493] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:13.217633 24564 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.223109 24564 raft_consensus.cc:515] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.224990 24564 leader_election.cc:290] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 3 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:13.225999 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:13.226815 24846 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.227452 24639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7348cdc242794ad7ad87db671d0df228" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:13.228128 24639 raft_consensus.cc:3055] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:13.228459 24639 raft_consensus.cc:740] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:13.229260 24639 consensus_queue.cc:260] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.230298 24639 raft_consensus.cc:3060] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.236040 24639 raft_consensus.cc:2468] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 3.
I20260709 13:09:13.236125 24846 raft_consensus.cc:2468] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 3.
I20260709 13:09:13.237655 24532 leader_election.cc:304] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:13.238790 24902 raft_consensus.cc:2804] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.239439 24902 raft_consensus.cc:697] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 3 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:13.240495 24902 consensus_queue.cc:237] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.250236 24387 catalog_manager.cc:5697] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 2 to 3, leader changed from 05b14d8480174a549bf0b073b61b5671 (127.13.245.67) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 3 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:13.260687 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:13.434118 24936 raft_consensus.cc:993] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760: : Instructing follower 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:13.434691 24902 raft_consensus.cc:1081] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 3 LEADER]: Signalling peer 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:13.436408 24639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:33772
I20260709 13:09:13.436959 24639 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:13.437305 24639 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.442983 24639 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.444887 24639 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 4 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:13.446030 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:13.446082 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:13.446841 24564 raft_consensus.cc:3055] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:13.447297 24564 raft_consensus.cc:740] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:13.446841 24846 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.448153 24564 consensus_queue.cc:260] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.449493 24564 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.455349 24564 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 4.
I20260709 13:09:13.455349 24846 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 4.
I20260709 13:09:13.456804 24604 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 150065cf33f74c949a60e9fd3dc57760; no voters: 
I20260709 13:09:13.457716 24791 raft_consensus.cc:2804] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.458155 24791 raft_consensus.cc:697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 4 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:13.459081 24791 consensus_queue.cc:237] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:13.467871 24387 catalog_manager.cc:5697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 3 to 4, leader changed from 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66) to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 4 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.522166 24846 raft_consensus.cc:1275] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.523690 24791 consensus_queue.cc:1048] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.534279 24564 raft_consensus.cc:1275] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.535979 24886 consensus_queue.cc:1048] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.781417 24846 raft_consensus.cc:1275] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:13.782830 24902 consensus_queue.cc:1048] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:13.793443 24640 raft_consensus.cc:1275] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:13.795508 24902 consensus_queue.cc:1048] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:13.947850 24564 raft_consensus.cc:1275] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 4 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:13.949254 24920 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:13.962843 24846 raft_consensus.cc:1275] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 4 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:13.964429 24920 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:14.029996 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:14.037453 24640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
mode: GRACEFUL
new_leader_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:09:14.038071 24640 raft_consensus.cc:606] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 4 LEADER]: Received request to transfer leadership to TS 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:14.040560 24564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
mode: GRACEFUL
new_leader_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:34844
I20260709 13:09:14.040992 24564 raft_consensus.cc:606] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Received request to transfer leadership to TS 05b14d8480174a549bf0b073b61b5671
I20260709 13:09:14.043362 24640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
mode: GRACEFUL
new_leader_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:09:14.043864 24640 raft_consensus.cc:606] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Received request to transfer leadership to TS 150065cf33f74c949a60e9fd3dc57760
I20260709 13:09:14.044831 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:14.045342 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:14.045890 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:14.105672 24936 raft_consensus.cc:993] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760: : Instructing follower 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:14.106303 24936 raft_consensus.cc:1081] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Signalling peer 05b14d8480174a549bf0b073b61b5671 to start an election
I20260709 13:09:14.107934 24640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd"
dest_uuid: "05b14d8480174a549bf0b073b61b5671"
 from {username='slave'} at 127.0.0.1:33772
I20260709 13:09:14.108528 24640 raft_consensus.cc:493] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.108865 24640 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.115769 24640 raft_consensus.cc:515] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.117952 24640 leader_election.cc:290] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 3 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427)
I20260709 13:09:14.119035 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
I20260709 13:09:14.119511 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728c89bc464a06b906523e00ece3dd" candidate_uuid: "05b14d8480174a549bf0b073b61b5671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:14.119896 24564 raft_consensus.cc:3055] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:14.120214 24846 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.120256 24564 raft_consensus.cc:740] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:14.121206 24564 consensus_queue.cc:260] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.122589 24564 raft_consensus.cc:3060] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.129076 24846 raft_consensus.cc:2468] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 3.
I20260709 13:09:14.130788 24564 raft_consensus.cc:2468] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b14d8480174a549bf0b073b61b5671 in term 3.
I20260709 13:09:14.130806 24606 leader_election.cc:304] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b14d8480174a549bf0b073b61b5671, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:14.131985 24920 raft_consensus.cc:2804] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:14.132469 24920 raft_consensus.cc:697] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Becoming Leader. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:14.133249 24920 consensus_queue.cc:237] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.141906 24388 catalog_manager.cc:5697] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 reported cstate change: term changed from 2 to 3, leader changed from 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66) to 05b14d8480174a549bf0b073b61b5671 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "05b14d8480174a549bf0b073b61b5671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:14.261827 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:14.304284 24920 raft_consensus.cc:993] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671: : Instructing follower 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:14.304888 24920 raft_consensus.cc:1081] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Signalling peer 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:14.306440 24564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:35718
I20260709 13:09:14.306953 24564 raft_consensus.cc:493] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.307247 24564 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.314555 24564 raft_consensus.cc:515] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.316327 24564 leader_election.cc:290] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 4 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:14.317304 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:14.317384 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b586f33ee6434d438897d3ed7f07ecbd" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:14.318244 24846 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.318290 24640 raft_consensus.cc:3055] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.318763 24640 raft_consensus.cc:740] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:14.319763 24640 consensus_queue.cc:260] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.321120 24640 raft_consensus.cc:3060] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.326252 24846 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 4.
I20260709 13:09:14.327606 24532 leader_election.cc:304] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:14.328425 24936 raft_consensus.cc:2804] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.328631 24640 raft_consensus.cc:2468] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 4.
I20260709 13:09:14.328861 24936 raft_consensus.cc:697] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 4 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:14.329885 24936 consensus_queue.cc:237] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.337340 24388 catalog_manager.cc:5697] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 3 to 4, leader changed from 05b14d8480174a549bf0b073b61b5671 (127.13.245.67) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 4 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.544294 24791 raft_consensus.cc:993] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671: : Instructing follower 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:14.544772 24920 raft_consensus.cc:1081] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 4 LEADER]: Signalling peer 150065cf33f74c949a60e9fd3dc57760 to start an election
I20260709 13:09:14.546274 24564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b"
dest_uuid: "150065cf33f74c949a60e9fd3dc57760"
 from {username='slave'} at 127.0.0.1:35718
I20260709 13:09:14.546804 24564 raft_consensus.cc:493] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.547034 24564 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.552431 24564 raft_consensus.cc:515] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.553884 24564 leader_election.cc:290] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 5 election: Requested vote from peers 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755), 05b14d8480174a549bf0b073b61b5671 (127.13.245.67:40295)
I20260709 13:09:14.554697 24846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3b7e2e833c5e44f8888a97ea1f857a81"
I20260709 13:09:14.554953 24640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd8ffd72fcf4cf7bb76f8529d8c639b" candidate_uuid: "150065cf33f74c949a60e9fd3dc57760" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "05b14d8480174a549bf0b073b61b5671"
I20260709 13:09:14.555323 24846 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.555658 24640 raft_consensus.cc:3055] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:14.555969 24640 raft_consensus.cc:740] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05b14d8480174a549bf0b073b61b5671, State: Running, Role: LEADER
I20260709 13:09:14.556717 24640 consensus_queue.cc:260] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.557751 24640 raft_consensus.cc:3060] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.560652 24846 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 5.
I20260709 13:09:14.562034 24532 leader_election.cc:304] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150065cf33f74c949a60e9fd3dc57760, 3b7e2e833c5e44f8888a97ea1f857a81; no voters: 
I20260709 13:09:14.562887 24936 raft_consensus.cc:2804] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:14.563372 24936 raft_consensus.cc:697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 5 LEADER]: Becoming Leader. State: Replica: 150065cf33f74c949a60e9fd3dc57760, State: Running, Role: LEADER
I20260709 13:09:14.564096 24640 raft_consensus.cc:2468] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150065cf33f74c949a60e9fd3dc57760 in term 5.
I20260709 13:09:14.564266 24936 consensus_queue.cc:237] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } }
I20260709 13:09:14.570839 24388 catalog_manager.cc:5697] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 reported cstate change: term changed from 4 to 5, leader changed from 05b14d8480174a549bf0b073b61b5671 (127.13.245.67) to 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66). New cstate: current_term: 5 leader_uuid: "150065cf33f74c949a60e9fd3dc57760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.590266 24564 raft_consensus.cc:1275] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:14.591697 24920 consensus_queue.cc:1048] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150065cf33f74c949a60e9fd3dc57760" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 34427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:14.603679 24846 raft_consensus.cc:1275] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Refusing update from remote peer 05b14d8480174a549bf0b073b61b5671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:14.604939 24920 consensus_queue.cc:1048] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:14.752605 24640 raft_consensus.cc:1275] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 4 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:14.753979 24936 consensus_queue.cc:1048] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:14.763053 24846 raft_consensus.cc:1275] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 4 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:14.764767 24957 consensus_queue.cc:1048] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:14.981021 24640 raft_consensus.cc:1275] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 5 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:14.982604 24936 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b14d8480174a549bf0b073b61b5671" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:14.995831 24846 raft_consensus.cc:1275] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 5 FOLLOWER]: Refusing update from remote peer 150065cf33f74c949a60e9fd3dc57760: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:14.997947 24936 consensus_queue.cc:1048] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7e2e833c5e44f8888a97ea1f857a81" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:15.052343 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:15.083030 14293 tablet_server.cc:179] TabletServer@127.13.245.65:38755 shutting down...
I20260709 13:09:15.106841 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:15.107666 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.108414 14293 raft_consensus.cc:2243] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.108942 14293 raft_consensus.cc:2272] T fef231923f484e1084b05db8b9a51bae P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.111167 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.111910 14293 raft_consensus.cc:2243] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.112381 14293 raft_consensus.cc:2272] T e0a65e3df81f4d30b28f8e77897a1525 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.114435 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.115054 14293 raft_consensus.cc:2243] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.115476 14293 raft_consensus.cc:2272] T 28d27045940a4318ba74a8ab449a21b7 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.117395 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.117998 14293 raft_consensus.cc:2243] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.118422 14293 raft_consensus.cc:2272] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 3b7e2e833c5e44f8888a97ea1f857a81 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.121348 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.122134 14293 raft_consensus.cc:2243] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.122679 14293 raft_consensus.cc:2272] T b586f33ee6434d438897d3ed7f07ecbd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.125288 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.125813 14293 raft_consensus.cc:2243] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.126184 14293 raft_consensus.cc:2272] T 16728c89bc464a06b906523e00ece3dd P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.128470 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.129055 14293 raft_consensus.cc:2243] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.129479 14293 raft_consensus.cc:2272] T 54dc563ef0134d4787b805f076b4f2a5 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.131314 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.131870 14293 raft_consensus.cc:2243] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.132311 14293 raft_consensus.cc:2272] T 1d0cdaf6979241b7a38b0021098f7c1e P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.134162 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.134666 14293 raft_consensus.cc:2243] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.135102 14293 raft_consensus.cc:2272] T 02b9d94ad1e542f8b801427ae982c0ef P 3b7e2e833c5e44f8888a97ea1f857a81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.136986 14293 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:15.137466 14293 raft_consensus.cc:2243] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.137882 14293 raft_consensus.cc:2272] T 7348cdc242794ad7ad87db671d0df228 P 3b7e2e833c5e44f8888a97ea1f857a81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.169006 14293 tablet_server.cc:196] TabletServer@127.13.245.65:38755 shutdown complete.
W20260709 13:09:15.171326 24606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111) [suppressed 99 similar messages]
W20260709 13:09:15.174808 24606 consensus_peers.cc:597] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.192878 14293 tablet_server.cc:179] TabletServer@127.13.245.66:0 shutting down...
W20260709 13:09:15.196149 24532 consensus_peers.cc:597] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.196906 24532 consensus_peers.cc:597] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.220805 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:15.221742 14293 tablet_replica.cc:333] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.222803 14293 raft_consensus.cc:2243] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.223829 14293 raft_consensus.cc:2272] T 1d0cdaf6979241b7a38b0021098f7c1e P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.226627 14293 tablet_replica.cc:333] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.227401 14293 raft_consensus.cc:2243] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.228440 14293 raft_consensus.cc:2272] T 02b9d94ad1e542f8b801427ae982c0ef P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.230865 14293 tablet_replica.cc:333] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.231519 14293 raft_consensus.cc:2243] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.232044 14293 raft_consensus.cc:2272] T 54dc563ef0134d4787b805f076b4f2a5 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.234604 14293 tablet_replica.cc:333] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.235284 14293 raft_consensus.cc:2243] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.236184 14293 raft_consensus.cc:2272] T e0a65e3df81f4d30b28f8e77897a1525 P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.238729 14293 tablet_replica.cc:333] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.239404 14293 raft_consensus.cc:2243] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.240182 14293 raft_consensus.cc:2272] T 28d27045940a4318ba74a8ab449a21b7 P 150065cf33f74c949a60e9fd3dc57760 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.242705 14293 tablet_replica.cc:333] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.243327 14293 raft_consensus.cc:2243] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.243832 14293 raft_consensus.cc:2272] T fef231923f484e1084b05db8b9a51bae P 150065cf33f74c949a60e9fd3dc57760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.247148 14293 tablet_replica.cc:333] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.248348 14293 raft_consensus.cc:2243] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.249341 14293 raft_consensus.cc:2272] T 7348cdc242794ad7ad87db671d0df228 P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.253017 14293 tablet_replica.cc:333] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.253684 14293 raft_consensus.cc:2243] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.254664 14293 raft_consensus.cc:2272] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 150065cf33f74c949a60e9fd3dc57760 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.257624 14293 tablet_replica.cc:333] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.258282 14293 raft_consensus.cc:2243] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.259248 14293 raft_consensus.cc:2272] T b586f33ee6434d438897d3ed7f07ecbd P 150065cf33f74c949a60e9fd3dc57760 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.262077 14293 tablet_replica.cc:333] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760: stopping tablet replica
I20260709 13:09:15.262683 14293 raft_consensus.cc:2243] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:15.262908 24437 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:15.263175 14293 raft_consensus.cc:2272] T 16728c89bc464a06b906523e00ece3dd P 150065cf33f74c949a60e9fd3dc57760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.292385 14293 tablet_server.cc:196] TabletServer@127.13.245.66:0 shutdown complete.
W20260709 13:09:15.314390 24604 consensus_peers.cc:597] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 -> Peer 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427): Couldn't send request to peer 150065cf33f74c949a60e9fd3dc57760. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.324204 14293 tablet_server.cc:179] TabletServer@127.13.245.67:0 shutting down...
W20260709 13:09:15.354818 24606 consensus_peers.cc:597] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.356875 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:15.357911 14293 tablet_replica.cc:333] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.358812 14293 raft_consensus.cc:2243] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.359931 14293 raft_consensus.cc:2272] T 1d0cdaf6979241b7a38b0021098f7c1e P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.362458 14293 tablet_replica.cc:333] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.363127 14293 raft_consensus.cc:2243] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.363664 14293 raft_consensus.cc:2272] T 02b9d94ad1e542f8b801427ae982c0ef P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.366086 14293 tablet_replica.cc:333] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.366807 14293 raft_consensus.cc:2243] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.367296 14293 raft_consensus.cc:2272] T 7348cdc242794ad7ad87db671d0df228 P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.370333 14293 tablet_replica.cc:333] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.371346 14293 raft_consensus.cc:2243] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.372131 14293 raft_consensus.cc:2272] T 0dd8ffd72fcf4cf7bb76f8529d8c639b P 05b14d8480174a549bf0b073b61b5671 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.373183 24606 consensus_peers.cc:597] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 -> Peer 3b7e2e833c5e44f8888a97ea1f857a81 (127.13.245.65:38755): Couldn't send request to peer 3b7e2e833c5e44f8888a97ea1f857a81. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.374799 24604 consensus_peers.cc:597] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 -> Peer 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427): Couldn't send request to peer 150065cf33f74c949a60e9fd3dc57760. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.376500 14293 tablet_replica.cc:333] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.377326 14293 raft_consensus.cc:2243] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:09:15.377933 24604 consensus_peers.cc:597] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 -> Peer 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427): Couldn't send request to peer 150065cf33f74c949a60e9fd3dc57760. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.378230 14293 raft_consensus.cc:2272] T 16728c89bc464a06b906523e00ece3dd P 05b14d8480174a549bf0b073b61b5671 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.381366 14293 tablet_replica.cc:333] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.382078 14293 raft_consensus.cc:2243] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.382570 14293 raft_consensus.cc:2272] T b586f33ee6434d438897d3ed7f07ecbd P 05b14d8480174a549bf0b073b61b5671 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.385694 14293 tablet_replica.cc:333] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.386356 14293 raft_consensus.cc:2243] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.387250 14293 raft_consensus.cc:2272] T fef231923f484e1084b05db8b9a51bae P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.390098 14293 tablet_replica.cc:333] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.390715 14293 raft_consensus.cc:2243] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:15.391057 24604 consensus_peers.cc:597] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 -> Peer 150065cf33f74c949a60e9fd3dc57760 (127.13.245.66:34427): Couldn't send request to peer 150065cf33f74c949a60e9fd3dc57760. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:34427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.391201 14293 raft_consensus.cc:2272] T e0a65e3df81f4d30b28f8e77897a1525 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.393893 14293 tablet_replica.cc:333] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.394496 14293 raft_consensus.cc:2243] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.395401 14293 raft_consensus.cc:2272] T 28d27045940a4318ba74a8ab449a21b7 P 05b14d8480174a549bf0b073b61b5671 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.397953 14293 tablet_replica.cc:333] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671: stopping tablet replica
I20260709 13:09:15.398484 14293 raft_consensus.cc:2243] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.399325 14293 raft_consensus.cc:2272] T 54dc563ef0134d4787b805f076b4f2a5 P 05b14d8480174a549bf0b073b61b5671 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.434242 14293 tablet_server.cc:196] TabletServer@127.13.245.67:0 shutdown complete.
I20260709 13:09:15.468000 14293 master.cc:562] Master@127.13.245.126:35371 shutting down...
I20260709 13:09:15.502738 14293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.503422 14293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.503835 14293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8ce244ffed31436e86e614a1defe4665: stopping tablet replica
I20260709 13:09:15.543931 14293 master.cc:584] Master@127.13.245.126:35371 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13712 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:09:15.595819 14293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.245.126:33221
I20260709 13:09:15.597062 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:15.602645 24985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:15.603436 24986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:15.604537 24988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:15.604965 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:15.606146 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:15.606361 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:15.606534 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602555606514 us; error 0 us; skew 500 ppm
I20260709 13:09:15.607108 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:15.609850 14293 webserver.cc:533] Webserver started at http://127.13.245.126:35703/ using document root <none> and password file <none>
I20260709 13:09:15.610467 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:15.610710 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:15.611047 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:15.613170 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/master-0-root/instance:
uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d"
format_stamp: "Formatted at 2026-07-09 13:09:15 on dist-test-slave-fc6v"
I20260709 13:09:15.620498 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:09:15.624848 24993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.625733 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:09:15.626068 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/master-0-root
uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d"
format_stamp: "Formatted at 2026-07-09 13:09:15 on dist-test-slave-fc6v"
I20260709 13:09:15.626362 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:15.645867 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:15.647257 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:15.690265 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.126:33221
I20260709 13:09:15.690372 25044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.126:33221 every 8 connection(s)
I20260709 13:09:15.694656 25045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.706789 25045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d: Bootstrap starting.
I20260709 13:09:15.712230 25045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.717118 25045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d: No bootstrap required, opened a new log
I20260709 13:09:15.719597 25045 raft_consensus.cc:359] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d" member_type: VOTER }
I20260709 13:09:15.720048 25045 raft_consensus.cc:385] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.720289 25045 raft_consensus.cc:740] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a100c96f4d4a6f8283cc9f0ea7f06d, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.720993 25045 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d" member_type: VOTER }
I20260709 13:09:15.721457 25045 raft_consensus.cc:399] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:15.721697 25045 raft_consensus.cc:493] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:15.721973 25045 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.727344 25045 raft_consensus.cc:515] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d" member_type: VOTER }
I20260709 13:09:15.727967 25045 leader_election.cc:304] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4a100c96f4d4a6f8283cc9f0ea7f06d; no voters: 
I20260709 13:09:15.729351 25045 leader_election.cc:290] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:15.729709 25048 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.731299 25048 raft_consensus.cc:697] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 1 LEADER]: Becoming Leader. State: Replica: e4a100c96f4d4a6f8283cc9f0ea7f06d, State: Running, Role: LEADER
I20260709 13:09:15.731940 25048 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d" member_type: VOTER }
I20260709 13:09:15.732483 25045 sys_catalog.cc:565] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:15.736428 25049 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d" member_type: VOTER } }
I20260709 13:09:15.737226 25049 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:15.736966 25050 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4a100c96f4d4a6f8283cc9f0ea7f06d. Latest consensus state: current_term: 1 leader_uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a100c96f4d4a6f8283cc9f0ea7f06d" member_type: VOTER } }
I20260709 13:09:15.738579 25050 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:15.741801 25055 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:15.750651 25055 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:15.752871 14293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:15.761569 25055 catalog_manager.cc:1383] Generated new cluster ID: e7620d8e06a04538a3f3124ca0afa0c7
I20260709 13:09:15.761940 25055 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:15.779454 25055 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:15.781032 25055 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:15.794265 25055 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d: Generated new TSK 0
I20260709 13:09:15.794956 25055 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:15.820569 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:15.827854 25066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:15.828717 25067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:15.830142 25069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:15.831142 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:15.832221 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:15.832438 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:15.832623 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602555832603 us; error 0 us; skew 500 ppm
I20260709 13:09:15.833272 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:15.835917 14293 webserver.cc:533] Webserver started at http://127.13.245.65:46769/ using document root <none> and password file <none>
I20260709 13:09:15.836453 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:15.836659 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:15.836941 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:15.838119 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-0-root/instance:
uuid: "7338488648e74f1a82a87347b5229cb7"
format_stamp: "Formatted at 2026-07-09 13:09:15 on dist-test-slave-fc6v"
I20260709 13:09:15.843003 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:09:15.846971 25074 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.847977 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:09:15.848294 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "7338488648e74f1a82a87347b5229cb7"
format_stamp: "Formatted at 2026-07-09 13:09:15 on dist-test-slave-fc6v"
I20260709 13:09:15.848600 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:15.886583 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:15.888152 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:15.889791 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:15.892446 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:15.892697 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.893002 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:15.893219 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.942706 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:43923
I20260709 13:09:15.942807 25136 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:43923 every 8 connection(s)
I20260709 13:09:15.948686 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:15.958408 25141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:15.964728 25142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:15.965804 25137 heartbeater.cc:344] Connected to a master server at 127.13.245.126:33221
W20260709 13:09:15.966023 25144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:15.966385 25137 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:15.967418 25137 heartbeater.cc:507] Master 127.13.245.126:33221 requested a full tablet report, sending...
I20260709 13:09:15.967533 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:15.969058 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:15.969314 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:15.969542 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602555969521 us; error 0 us; skew 500 ppm
I20260709 13:09:15.970211 25010 ts_manager.cc:194] Registered new tserver with Master: 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923)
I20260709 13:09:15.970587 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:15.973248 25010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49662
I20260709 13:09:15.974017 14293 webserver.cc:533] Webserver started at http://127.13.245.66:38703/ using document root <none> and password file <none>
I20260709 13:09:15.974763 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:15.975035 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:15.975379 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:15.976987 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-1-root/instance:
uuid: "f6f38c6f853d47919288d4688b8d8cdd"
format_stamp: "Formatted at 2026-07-09 13:09:15 on dist-test-slave-fc6v"
I20260709 13:09:15.982267 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:15.986337 25149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.987421 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:09:15.987792 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-1-root
uuid: "f6f38c6f853d47919288d4688b8d8cdd"
format_stamp: "Formatted at 2026-07-09 13:09:15 on dist-test-slave-fc6v"
I20260709 13:09:15.988072 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:16.005577 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:16.006946 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:16.008670 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:16.011315 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:16.011518 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:16.011875 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:16.012019 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:16.059353 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.66:33807
I20260709 13:09:16.059460 25211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.66:33807 every 8 connection(s)
I20260709 13:09:16.064841 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:16.074230 25216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:16.075706 25215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:16.077018 25218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:16.077708 25212 heartbeater.cc:344] Connected to a master server at 127.13.245.126:33221
I20260709 13:09:16.078197 25212 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:16.079046 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:16.079167 25212 heartbeater.cc:507] Master 127.13.245.126:33221 requested a full tablet report, sending...
I20260709 13:09:16.080251 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:16.080493 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:16.080699 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602556080682 us; error 0 us; skew 500 ppm
I20260709 13:09:16.081506 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:16.081655 25010 ts_manager.cc:194] Registered new tserver with Master: f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807)
I20260709 13:09:16.083763 25010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49670
I20260709 13:09:16.084673 14293 webserver.cc:533] Webserver started at http://127.13.245.67:45425/ using document root <none> and password file <none>
I20260709 13:09:16.085461 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:16.085726 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:16.086079 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:16.087601 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-2-root/instance:
uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
format_stamp: "Formatted at 2026-07-09 13:09:16 on dist-test-slave-fc6v"
I20260709 13:09:16.092882 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:09:16.096801 25223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:16.098208 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:16.098523 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-2-root
uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
format_stamp: "Formatted at 2026-07-09 13:09:16 on dist-test-slave-fc6v"
I20260709 13:09:16.098812 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602214968311-14293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:16.110744 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:16.112396 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:16.114123 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:16.117023 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:16.117247 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:16.117604 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:16.117758 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:16.167922 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.67:46015
I20260709 13:09:16.168033 25285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.67:46015 every 8 connection(s)
I20260709 13:09:16.183240 25286 heartbeater.cc:344] Connected to a master server at 127.13.245.126:33221
I20260709 13:09:16.183795 25286 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:16.184634 25286 heartbeater.cc:507] Master 127.13.245.126:33221 requested a full tablet report, sending...
I20260709 13:09:16.186679 25010 ts_manager.cc:194] Registered new tserver with Master: fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67:46015)
I20260709 13:09:16.187659 14293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016138593s
I20260709 13:09:16.188386 25010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49678
I20260709 13:09:16.214903 25010 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49682:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:16.217324 25010 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:16.268448 25251 tablet_service.cc:1511] Processing CreateTablet for tablet 2a35d72572e44c649578014c84947af6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d4754f73fe4248f6bfdbd2ed0c5d883a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:16.270328 25251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a35d72572e44c649578014c84947af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.268630 25250 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa1b3b2237d4cc4a1fc56a5be91442b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d4754f73fe4248f6bfdbd2ed0c5d883a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:16.273804 25250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa1b3b2237d4cc4a1fc56a5be91442b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.280386 25102 tablet_service.cc:1511] Processing CreateTablet for tablet 2a35d72572e44c649578014c84947af6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d4754f73fe4248f6bfdbd2ed0c5d883a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:16.281953 25102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a35d72572e44c649578014c84947af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.283241 25176 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa1b3b2237d4cc4a1fc56a5be91442b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d4754f73fe4248f6bfdbd2ed0c5d883a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:16.284680 25176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa1b3b2237d4cc4a1fc56a5be91442b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.284855 25101 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa1b3b2237d4cc4a1fc56a5be91442b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d4754f73fe4248f6bfdbd2ed0c5d883a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:16.286269 25101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa1b3b2237d4cc4a1fc56a5be91442b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.290932 25177 tablet_service.cc:1511] Processing CreateTablet for tablet 2a35d72572e44c649578014c84947af6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d4754f73fe4248f6bfdbd2ed0c5d883a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:16.292891 25177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a35d72572e44c649578014c84947af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.312954 25301 tablet_bootstrap.cc:492] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e: Bootstrap starting.
I20260709 13:09:16.317418 25302 tablet_bootstrap.cc:492] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd: Bootstrap starting.
I20260709 13:09:16.321578 25301 tablet_bootstrap.cc:654] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.325892 25302 tablet_bootstrap.cc:654] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.325923 25303 tablet_bootstrap.cc:492] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7: Bootstrap starting.
I20260709 13:09:16.334884 25303 tablet_bootstrap.cc:654] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.338056 25301 tablet_bootstrap.cc:492] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e: No bootstrap required, opened a new log
I20260709 13:09:16.338617 25301 ts_tablet_manager.cc:1403] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.013s
I20260709 13:09:16.340322 25302 tablet_bootstrap.cc:492] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd: No bootstrap required, opened a new log
I20260709 13:09:16.340844 25302 ts_tablet_manager.cc:1403] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 13:09:16.340934 25303 tablet_bootstrap.cc:492] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7: No bootstrap required, opened a new log
I20260709 13:09:16.341475 25303 ts_tablet_manager.cc:1403] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:09:16.341828 25301 raft_consensus.cc:359] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.342674 25301 raft_consensus.cc:385] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.342985 25301 raft_consensus.cc:740] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.343498 25302 raft_consensus.cc:359] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.344296 25302 raft_consensus.cc:385] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.343829 25301 consensus_queue.cc:260] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.344583 25302 raft_consensus.cc:740] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f38c6f853d47919288d4688b8d8cdd, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.344738 25303 raft_consensus.cc:359] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.345839 25303 raft_consensus.cc:385] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.345453 25302 consensus_queue.cc:260] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.346428 25303 raft_consensus.cc:740] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7338488648e74f1a82a87347b5229cb7, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.347226 25286 heartbeater.cc:499] Master 127.13.245.126:33221 was elected leader, sending a full tablet report...
I20260709 13:09:16.347620 25301 ts_tablet_manager.cc:1434] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:09:16.348618 25212 heartbeater.cc:499] Master 127.13.245.126:33221 was elected leader, sending a full tablet report...
I20260709 13:09:16.348841 25301 tablet_bootstrap.cc:492] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e: Bootstrap starting.
I20260709 13:09:16.349153 25302 ts_tablet_manager.cc:1434] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:09:16.347280 25303 consensus_queue.cc:260] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.352355 25307 raft_consensus.cc:493] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.353080 25307 raft_consensus.cc:515] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.356226 25137 heartbeater.cc:499] Master 127.13.245.126:33221 was elected leader, sending a full tablet report...
I20260709 13:09:16.356559 25301 tablet_bootstrap.cc:654] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.370487 25303 ts_tablet_manager.cc:1434] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:09:16.381105 25307 leader_election.cc:290] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807), 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923)
I20260709 13:09:16.389158 25302 tablet_bootstrap.cc:492] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd: Bootstrap starting.
I20260709 13:09:16.390609 25303 tablet_bootstrap.cc:492] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7: Bootstrap starting.
I20260709 13:09:16.390913 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a35d72572e44c649578014c84947af6" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd" is_pre_election: true
W20260709 13:09:16.393741 25227 leader_election.cc:343] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.401041 25302 tablet_bootstrap.cc:654] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.402055 25301 tablet_bootstrap.cc:492] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e: No bootstrap required, opened a new log
I20260709 13:09:16.402663 25301 ts_tablet_manager.cc:1403] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e: Time spent bootstrapping tablet: real 0.054s	user 0.036s	sys 0.007s
I20260709 13:09:16.405144 25303 tablet_bootstrap.cc:654] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.406296 25301 raft_consensus.cc:359] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.407249 25301 raft_consensus.cc:385] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.407603 25301 raft_consensus.cc:740] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.407379 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a35d72572e44c649578014c84947af6" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7338488648e74f1a82a87347b5229cb7" is_pre_election: true
I20260709 13:09:16.408954 25301 consensus_queue.cc:260] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
W20260709 13:09:16.410406 25224 leader_election.cc:343] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.411224 25224 leader_election.cc:304] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 7338488648e74f1a82a87347b5229cb7, f6f38c6f853d47919288d4688b8d8cdd
I20260709 13:09:16.412487 25307 raft_consensus.cc:2749] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.417196 25301 ts_tablet_manager.cc:1434] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:09:16.417907 25302 tablet_bootstrap.cc:492] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd: No bootstrap required, opened a new log
I20260709 13:09:16.418475 25302 ts_tablet_manager.cc:1403] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.000s
I20260709 13:09:16.420017 25303 tablet_bootstrap.cc:492] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7: No bootstrap required, opened a new log
I20260709 13:09:16.420615 25303 ts_tablet_manager.cc:1403] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.012s
I20260709 13:09:16.421219 25302 raft_consensus.cc:359] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.422036 25302 raft_consensus.cc:385] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.422364 25302 raft_consensus.cc:740] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f38c6f853d47919288d4688b8d8cdd, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.423308 25302 consensus_queue.cc:260] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.423652 25303 raft_consensus.cc:359] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.424355 25303 raft_consensus.cc:385] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.424666 25303 raft_consensus.cc:740] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7338488648e74f1a82a87347b5229cb7, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.425468 25303 consensus_queue.cc:260] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.427563 25303 ts_tablet_manager.cc:1434] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:16.427798 25302 ts_tablet_manager.cc:1434] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:09:16.512987 25308 raft_consensus.cc:493] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.513500 25308 raft_consensus.cc:515] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.515884 25308 leader_election.cc:290] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67:46015), 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923)
I20260709 13:09:16.526543 25261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a35d72572e44c649578014c84947af6" candidate_uuid: "f6f38c6f853d47919288d4688b8d8cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" is_pre_election: true
I20260709 13:09:16.527482 25261 raft_consensus.cc:2468] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6f38c6f853d47919288d4688b8d8cdd in term 0.
I20260709 13:09:16.527617 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a35d72572e44c649578014c84947af6" candidate_uuid: "f6f38c6f853d47919288d4688b8d8cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7338488648e74f1a82a87347b5229cb7" is_pre_election: true
I20260709 13:09:16.528366 25112 raft_consensus.cc:2468] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6f38c6f853d47919288d4688b8d8cdd in term 0.
I20260709 13:09:16.529072 25150 leader_election.cc:304] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6f38c6f853d47919288d4688b8d8cdd, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:16.530021 25308 raft_consensus.cc:2804] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.530426 25308 raft_consensus.cc:493] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.530820 25308 raft_consensus.cc:3060] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.537369 25308 raft_consensus.cc:515] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.539252 25308 leader_election.cc:290] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [CANDIDATE]: Term 1 election: Requested vote from peers fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67:46015), 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923)
I20260709 13:09:16.540280 25261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a35d72572e44c649578014c84947af6" candidate_uuid: "f6f38c6f853d47919288d4688b8d8cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
I20260709 13:09:16.540459 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a35d72572e44c649578014c84947af6" candidate_uuid: "f6f38c6f853d47919288d4688b8d8cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7338488648e74f1a82a87347b5229cb7"
I20260709 13:09:16.540936 25261 raft_consensus.cc:3060] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.541065 25112 raft_consensus.cc:3060] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.547950 25261 raft_consensus.cc:2468] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f38c6f853d47919288d4688b8d8cdd in term 1.
I20260709 13:09:16.547950 25112 raft_consensus.cc:2468] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f38c6f853d47919288d4688b8d8cdd in term 1.
I20260709 13:09:16.549247 25150 leader_election.cc:304] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6f38c6f853d47919288d4688b8d8cdd, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:16.549961 25308 raft_consensus.cc:2804] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.550985 25308 raft_consensus.cc:697] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 1 LEADER]: Becoming Leader. State: Replica: f6f38c6f853d47919288d4688b8d8cdd, State: Running, Role: LEADER
I20260709 13:09:16.551894 25308 consensus_queue.cc:237] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:16.560086 25009 catalog_manager.cc:5697] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd reported cstate change: term changed from 0 to 1, leader changed from <none> to f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66). New cstate: current_term: 1 leader_uuid: "f6f38c6f853d47919288d4688b8d8cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.588754 25307 raft_consensus.cc:493] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.589490 25307 raft_consensus.cc:515] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.591495 25307 leader_election.cc:290] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923), f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807)
I20260709 13:09:16.592314 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa1b3b2237d4cc4a1fc56a5be91442b" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7338488648e74f1a82a87347b5229cb7" is_pre_election: true
I20260709 13:09:16.592760 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa1b3b2237d4cc4a1fc56a5be91442b" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd" is_pre_election: true
I20260709 13:09:16.593165 25112 raft_consensus.cc:2468] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 0.
I20260709 13:09:16.593461 25187 raft_consensus.cc:2468] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 0.
I20260709 13:09:16.594306 25224 leader_election.cc:304] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:16.595088 25307 raft_consensus.cc:2804] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.595465 25307 raft_consensus.cc:493] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.595839 25307 raft_consensus.cc:3060] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.601982 25307 raft_consensus.cc:515] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.603816 25307 leader_election.cc:290] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 election: Requested vote from peers 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923), f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807)
I20260709 13:09:16.604633 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa1b3b2237d4cc4a1fc56a5be91442b" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7338488648e74f1a82a87347b5229cb7"
I20260709 13:09:16.604820 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa1b3b2237d4cc4a1fc56a5be91442b" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
I20260709 13:09:16.605280 25112 raft_consensus.cc:3060] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.605419 25187 raft_consensus.cc:3060] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.611048 25112 raft_consensus.cc:2468] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 1.
I20260709 13:09:16.611194 25187 raft_consensus.cc:2468] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 1.
I20260709 13:09:16.612392 25224 leader_election.cc:304] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:16.613162 25307 raft_consensus.cc:2804] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.614107 25307 raft_consensus.cc:697] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Becoming Leader. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Running, Role: LEADER
I20260709 13:09:16.614856 25307 consensus_queue.cc:237] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.622037 25009 catalog_manager.cc:5697] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e reported cstate change: term changed from 0 to 1, leader changed from <none> to fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67). New cstate: current_term: 1 leader_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.687849 25009 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49690:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:16.690254 25009 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:16.715585 25101 tablet_service.cc:1511] Processing CreateTablet for tablet 556d9f22431d4ad0bd028ee656fcb533 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=289c4b1658b14e33a627ac471d231cd1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:16.717084 25101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d9f22431d4ad0bd028ee656fcb533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.717017 25177 tablet_service.cc:1511] Processing CreateTablet for tablet 556d9f22431d4ad0bd028ee656fcb533 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=289c4b1658b14e33a627ac471d231cd1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:16.718446 25251 tablet_service.cc:1511] Processing CreateTablet for tablet 556d9f22431d4ad0bd028ee656fcb533 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=289c4b1658b14e33a627ac471d231cd1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:16.719745 25251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d9f22431d4ad0bd028ee656fcb533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.718459 25177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d9f22431d4ad0bd028ee656fcb533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.723353 25176 tablet_service.cc:1511] Processing CreateTablet for tablet 3edc4031af184c3dab1d04f5d00699be (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=289c4b1658b14e33a627ac471d231cd1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:16.723628 25102 tablet_service.cc:1511] Processing CreateTablet for tablet 3edc4031af184c3dab1d04f5d00699be (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=289c4b1658b14e33a627ac471d231cd1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:16.723764 25250 tablet_service.cc:1511] Processing CreateTablet for tablet 3edc4031af184c3dab1d04f5d00699be (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=289c4b1658b14e33a627ac471d231cd1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:16.724715 25176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edc4031af184c3dab1d04f5d00699be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.724987 25102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edc4031af184c3dab1d04f5d00699be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.725245 25250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edc4031af184c3dab1d04f5d00699be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.743113 25302 tablet_bootstrap.cc:492] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd: Bootstrap starting.
W20260709 13:09:16.746724 25058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:16.753185 25303 tablet_bootstrap.cc:492] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7: Bootstrap starting.
I20260709 13:09:16.757239 25302 tablet_bootstrap.cc:654] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.759642 25301 tablet_bootstrap.cc:492] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e: Bootstrap starting.
I20260709 13:09:16.760380 25303 tablet_bootstrap.cc:654] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.768409 25302 tablet_bootstrap.cc:492] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd: No bootstrap required, opened a new log
I20260709 13:09:16.769101 25302 ts_tablet_manager.cc:1403] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.008s
I20260709 13:09:16.770505 25301 tablet_bootstrap.cc:654] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.770742 25303 tablet_bootstrap.cc:492] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7: No bootstrap required, opened a new log
I20260709 13:09:16.771364 25303 ts_tablet_manager.cc:1403] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:09:16.773211 25302 raft_consensus.cc:359] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.773764 25303 raft_consensus.cc:359] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.774376 25302 raft_consensus.cc:385] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.774442 25303 raft_consensus.cc:385] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.774983 25302 raft_consensus.cc:740] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f38c6f853d47919288d4688b8d8cdd, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.775149 25303 raft_consensus.cc:740] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7338488648e74f1a82a87347b5229cb7, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.776150 25302 consensus_queue.cc:260] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.778108 25301 tablet_bootstrap.cc:492] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e: No bootstrap required, opened a new log
I20260709 13:09:16.778592 25302 ts_tablet_manager.cc:1434] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:09:16.778770 25301 ts_tablet_manager.cc:1403] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 13:09:16.777024 25303 consensus_queue.cc:260] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.779958 25302 tablet_bootstrap.cc:492] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd: Bootstrap starting.
I20260709 13:09:16.784958 25301 raft_consensus.cc:359] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.785861 25301 raft_consensus.cc:385] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.786164 25301 raft_consensus.cc:740] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.787001 25301 consensus_queue.cc:260] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.788105 25302 tablet_bootstrap.cc:654] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.791098 25301 ts_tablet_manager.cc:1434] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:16.792394 25301 tablet_bootstrap.cc:492] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: Bootstrap starting.
I20260709 13:09:16.784627 25303 ts_tablet_manager.cc:1434] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:16.794853 25303 tablet_bootstrap.cc:492] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7: Bootstrap starting.
I20260709 13:09:16.800365 25301 tablet_bootstrap.cc:654] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.802309 25303 tablet_bootstrap.cc:654] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.804176 25309 raft_consensus.cc:493] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.804762 25309 raft_consensus.cc:515] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.820637 25309 leader_election.cc:290] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807), fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67:46015)
I20260709 13:09:16.882642 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d9f22431d4ad0bd028ee656fcb533" candidate_uuid: "7338488648e74f1a82a87347b5229cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd" is_pre_election: true
I20260709 13:09:16.883634 25187 raft_consensus.cc:2468] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7338488648e74f1a82a87347b5229cb7 in term 0.
I20260709 13:09:16.884096 25303 tablet_bootstrap.cc:492] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7: No bootstrap required, opened a new log
I20260709 13:09:16.884725 25303 ts_tablet_manager.cc:1403] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7: Time spent bootstrapping tablet: real 0.090s	user 0.026s	sys 0.061s
I20260709 13:09:16.884124 25301 tablet_bootstrap.cc:492] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: No bootstrap required, opened a new log
I20260709 13:09:16.885300 25078 leader_election.cc:304] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, f6f38c6f853d47919288d4688b8d8cdd; no voters: 
I20260709 13:09:16.885681 25302 tablet_bootstrap.cc:492] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd: No bootstrap required, opened a new log
I20260709 13:09:16.885819 25301 ts_tablet_manager.cc:1403] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: Time spent bootstrapping tablet: real 0.094s	user 0.041s	sys 0.046s
I20260709 13:09:16.886451 25302 ts_tablet_manager.cc:1403] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd: Time spent bootstrapping tablet: real 0.107s	user 0.040s	sys 0.048s
I20260709 13:09:16.886523 25309 raft_consensus.cc:2804] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.887084 25309 raft_consensus.cc:493] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.887717 25309 raft_consensus.cc:3060] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.888633 25303 raft_consensus.cc:359] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.889706 25303 raft_consensus.cc:385] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.890094 25303 raft_consensus.cc:740] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7338488648e74f1a82a87347b5229cb7, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.890620 25302 raft_consensus.cc:359] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.891428 25302 raft_consensus.cc:385] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.891781 25302 raft_consensus.cc:740] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f38c6f853d47919288d4688b8d8cdd, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.889765 25301 raft_consensus.cc:359] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.891024 25303 consensus_queue.cc:260] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.892742 25302 consensus_queue.cc:260] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.893584 25261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d9f22431d4ad0bd028ee656fcb533" candidate_uuid: "7338488648e74f1a82a87347b5229cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" is_pre_election: true
I20260709 13:09:16.894451 25261 raft_consensus.cc:2468] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7338488648e74f1a82a87347b5229cb7 in term 0.
I20260709 13:09:16.892793 25301 raft_consensus.cc:385] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.900895 25301 raft_consensus.cc:740] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.901182 25309 raft_consensus.cc:515] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.902040 25301 consensus_queue.cc:260] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.903898 25309 leader_election.cc:290] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [CANDIDATE]: Term 1 election: Requested vote from peers f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807), fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67:46015)
I20260709 13:09:16.905524 25301 ts_tablet_manager.cc:1434] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:09:16.899706 25302 ts_tablet_manager.cc:1434] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:09:16.911830 25303 ts_tablet_manager.cc:1434] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7: Time spent starting tablet: real 0.027s	user 0.026s	sys 0.000s
I20260709 13:09:16.913669 25261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d9f22431d4ad0bd028ee656fcb533" candidate_uuid: "7338488648e74f1a82a87347b5229cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
I20260709 13:09:16.914426 25261 raft_consensus.cc:3060] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.917060 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d9f22431d4ad0bd028ee656fcb533" candidate_uuid: "7338488648e74f1a82a87347b5229cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
I20260709 13:09:16.917829 25187 raft_consensus.cc:3060] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.923518 25261 raft_consensus.cc:2468] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7338488648e74f1a82a87347b5229cb7 in term 1.
I20260709 13:09:16.925120 25075 leader_election.cc:304] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:16.926229 25332 raft_consensus.cc:2804] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.926590 25187 raft_consensus.cc:2468] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7338488648e74f1a82a87347b5229cb7 in term 1.
I20260709 13:09:16.926867 25332 raft_consensus.cc:697] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 7338488648e74f1a82a87347b5229cb7, State: Running, Role: LEADER
I20260709 13:09:16.928519 25332 consensus_queue.cc:237] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.936630 25009 catalog_manager.cc:5697] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7338488648e74f1a82a87347b5229cb7 (127.13.245.65). New cstate: current_term: 1 leader_uuid: "7338488648e74f1a82a87347b5229cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.969517 25308 consensus_queue.cc:1048] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.978407 25307 raft_consensus.cc:493] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.979503 25307 raft_consensus.cc:515] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:16.983314 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7338488648e74f1a82a87347b5229cb7" is_pre_election: true
I20260709 13:09:16.983660 25307 leader_election.cc:290] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923), f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807)
I20260709 13:09:16.984368 25112 raft_consensus.cc:2468] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 0.
I20260709 13:09:16.985780 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd" is_pre_election: true
I20260709 13:09:16.986284 25224 leader_election.cc:304] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:16.986582 25187 raft_consensus.cc:2468] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 0.
I20260709 13:09:16.987246 25307 raft_consensus.cc:2804] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.987654 25307 raft_consensus.cc:493] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.988005 25307 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.989040 25308 consensus_queue.cc:1048] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.997632 25307 raft_consensus.cc:515] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:17.000794 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7338488648e74f1a82a87347b5229cb7"
I20260709 13:09:17.001158 25307 leader_election.cc:290] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 election: Requested vote from peers 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923), f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807)
I20260709 13:09:17.001542 25112 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.001418 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
I20260709 13:09:17.002287 25187 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.010563 25187 raft_consensus.cc:2468] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 1.
I20260709 13:09:17.010569 25112 raft_consensus.cc:2468] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 1.
I20260709 13:09:17.011999 25224 leader_election.cc:304] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:17.012859 25307 raft_consensus.cc:2804] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.013417 25307 raft_consensus.cc:697] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Becoming Leader. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Running, Role: LEADER
I20260709 13:09:17.014398 25307 consensus_queue.cc:237] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:17.022830 25009 catalog_manager.cc:5697] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e reported cstate change: term changed from 0 to 1, leader changed from <none> to fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67). New cstate: current_term: 1 leader_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.058303 25307 consensus_queue.cc:1048] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.069766 25317 consensus_queue.cc:1048] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.091468 25187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a35d72572e44c649578014c84947af6"
dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
mode: GRACEFUL
new_leader_uuid: "7338488648e74f1a82a87347b5229cb7"
 from {username='slave'} at 127.0.0.1:38350
I20260709 13:09:17.092093 25187 raft_consensus.cc:606] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 1 LEADER]: Received request to transfer leadership to TS 7338488648e74f1a82a87347b5229cb7
I20260709 13:09:17.104903 25261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa1b3b2237d4cc4a1fc56a5be91442b"
dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
mode: GRACEFUL
new_leader_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:09:17.105525 25261 raft_consensus.cc:606] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Received request to transfer leadership to TS f6f38c6f853d47919288d4688b8d8cdd
I20260709 13:09:17.113754 25261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be"
dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
mode: GRACEFUL
new_leader_uuid: "7338488648e74f1a82a87347b5229cb7"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:09:17.114305 25261 raft_consensus.cc:606] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Received request to transfer leadership to TS 7338488648e74f1a82a87347b5229cb7
I20260709 13:09:17.413388 25308 raft_consensus.cc:993] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd: : Instructing follower 7338488648e74f1a82a87347b5229cb7 to start an election
I20260709 13:09:17.413964 25344 raft_consensus.cc:1081] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 1 LEADER]: Signalling peer 7338488648e74f1a82a87347b5229cb7 to start an election
I20260709 13:09:17.415812 25112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a35d72572e44c649578014c84947af6"
dest_uuid: "7338488648e74f1a82a87347b5229cb7"
 from {username='slave'} at 127.0.0.1:45198
I20260709 13:09:17.416446 25112 raft_consensus.cc:493] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.416855 25112 raft_consensus.cc:3060] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.424322 25112 raft_consensus.cc:515] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:17.427047 25112 leader_election.cc:290] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [CANDIDATE]: Term 2 election: Requested vote from peers fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67:46015), f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807)
I20260709 13:09:17.427306 25261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a35d72572e44c649578014c84947af6" candidate_uuid: "7338488648e74f1a82a87347b5229cb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
I20260709 13:09:17.427606 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a35d72572e44c649578014c84947af6" candidate_uuid: "7338488648e74f1a82a87347b5229cb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
I20260709 13:09:17.428200 25261 raft_consensus.cc:3060] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.428269 25187 raft_consensus.cc:3055] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.428807 25187 raft_consensus.cc:740] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6f38c6f853d47919288d4688b8d8cdd, State: Running, Role: LEADER
I20260709 13:09:17.429711 25187 consensus_queue.cc:260] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:17.430927 25187 raft_consensus.cc:3060] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.435683 25261 raft_consensus.cc:2468] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7338488648e74f1a82a87347b5229cb7 in term 2.
I20260709 13:09:17.436589 25260 raft_consensus.cc:1240] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Rejecting Update request from peer f6f38c6f853d47919288d4688b8d8cdd for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:17.437099 25075 leader_election.cc:304] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:17.437330 25187 raft_consensus.cc:2468] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7338488648e74f1a82a87347b5229cb7 in term 2.
I20260709 13:09:17.438129 25332 raft_consensus.cc:2804] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.439474 25332 raft_consensus.cc:697] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 2 LEADER]: Becoming Leader. State: Replica: 7338488648e74f1a82a87347b5229cb7, State: Running, Role: LEADER
I20260709 13:09:17.440408 25332 consensus_queue.cc:237] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } }
I20260709 13:09:17.447144 25007 catalog_manager.cc:5697] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 reported cstate change: term changed from 1 to 2, leader changed from f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66) to 7338488648e74f1a82a87347b5229cb7 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "7338488648e74f1a82a87347b5229cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.451654 25332 consensus_queue.cc:1048] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.458124 25332 consensus_queue.cc:1048] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.470803 25317 consensus_queue.cc:1048] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.491096 25307 consensus_queue.cc:1048] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.499750 25341 raft_consensus.cc:993] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: : Instructing follower 7338488648e74f1a82a87347b5229cb7 to start an election
I20260709 13:09:17.500330 25307 raft_consensus.cc:1081] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Signalling peer 7338488648e74f1a82a87347b5229cb7 to start an election
I20260709 13:09:17.502122 25112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be"
dest_uuid: "7338488648e74f1a82a87347b5229cb7"
 from {username='slave'} at 127.0.0.1:45190
I20260709 13:09:17.502738 25112 raft_consensus.cc:493] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.503126 25112 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.509630 25112 raft_consensus.cc:515] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:17.511523 25112 leader_election.cc:290] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [CANDIDATE]: Term 2 election: Requested vote from peers f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807), fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67:46015)
I20260709 13:09:17.512624 25260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be" candidate_uuid: "7338488648e74f1a82a87347b5229cb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
I20260709 13:09:17.512495 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be" candidate_uuid: "7338488648e74f1a82a87347b5229cb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
I20260709 13:09:17.513548 25260 raft_consensus.cc:3055] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.513639 25187 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.513950 25260 raft_consensus.cc:740] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Running, Role: LEADER
I20260709 13:09:17.514930 25260 consensus_queue.cc:260] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:17.516448 25260 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.520591 25187 raft_consensus.cc:2468] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7338488648e74f1a82a87347b5229cb7 in term 2.
I20260709 13:09:17.522014 25078 leader_election.cc:304] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, f6f38c6f853d47919288d4688b8d8cdd; no voters: 
I20260709 13:09:17.522670 25260 raft_consensus.cc:2468] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7338488648e74f1a82a87347b5229cb7 in term 2.
I20260709 13:09:17.522969 25348 raft_consensus.cc:2804] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.523576 25348 raft_consensus.cc:697] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 2 LEADER]: Becoming Leader. State: Replica: 7338488648e74f1a82a87347b5229cb7, State: Running, Role: LEADER
I20260709 13:09:17.524487 25348 consensus_queue.cc:237] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:17.530759 25008 catalog_manager.cc:5697] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 reported cstate change: term changed from 1 to 2, leader changed from fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67) to 7338488648e74f1a82a87347b5229cb7 (127.13.245.65). New cstate: current_term: 2 leader_uuid: "7338488648e74f1a82a87347b5229cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.580097 25341 raft_consensus.cc:993] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e: : Instructing follower f6f38c6f853d47919288d4688b8d8cdd to start an election
I20260709 13:09:17.580617 25307 raft_consensus.cc:1081] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Signalling peer f6f38c6f853d47919288d4688b8d8cdd to start an election
I20260709 13:09:17.582330 25187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aa1b3b2237d4cc4a1fc56a5be91442b"
dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
 from {username='slave'} at 127.0.0.1:38320
I20260709 13:09:17.583295 25187 raft_consensus.cc:493] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.583693 25187 raft_consensus.cc:3060] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.589377 25187 raft_consensus.cc:515] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:17.591440 25187 leader_election.cc:290] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [CANDIDATE]: Term 2 election: Requested vote from peers 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923), fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67:46015)
I20260709 13:09:17.592345 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa1b3b2237d4cc4a1fc56a5be91442b" candidate_uuid: "f6f38c6f853d47919288d4688b8d8cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7338488648e74f1a82a87347b5229cb7"
I20260709 13:09:17.592871 25260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa1b3b2237d4cc4a1fc56a5be91442b" candidate_uuid: "f6f38c6f853d47919288d4688b8d8cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
I20260709 13:09:17.593004 25112 raft_consensus.cc:3060] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.593444 25260 raft_consensus.cc:3055] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.593736 25260 raft_consensus.cc:740] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Running, Role: LEADER
I20260709 13:09:17.594475 25260 consensus_queue.cc:260] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:17.595597 25260 raft_consensus.cc:3060] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.599489 25112 raft_consensus.cc:2468] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f38c6f853d47919288d4688b8d8cdd in term 2.
I20260709 13:09:17.601008 25150 leader_election.cc:304] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7338488648e74f1a82a87347b5229cb7, f6f38c6f853d47919288d4688b8d8cdd; no voters: 
I20260709 13:09:17.601606 25260 raft_consensus.cc:2468] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f38c6f853d47919288d4688b8d8cdd in term 2.
I20260709 13:09:17.601799 25344 raft_consensus.cc:2804] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.602402 25344 raft_consensus.cc:697] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 2 LEADER]: Becoming Leader. State: Replica: f6f38c6f853d47919288d4688b8d8cdd, State: Running, Role: LEADER
I20260709 13:09:17.603309 25344 consensus_queue.cc:237] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:17.610380 25008 catalog_manager.cc:5697] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd reported cstate change: term changed from 1 to 2, leader changed from fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67) to f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66). New cstate: current_term: 2 leader_uuid: "f6f38c6f853d47919288d4688b8d8cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.853056 14293 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:09:17.854717 14293 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:09:17.855094 14293 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:09:17.869169 25112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be"
dest_uuid: "7338488648e74f1a82a87347b5229cb7"
mode: GRACEFUL
new_leader_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
 from {username='slave'} at 127.0.0.1:45206
I20260709 13:09:17.869751 25112 raft_consensus.cc:606] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 2 LEADER]: Received request to transfer leadership to TS fa2feddd1bfe43eaa60ec0dcce6f875e
I20260709 13:09:17.871163 14293 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:09:17.886415 25260 raft_consensus.cc:1275] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Refusing update from remote peer 7338488648e74f1a82a87347b5229cb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:17.887918 25348 consensus_queue.cc:1048] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.898538 25187 raft_consensus.cc:1275] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Refusing update from remote peer 7338488648e74f1a82a87347b5229cb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:17.901170 25345 consensus_queue.cc:1048] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:18.072058 25260 raft_consensus.cc:1275] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Refusing update from remote peer f6f38c6f853d47919288d4688b8d8cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.073740 25344 consensus_queue.cc:1048] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.085610 25112 raft_consensus.cc:1275] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Refusing update from remote peer f6f38c6f853d47919288d4688b8d8cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.087716 25354 consensus_queue.cc:1048] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:18.094777 25187 raft_consensus.cc:1275] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Refusing update from remote peer 7338488648e74f1a82a87347b5229cb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.097345 25332 consensus_queue.cc:1048] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.104403 25260 raft_consensus.cc:1275] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Refusing update from remote peer 7338488648e74f1a82a87347b5229cb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.110216 25332 consensus_queue.cc:1048] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:18.186268 25332 raft_consensus.cc:993] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7: : Instructing follower fa2feddd1bfe43eaa60ec0dcce6f875e to start an election
I20260709 13:09:18.187736 25332 raft_consensus.cc:1081] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 2 LEADER]: Signalling peer fa2feddd1bfe43eaa60ec0dcce6f875e to start an election
I20260709 13:09:18.192104 25260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be"
dest_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e"
 from {username='slave'} at 127.0.0.1:43568
I20260709 13:09:18.193296 25260 raft_consensus.cc:493] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.193862 25260 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.204566 25260 raft_consensus.cc:515] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:18.207139 25260 leader_election.cc:290] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 3 election: Requested vote from peers 7338488648e74f1a82a87347b5229cb7 (127.13.245.65:43923), f6f38c6f853d47919288d4688b8d8cdd (127.13.245.66:33807)
I20260709 13:09:18.209580 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7338488648e74f1a82a87347b5229cb7"
I20260709 13:09:18.209743 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edc4031af184c3dab1d04f5d00699be" candidate_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6f38c6f853d47919288d4688b8d8cdd"
I20260709 13:09:18.210722 25112 raft_consensus.cc:3055] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:18.211040 25187 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.211133 25112 raft_consensus.cc:740] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7338488648e74f1a82a87347b5229cb7, State: Running, Role: LEADER
I20260709 13:09:18.212917 25112 consensus_queue.cc:260] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:18.215930 25112 raft_consensus.cc:3060] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.222039 25187 raft_consensus.cc:2468] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 3.
I20260709 13:09:18.224031 25227 leader_election.cc:304] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6f38c6f853d47919288d4688b8d8cdd, fa2feddd1bfe43eaa60ec0dcce6f875e; no voters: 
I20260709 13:09:18.225419 25307 raft_consensus.cc:2804] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:18.226665 25307 raft_consensus.cc:697] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 3 LEADER]: Becoming Leader. State: Replica: fa2feddd1bfe43eaa60ec0dcce6f875e, State: Running, Role: LEADER
I20260709 13:09:18.228034 25307 consensus_queue.cc:237] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } }
I20260709 13:09:18.228417 25112 raft_consensus.cc:2468] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2feddd1bfe43eaa60ec0dcce6f875e in term 3.
I20260709 13:09:18.235646 25009 catalog_manager.cc:5697] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e reported cstate change: term changed from 2 to 3, leader changed from 7338488648e74f1a82a87347b5229cb7 (127.13.245.65) to fa2feddd1bfe43eaa60ec0dcce6f875e (127.13.245.67). New cstate: current_term: 3 leader_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7338488648e74f1a82a87347b5229cb7" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 43923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f38c6f853d47919288d4688b8d8cdd" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2feddd1bfe43eaa60ec0dcce6f875e" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.260785 14293 tablet_server.cc:179] TabletServer@127.13.245.65:0 shutting down...
I20260709 13:09:18.295949 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:18.296787 14293 tablet_replica.cc:333] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7: stopping tablet replica
I20260709 13:09:18.297580 14293 raft_consensus.cc:2243] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.298091 14293 raft_consensus.cc:2272] T 3edc4031af184c3dab1d04f5d00699be P 7338488648e74f1a82a87347b5229cb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.302060 14293 tablet_replica.cc:333] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7: stopping tablet replica
I20260709 13:09:18.302731 14293 raft_consensus.cc:2243] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.304689 14293 raft_consensus.cc:2272] T 556d9f22431d4ad0bd028ee656fcb533 P 7338488648e74f1a82a87347b5229cb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.308871 14293 tablet_replica.cc:333] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7: stopping tablet replica
I20260709 13:09:18.309499 14293 raft_consensus.cc:2243] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.311214 14293 raft_consensus.cc:2272] T 2a35d72572e44c649578014c84947af6 P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.315160 14293 tablet_replica.cc:333] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7: stopping tablet replica
I20260709 13:09:18.315883 14293 raft_consensus.cc:2243] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.316522 14293 raft_consensus.cc:2272] T 1aa1b3b2237d4cc4a1fc56a5be91442b P 7338488648e74f1a82a87347b5229cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.348721 14293 tablet_server.cc:196] TabletServer@127.13.245.65:0 shutdown complete.
I20260709 13:09:18.370249 14293 tablet_server.cc:179] TabletServer@127.13.245.66:0 shutting down...
I20260709 13:09:18.396183 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:18.397099 14293 tablet_replica.cc:333] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd: stopping tablet replica
I20260709 13:09:18.398047 14293 raft_consensus.cc:2243] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.398720 14293 raft_consensus.cc:2272] T 3edc4031af184c3dab1d04f5d00699be P f6f38c6f853d47919288d4688b8d8cdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.402884 14293 tablet_replica.cc:333] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd: stopping tablet replica
I20260709 13:09:18.403717 14293 raft_consensus.cc:2243] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.404366 14293 raft_consensus.cc:2272] T 556d9f22431d4ad0bd028ee656fcb533 P f6f38c6f853d47919288d4688b8d8cdd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.408219 14293 tablet_replica.cc:333] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd: stopping tablet replica
I20260709 13:09:18.408866 14293 raft_consensus.cc:2243] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.409461 14293 raft_consensus.cc:2272] T 2a35d72572e44c649578014c84947af6 P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.413174 14293 tablet_replica.cc:333] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd: stopping tablet replica
I20260709 13:09:18.413769 14293 raft_consensus.cc:2243] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.415387 14293 raft_consensus.cc:2272] T 1aa1b3b2237d4cc4a1fc56a5be91442b P f6f38c6f853d47919288d4688b8d8cdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.437635 14293 tablet_server.cc:196] TabletServer@127.13.245.66:0 shutdown complete.
I20260709 13:09:18.460990 14293 tablet_server.cc:179] TabletServer@127.13.245.67:0 shutting down...
I20260709 13:09:18.495739 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:18.496486 14293 tablet_replica.cc:333] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: stopping tablet replica
I20260709 13:09:18.497210 14293 raft_consensus.cc:2243] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.497922 14293 pending_rounds.cc:70] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: Trying to abort 1 pending ops.
I20260709 13:09:18.498143 14293 pending_rounds.cc:77] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636078511067136 op_type: NO_OP noop_request { }
I20260709 13:09:18.498514 14293 raft_consensus.cc:2889] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:18.498793 14293 raft_consensus.cc:2272] T 3edc4031af184c3dab1d04f5d00699be P fa2feddd1bfe43eaa60ec0dcce6f875e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.501986 14293 tablet_replica.cc:333] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e: stopping tablet replica
I20260709 13:09:18.502601 14293 raft_consensus.cc:2243] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.503196 14293 raft_consensus.cc:2272] T 556d9f22431d4ad0bd028ee656fcb533 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.505908 14293 tablet_replica.cc:333] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e: stopping tablet replica
I20260709 13:09:18.506651 14293 raft_consensus.cc:2243] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.507280 14293 raft_consensus.cc:2272] T 1aa1b3b2237d4cc4a1fc56a5be91442b P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.510949 14293 tablet_replica.cc:333] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e: stopping tablet replica
I20260709 13:09:18.511523 14293 raft_consensus.cc:2243] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.512181 14293 raft_consensus.cc:2272] T 2a35d72572e44c649578014c84947af6 P fa2feddd1bfe43eaa60ec0dcce6f875e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.540477 14293 tablet_server.cc:196] TabletServer@127.13.245.67:0 shutdown complete.
I20260709 13:09:18.561233 14293 master.cc:562] Master@127.13.245.126:33221 shutting down...
I20260709 13:09:18.590198 14293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.590921 14293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.591341 14293 tablet_replica.cc:333] T 00000000000000000000000000000000 P e4a100c96f4d4a6f8283cc9f0ea7f06d: stopping tablet replica
I20260709 13:09:18.612591 14293 master.cc:584] Master@127.13.245.126:33221 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3065 ms)
[----------] 6 tests from LeaderRebalancerTest (343491 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:09:18.662803 14293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.245.126:39679
I20260709 13:09:18.664407 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:18.671345 25363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:18.673364 25364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:18.673712 25366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:18.675832 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:18.676905 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:18.677101 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:18.677309 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602558677272 us; error 0 us; skew 500 ppm
I20260709 13:09:18.677901 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:18.680918 14293 webserver.cc:533] Webserver started at http://127.13.245.126:42197/ using document root <none> and password file <none>
I20260709 13:09:18.681490 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:18.681697 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:18.682031 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:18.683373 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/master-0-root/instance:
uuid: "44a0029952ea4b06b29aff5b0e441b2b"
format_stamp: "Formatted at 2026-07-09 13:09:18 on dist-test-slave-fc6v"
I20260709 13:09:18.688970 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:18.693991 25371 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:18.694896 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:18.695317 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/master-0-root
uuid: "44a0029952ea4b06b29aff5b0e441b2b"
format_stamp: "Formatted at 2026-07-09 13:09:18 on dist-test-slave-fc6v"
I20260709 13:09:18.695895 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:18.732156 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:18.733819 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:18.780802 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.126:39679
I20260709 13:09:18.780932 25422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.126:39679 every 8 connection(s)
I20260709 13:09:18.785390 25423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.799463 25423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b: Bootstrap starting.
I20260709 13:09:18.805423 25423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.810496 25423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b: No bootstrap required, opened a new log
I20260709 13:09:18.813143 25423 raft_consensus.cc:359] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a0029952ea4b06b29aff5b0e441b2b" member_type: VOTER }
I20260709 13:09:18.813601 25423 raft_consensus.cc:385] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.813862 25423 raft_consensus.cc:740] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a0029952ea4b06b29aff5b0e441b2b, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.814478 25423 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a0029952ea4b06b29aff5b0e441b2b" member_type: VOTER }
I20260709 13:09:18.814958 25423 raft_consensus.cc:399] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:18.815168 25423 raft_consensus.cc:493] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:18.815471 25423 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.821292 25423 raft_consensus.cc:515] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a0029952ea4b06b29aff5b0e441b2b" member_type: VOTER }
I20260709 13:09:18.821883 25423 leader_election.cc:304] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44a0029952ea4b06b29aff5b0e441b2b; no voters: 
I20260709 13:09:18.823139 25423 leader_election.cc:290] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:18.823820 25426 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.825361 25426 raft_consensus.cc:697] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 1 LEADER]: Becoming Leader. State: Replica: 44a0029952ea4b06b29aff5b0e441b2b, State: Running, Role: LEADER
I20260709 13:09:18.826123 25426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a0029952ea4b06b29aff5b0e441b2b" member_type: VOTER }
I20260709 13:09:18.826539 25423 sys_catalog.cc:565] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:18.829576 25427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44a0029952ea4b06b29aff5b0e441b2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a0029952ea4b06b29aff5b0e441b2b" member_type: VOTER } }
I20260709 13:09:18.829805 25428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a0029952ea4b06b29aff5b0e441b2b. Latest consensus state: current_term: 1 leader_uuid: "44a0029952ea4b06b29aff5b0e441b2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a0029952ea4b06b29aff5b0e441b2b" member_type: VOTER } }
I20260709 13:09:18.830590 25427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:18.830621 25428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:18.833882 25432 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:18.839638 25432 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:18.846124 14293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:18.850184 25432 catalog_manager.cc:1383] Generated new cluster ID: c35ad109fbb34d159d8a269051074eb9
I20260709 13:09:18.850533 25432 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:18.869020 25432 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:18.870607 25432 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:18.890926 25432 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b: Generated new TSK 0
I20260709 13:09:18.891757 25432 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:18.914453 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:18.922160 25444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:18.923674 25445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:18.928898 25447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:18.929064 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:18.930284 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:18.930511 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:18.930723 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602558930700 us; error 0 us; skew 500 ppm
I20260709 13:09:18.931361 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:18.934108 14293 webserver.cc:533] Webserver started at http://127.13.245.65:33903/ using document root <none> and password file <none>
I20260709 13:09:18.934690 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:18.934908 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:18.935223 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:18.936805 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-0-root/instance:
uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
format_stamp: "Formatted at 2026-07-09 13:09:18 on dist-test-slave-fc6v"
I20260709 13:09:18.942543 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:09:18.947077 25452 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:18.948118 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:18.948509 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
format_stamp: "Formatted at 2026-07-09 13:09:18 on dist-test-slave-fc6v"
I20260709 13:09:18.948863 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:18.960600 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:18.962107 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:18.963943 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:18.966688 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:18.966949 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:18.967236 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:18.967446 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:19.019810 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:42365
I20260709 13:09:19.019918 25514 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:42365 every 8 connection(s)
I20260709 13:09:19.026173 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:19.035857 25520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:19.037335 25519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:19.042173 25515 heartbeater.cc:344] Connected to a master server at 127.13.245.126:39679
I20260709 13:09:19.042786 25515 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:19.043648 25522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:19.043877 25515 heartbeater.cc:507] Master 127.13.245.126:39679 requested a full tablet report, sending...
I20260709 13:09:19.044682 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:19.045936 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:19.046234 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:19.046448 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602559046409 us; error 0 us; skew 500 ppm
I20260709 13:09:19.047075 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:19.047060 25388 ts_manager.cc:194] Registered new tserver with Master: d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365)
I20260709 13:09:19.050143 25388 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57054
I20260709 13:09:19.050493 14293 webserver.cc:533] Webserver started at http://127.13.245.66:34371/ using document root <none> and password file <none>
I20260709 13:09:19.051193 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:19.051401 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:19.051782 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:19.053262 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-1-root/instance:
uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
format_stamp: "Formatted at 2026-07-09 13:09:19 on dist-test-slave-fc6v"
I20260709 13:09:19.058656 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:19.063194 25527 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:19.064296 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:19.064735 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-1-root
uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
format_stamp: "Formatted at 2026-07-09 13:09:19 on dist-test-slave-fc6v"
I20260709 13:09:19.065105 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:19.084182 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:19.085582 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:19.087260 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:19.089736 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:19.089974 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:19.090224 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:19.090440 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:19.136876 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.66:38965
I20260709 13:09:19.136998 25589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.66:38965 every 8 connection(s)
I20260709 13:09:19.142621 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:19.151405 25593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:19.152473 25594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:19.155699 25596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:19.156807 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:19.157554 25590 heartbeater.cc:344] Connected to a master server at 127.13.245.126:39679
I20260709 13:09:19.157997 25590 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:19.157994 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:19.158428 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:19.158646 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602559158620 us; error 0 us; skew 500 ppm
I20260709 13:09:19.159052 25590 heartbeater.cc:507] Master 127.13.245.126:39679 requested a full tablet report, sending...
I20260709 13:09:19.159339 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:19.161450 25388 ts_manager.cc:194] Registered new tserver with Master: bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:19.162583 14293 webserver.cc:533] Webserver started at http://127.13.245.67:38773/ using document root <none> and password file <none>
I20260709 13:09:19.163198 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:19.163249 25388 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57070
I20260709 13:09:19.163407 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:19.164008 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:19.165401 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-2-root/instance:
uuid: "873884a5b5414a60a19e0032108cef32"
format_stamp: "Formatted at 2026-07-09 13:09:19 on dist-test-slave-fc6v"
I20260709 13:09:19.170533 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:19.174320 25601 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:19.175112 14293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:09:19.175436 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-2-root
uuid: "873884a5b5414a60a19e0032108cef32"
format_stamp: "Formatted at 2026-07-09 13:09:19 on dist-test-slave-fc6v"
I20260709 13:09:19.175836 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602214968311-14293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:19.201565 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:19.202924 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:19.204429 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:19.206988 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:19.207223 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:19.207477 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:19.207717 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:19.255995 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.67:32797
I20260709 13:09:19.256114 25663 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.67:32797 every 8 connection(s)
I20260709 13:09:19.274147 25664 heartbeater.cc:344] Connected to a master server at 127.13.245.126:39679
I20260709 13:09:19.274703 25664 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:19.275588 25664 heartbeater.cc:507] Master 127.13.245.126:39679 requested a full tablet report, sending...
I20260709 13:09:19.277951 25388 ts_manager.cc:194] Registered new tserver with Master: 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:19.278649 14293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018766078s
I20260709 13:09:19.279525 25388 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57072
I20260709 13:09:19.310976 25388 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57080:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:19.314338 25388 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:19.408726 25627 tablet_service.cc:1511] Processing CreateTablet for tablet af165e01f8f7422598570900708e8fc8 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:19.410581 25627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af165e01f8f7422598570900708e8fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.410290 25552 tablet_service.cc:1511] Processing CreateTablet for tablet fe3eef16b7f34533bfeb162c201d9f28 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:19.411113 25555 tablet_service.cc:1511] Processing CreateTablet for tablet dec1a6107acf495cb824d25638aa6148 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:19.412645 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec1a6107acf495cb824d25638aa6148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.412688 25551 tablet_service.cc:1511] Processing CreateTablet for tablet 862fe6740c45420ba63831327761332b (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:19.414492 25551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862fe6740c45420ba63831327761332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.414844 25478 tablet_service.cc:1511] Processing CreateTablet for tablet af165e01f8f7422598570900708e8fc8 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:19.416467 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af165e01f8f7422598570900708e8fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.416208 25553 tablet_service.cc:1511] Processing CreateTablet for tablet af165e01f8f7422598570900708e8fc8 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:19.417107 25550 tablet_service.cc:1511] Processing CreateTablet for tablet 286c130c14624caebfd7c7255d8517b6 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:19.420841 25479 tablet_service.cc:1511] Processing CreateTablet for tablet f13f8e46642b463aaf81f7fd18b371ea (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:19.421357 25475 tablet_service.cc:1511] Processing CreateTablet for tablet 286c130c14624caebfd7c7255d8517b6 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:19.422142 25626 tablet_service.cc:1511] Processing CreateTablet for tablet fe3eef16b7f34533bfeb162c201d9f28 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:19.424847 25629 tablet_service.cc:1511] Processing CreateTablet for tablet dec1a6107acf495cb824d25638aa6148 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:19.426244 25549 tablet_service.cc:1511] Processing CreateTablet for tablet 49f18a2be6fc41258827f2e4b55264e9 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:19.427421 25474 tablet_service.cc:1511] Processing CreateTablet for tablet 49f18a2be6fc41258827f2e4b55264e9 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:19.428879 25476 tablet_service.cc:1511] Processing CreateTablet for tablet 862fe6740c45420ba63831327761332b (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:19.429927 25628 tablet_service.cc:1511] Processing CreateTablet for tablet f13f8e46642b463aaf81f7fd18b371ea (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:19.430459 25480 tablet_service.cc:1511] Processing CreateTablet for tablet dec1a6107acf495cb824d25638aa6148 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:19.420843 25625 tablet_service.cc:1511] Processing CreateTablet for tablet 862fe6740c45420ba63831327761332b (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:19.424167 25477 tablet_service.cc:1511] Processing CreateTablet for tablet fe3eef16b7f34533bfeb162c201d9f28 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:19.419071 25554 tablet_service.cc:1511] Processing CreateTablet for tablet f13f8e46642b463aaf81f7fd18b371ea (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:19.434701 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3eef16b7f34533bfeb162c201d9f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.435292 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 286c130c14624caebfd7c7255d8517b6 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:19.436947 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 286c130c14624caebfd7c7255d8517b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.440096 25628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13f8e46642b463aaf81f7fd18b371ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.442114 25623 tablet_service.cc:1511] Processing CreateTablet for tablet 49f18a2be6fc41258827f2e4b55264e9 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:19.443801 25623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f18a2be6fc41258827f2e4b55264e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.444486 25629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec1a6107acf495cb824d25638aa6148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.447870 25548 tablet_service.cc:1511] Processing CreateTablet for tablet 94350653ad1a4236950446d0b9b145e9 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:19.449040 25679 tablet_bootstrap.cc:492] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:19.450286 25473 tablet_service.cc:1511] Processing CreateTablet for tablet 94350653ad1a4236950446d0b9b145e9 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:19.451416 25625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862fe6740c45420ba63831327761332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.453382 25622 tablet_service.cc:1511] Processing CreateTablet for tablet 94350653ad1a4236950446d0b9b145e9 (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:19.454927 25622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94350653ad1a4236950446d0b9b145e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.456871 25472 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9d7d5a06304a419681491c70bae21f (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:19.422601 25479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13f8e46642b463aaf81f7fd18b371ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.458895 25555 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9d7d5a06304a419681491c70bae21f (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:19.460266 25472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9d7d5a06304a419681491c70bae21f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.461002 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec1a6107acf495cb824d25638aa6148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.463872 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862fe6740c45420ba63831327761332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.465903 25621 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9d7d5a06304a419681491c70bae21f (DEFAULT_TABLE table=test-workload [id=45d0e810c72d43d884644af64c5d0ae2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:19.467432 25621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9d7d5a06304a419681491c70bae21f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.467463 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3eef16b7f34533bfeb162c201d9f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.472795 25474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f18a2be6fc41258827f2e4b55264e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.475965 25473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94350653ad1a4236950446d0b9b145e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.479386 25553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af165e01f8f7422598570900708e8fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.488029 25475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 286c130c14624caebfd7c7255d8517b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.488029 25554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13f8e46642b463aaf81f7fd18b371ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.492453 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9d7d5a06304a419681491c70bae21f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.495965 25548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94350653ad1a4236950446d0b9b145e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.499989 25549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f18a2be6fc41258827f2e4b55264e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.503997 25552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3eef16b7f34533bfeb162c201d9f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.512073 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 286c130c14624caebfd7c7255d8517b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:19.581229 25679 tablet_bootstrap.cc:654] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.678112 25682 tablet_bootstrap.cc:492] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:19.685859 25679 tablet_bootstrap.cc:492] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:19.696496 25682 tablet_bootstrap.cc:654] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.697685 25680 tablet_bootstrap.cc:492] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:19.700340 25679 ts_tablet_manager.cc:1403] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.252s	user 0.022s	sys 0.008s
I20260709 13:09:19.706944 25679 raft_consensus.cc:359] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:19.707640 25679 raft_consensus.cc:385] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.707914 25679 raft_consensus.cc:740] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.708645 25679 consensus_queue.cc:260] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:19.710055 25680 tablet_bootstrap.cc:654] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.711180 25590 heartbeater.cc:499] Master 127.13.245.126:39679 was elected leader, sending a full tablet report...
I20260709 13:09:19.711737 25679 ts_tablet_manager.cc:1434] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:09:19.712843 25679 tablet_bootstrap.cc:492] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:19.712970 25682 tablet_bootstrap.cc:492] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:19.713629 25682 ts_tablet_manager.cc:1403] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.007s
I20260709 13:09:19.718035 25682 raft_consensus.cc:359] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.719038 25682 raft_consensus.cc:385] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.719456 25682 raft_consensus.cc:740] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.720311 25679 tablet_bootstrap.cc:654] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.720635 25682 consensus_queue.cc:260] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.723028 25680 tablet_bootstrap.cc:492] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:19.723820 25680 ts_tablet_manager.cc:1403] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 13:09:19.728520 25680 raft_consensus.cc:359] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.729467 25680 raft_consensus.cc:385] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.729784 25680 raft_consensus.cc:740] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.730837 25664 heartbeater.cc:499] Master 127.13.245.126:39679 was elected leader, sending a full tablet report...
I20260709 13:09:19.730800 25680 consensus_queue.cc:260] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.732465 25682 ts_tablet_manager.cc:1434] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.004s
I20260709 13:09:19.733788 25682 tablet_bootstrap.cc:492] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:19.734257 25679 tablet_bootstrap.cc:492] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:19.735054 25679 ts_tablet_manager.cc:1403] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:09:19.739439 25679 raft_consensus.cc:359] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.740490 25679 raft_consensus.cc:385] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.740900 25679 raft_consensus.cc:740] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.741786 25682 tablet_bootstrap.cc:654] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.742975 25515 heartbeater.cc:499] Master 127.13.245.126:39679 was elected leader, sending a full tablet report...
I20260709 13:09:19.743413 25680 ts_tablet_manager.cc:1434] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:09:19.744616 25680 tablet_bootstrap.cc:492] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:19.748943 25679 consensus_queue.cc:260] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.751672 25679 ts_tablet_manager.cc:1434] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.007s
I20260709 13:09:19.752012 25680 tablet_bootstrap.cc:654] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.752854 25679 tablet_bootstrap.cc:492] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:19.762300 25679 tablet_bootstrap.cc:654] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.778627 25682 tablet_bootstrap.cc:492] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:19.779367 25682 ts_tablet_manager.cc:1403] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.046s	user 0.035s	sys 0.004s
I20260709 13:09:19.781785 25684 raft_consensus.cc:493] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.782410 25684 raft_consensus.cc:515] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.782613 25682 raft_consensus.cc:359] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.783349 25682 raft_consensus.cc:385] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.783689 25682 raft_consensus.cc:740] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.784710 25682 consensus_queue.cc:260] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.787503 25682 ts_tablet_manager.cc:1434] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:19.788072 25686 raft_consensus.cc:493] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.788658 25686 raft_consensus.cc:515] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.793820 25686 leader_election.cc:290] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:19.795207 25682 tablet_bootstrap.cc:492] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:19.805080 25682 tablet_bootstrap.cc:654] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.805799 25684 leader_election.cc:290] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:19.809805 25680 tablet_bootstrap.cc:492] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:19.810137 25679 tablet_bootstrap.cc:492] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:19.810478 25680 ts_tablet_manager.cc:1403] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.008s
I20260709 13:09:19.810631 25679 ts_tablet_manager.cc:1403] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.029s
I20260709 13:09:19.814167 25679 raft_consensus.cc:359] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.814358 25680 raft_consensus.cc:359] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.815025 25679 raft_consensus.cc:385] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.815099 25680 raft_consensus.cc:385] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.815441 25679 raft_consensus.cc:740] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.815486 25680 raft_consensus.cc:740] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.816428 25679 consensus_queue.cc:260] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.816506 25680 consensus_queue.cc:260] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.819406 25679 ts_tablet_manager.cc:1434] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:09:19.820652 25679 tablet_bootstrap.cc:492] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:19.819406 25680 ts_tablet_manager.cc:1434] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:09:19.826217 25680 tablet_bootstrap.cc:492] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:19.828207 25679 tablet_bootstrap.cc:654] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.828884 25682 tablet_bootstrap.cc:492] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:19.829456 25682 ts_tablet_manager.cc:1403] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.004s
I20260709 13:09:19.832928 25682 raft_consensus.cc:359] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.833720 25682 raft_consensus.cc:385] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.834033 25682 raft_consensus.cc:740] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
W20260709 13:09:19.840937 25436 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:19.842571 25682 consensus_queue.cc:260] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.846354 25679 tablet_bootstrap.cc:492] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:19.846982 25679 ts_tablet_manager.cc:1403] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 13:09:19.849689 25680 tablet_bootstrap.cc:654] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.853989 25682 ts_tablet_manager.cc:1434] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 13:09:19.855165 25682 tablet_bootstrap.cc:492] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:19.863189 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af165e01f8f7422598570900708e8fc8" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:19.864424 25490 raft_consensus.cc:2468] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 0.
I20260709 13:09:19.850734 25679 raft_consensus.cc:359] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.867430 25679 raft_consensus.cc:385] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.867758 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af165e01f8f7422598570900708e8fc8" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:19.869045 25679 raft_consensus.cc:740] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.870054 25679 consensus_queue.cc:260] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
W20260709 13:09:19.870851 25602 leader_election.cc:343] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.871812 25682 tablet_bootstrap.cc:654] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.878950 25679 ts_tablet_manager.cc:1434] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 13:09:19.879274 25603 leader_election.cc:304] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: bcf2a1dc6ce04cb3a50346ca1e9d4033
I20260709 13:09:19.880539 25679 tablet_bootstrap.cc:492] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:19.880712 25686 raft_consensus.cc:2804] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.881162 25686 raft_consensus.cc:493] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.881554 25686 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.891469 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862fe6740c45420ba63831327761332b" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:19.891765 25680 tablet_bootstrap.cc:492] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:19.892371 25490 raft_consensus.cc:2468] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:19.892515 25680 ts_tablet_manager.cc:1403] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.026s
I20260709 13:09:19.894121 25529 leader_election.cc:304] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:19.895383 25684 raft_consensus.cc:2804] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.895867 25684 raft_consensus.cc:493] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.896185 25684 raft_consensus.cc:3060] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.896994 25680 raft_consensus.cc:359] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.898197 25680 raft_consensus.cc:385] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.898607 25680 raft_consensus.cc:740] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.900063 25686 raft_consensus.cc:515] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.899888 25680 consensus_queue.cc:260] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.903970 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af165e01f8f7422598570900708e8fc8" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
W20260709 13:09:19.905591 25602 leader_election.cc:343] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.905664 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af165e01f8f7422598570900708e8fc8" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:19.906358 25490 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.908633 25686 leader_election.cc:290] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:19.911404 25680 ts_tablet_manager.cc:1434] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.002s
I20260709 13:09:19.912338 25682 tablet_bootstrap.cc:492] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:19.912799 25680 tablet_bootstrap.cc:492] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:19.912972 25682 ts_tablet_manager.cc:1403] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.023s
I20260709 13:09:19.916584 25682 raft_consensus.cc:359] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:19.917393 25682 raft_consensus.cc:385] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.917698 25682 raft_consensus.cc:740] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.918618 25682 consensus_queue.cc:260] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:19.920761 25680 tablet_bootstrap.cc:654] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.921550 25682 ts_tablet_manager.cc:1434] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:09:19.922737 25682 tablet_bootstrap.cc:492] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:19.922919 25684 raft_consensus.cc:515] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.926944 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862fe6740c45420ba63831327761332b" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:19.927965 25639 raft_consensus.cc:2468] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:19.928185 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862fe6740c45420ba63831327761332b" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:19.928978 25489 raft_consensus.cc:3060] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.930230 25680 tablet_bootstrap.cc:492] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:19.930927 25680 ts_tablet_manager.cc:1403] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 13:09:19.931354 25682 tablet_bootstrap.cc:654] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.932853 25684 leader_election.cc:290] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:19.928925 25490 raft_consensus.cc:2468] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 1.
I20260709 13:09:19.933910 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862fe6740c45420ba63831327761332b" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:19.934590 25639 raft_consensus.cc:3060] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.936410 25680 raft_consensus.cc:359] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:19.937707 25680 raft_consensus.cc:385] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.938191 25680 raft_consensus.cc:740] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.939589 25680 consensus_queue.cc:260] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:19.943287 25680 ts_tablet_manager.cc:1434] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:09:19.945379 25680 tablet_bootstrap.cc:492] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:19.946866 25603 leader_election.cc:304] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: bcf2a1dc6ce04cb3a50346ca1e9d4033
I20260709 13:09:19.948247 25686 raft_consensus.cc:2804] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.955943 25680 tablet_bootstrap.cc:654] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.957402 25639 raft_consensus.cc:2468] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:19.959522 25531 leader_election.cc:304] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:19.960620 25684 raft_consensus.cc:2804] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.969790 25703 raft_consensus.cc:493] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.970481 25703 raft_consensus.cc:515] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.967463 25686 raft_consensus.cc:697] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:19.976733 25686 consensus_queue.cc:237] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.982858 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3eef16b7f34533bfeb162c201d9f28" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:19.983330 25703 leader_election.cc:290] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:19.984820 25489 raft_consensus.cc:2468] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:19.984897 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3eef16b7f34533bfeb162c201d9f28" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
W20260709 13:09:19.985111 25603 leader_election.cc:343] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:19.987275 25602 leader_election.cc:343] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.992632 25706 raft_consensus.cc:493] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.993443 25706 raft_consensus.cc:515] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:19.994758 25680 tablet_bootstrap.cc:492] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:19.995440 25680 ts_tablet_manager.cc:1403] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.016s
I20260709 13:09:19.997295 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec1a6107acf495cb824d25638aa6148" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:19.997932 25602 leader_election.cc:304] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873884a5b5414a60a19e0032108cef32; no voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:19.998558 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec1a6107acf495cb824d25638aa6148" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:19.999004 25639 raft_consensus.cc:2468] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:19.999234 25489 raft_consensus.cc:2468] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:20.003439 25682 tablet_bootstrap.cc:492] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:20.004333 25529 leader_election.cc:304] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.000416 25703 raft_consensus.cc:2749] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.006697 25682 ts_tablet_manager.cc:1403] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.026s
I20260709 13:09:20.008584 25684 raft_consensus.cc:697] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:20.008344 25680 raft_consensus.cc:359] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.008421 25679 tablet_bootstrap.cc:654] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.009385 25680 raft_consensus.cc:385] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.009775 25684 consensus_queue.cc:237] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.010919 25707 raft_consensus.cc:2804] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.011734 25682 raft_consensus.cc:359] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.009789 25680 raft_consensus.cc:740] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.012926 25682 raft_consensus.cc:385] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.013345 25682 raft_consensus.cc:740] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.014180 25707 raft_consensus.cc:493] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.013701 25680 consensus_queue.cc:260] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.016140 25707 raft_consensus.cc:3060] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.014361 25682 consensus_queue.cc:260] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:19.997891 25706 leader_election.cc:290] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797), d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365)
I20260709 13:09:20.020519 25682 ts_tablet_manager.cc:1434] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:20.022053 25682 tablet_bootstrap.cc:492] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:20.018009 25680 ts_tablet_manager.cc:1434] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:09:20.024780 25680 tablet_bootstrap.cc:492] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:20.034811 25682 tablet_bootstrap.cc:654] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.040802 25387 catalog_manager.cc:5697] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.042668 25707 raft_consensus.cc:515] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:20.043978 25680 tablet_bootstrap.cc:654] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.046587 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec1a6107acf495cb824d25638aa6148" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.047381 25639 raft_consensus.cc:3060] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.051013 25679 tablet_bootstrap.cc:492] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:20.052992 25679 ts_tablet_manager.cc:1403] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.173s	user 0.021s	sys 0.015s
I20260709 13:09:20.053418 25386 catalog_manager.cc:5697] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.051728 25682 tablet_bootstrap.cc:492] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:20.055439 25682 ts_tablet_manager.cc:1403] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:09:20.058794 25682 raft_consensus.cc:359] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.059518 25682 raft_consensus.cc:385] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.059875 25682 raft_consensus.cc:740] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.060779 25639 raft_consensus.cc:2468] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:20.060907 25682 consensus_queue.cc:260] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.062537 25679 raft_consensus.cc:359] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.063513 25531 leader_election.cc:304] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:20.064301 25682 ts_tablet_manager.cc:1434] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:09:20.063974 25679 raft_consensus.cc:385] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.065047 25684 raft_consensus.cc:2804] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.065104 25679 raft_consensus.cc:740] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.065827 25682 tablet_bootstrap.cc:492] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:20.066202 25684 raft_consensus.cc:697] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:20.067862 25679 consensus_queue.cc:260] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.068081 25684 consensus_queue.cc:237] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:20.070044 25707 leader_election.cc:290] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797), d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365)
I20260709 13:09:20.071668 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec1a6107acf495cb824d25638aa6148" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:20.076454 25489 raft_consensus.cc:3060] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.083351 25679 ts_tablet_manager.cc:1434] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 13:09:20.085201 25679 tablet_bootstrap.cc:492] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:20.088177 25489 raft_consensus.cc:2468] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:20.072891 25680 tablet_bootstrap.cc:492] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:20.089972 25680 ts_tablet_manager.cc:1403] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.024s
I20260709 13:09:20.091213 25688 raft_consensus.cc:493] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.092024 25688 raft_consensus.cc:515] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.094576 25679 tablet_bootstrap.cc:654] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.075497 25682 tablet_bootstrap.cc:654] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.102613 25680 raft_consensus.cc:359] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.103681 25680 raft_consensus.cc:385] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.103996 25680 raft_consensus.cc:740] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.104889 25680 consensus_queue.cc:260] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.109570 25688 leader_election.cc:290] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.141906 25680 ts_tablet_manager.cc:1434] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.051s	user 0.012s	sys 0.012s
I20260709 13:09:20.144007 25680 tablet_bootstrap.cc:492] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:20.153663 25682 tablet_bootstrap.cc:492] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:20.154610 25682 ts_tablet_manager.cc:1403] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.024s
I20260709 13:09:20.155076 25680 tablet_bootstrap.cc:654] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.160753 25684 raft_consensus.cc:493] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.161684 25684 raft_consensus.cc:515] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.167739 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
W20260709 13:09:20.170127 25531 leader_election.cc:343] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.171087 25684 leader_election.cc:290] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.175597 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:20.175846 25679 tablet_bootstrap.cc:492] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:20.172235 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:20.176447 25489 raft_consensus.cc:2468] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:20.176730 25679 ts_tablet_manager.cc:1403] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.092s	user 0.039s	sys 0.032s
I20260709 13:09:20.176955 25565 raft_consensus.cc:2468] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:20.178756 25453 leader_election.cc:304] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.180456 25529 leader_election.cc:304] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32
I20260709 13:09:20.180776 25722 raft_consensus.cc:2804] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.181207 25722 raft_consensus.cc:493] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.181559 25684 raft_consensus.cc:2804] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.182008 25684 raft_consensus.cc:493] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.182541 25684 raft_consensus.cc:3060] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.171517 25387 catalog_manager.cc:5697] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.182061 25679 raft_consensus.cc:359] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.184619 25679 raft_consensus.cc:385] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.184958 25679 raft_consensus.cc:740] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.185956 25679 consensus_queue.cc:260] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.186645 25680 tablet_bootstrap.cc:492] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:20.187481 25680 ts_tablet_manager.cc:1403] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.017s
I20260709 13:09:20.188791 25679 ts_tablet_manager.cc:1434] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:09:20.189949 25679 tablet_bootstrap.cc:492] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:20.191591 25680 raft_consensus.cc:359] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.192602 25680 raft_consensus.cc:385] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.193040 25680 raft_consensus.cc:740] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.181553 25722 raft_consensus.cc:3060] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.194253 25680 consensus_queue.cc:260] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.197199 25680 ts_tablet_manager.cc:1434] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:20.197330 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:20.198896 25680 tablet_bootstrap.cc:492] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:20.199985 25679 tablet_bootstrap.cc:654] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.205870 25684 raft_consensus.cc:515] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.172480 25682 raft_consensus.cc:359] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.208248 25680 tablet_bootstrap.cc:654] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.208559 25682 raft_consensus.cc:385] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.208982 25682 raft_consensus.cc:740] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.210083 25682 consensus_queue.cc:260] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.211323 25639 raft_consensus.cc:2468] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:20.213423 25682 ts_tablet_manager.cc:1434] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 13:09:20.218811 25679 tablet_bootstrap.cc:492] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:20.219617 25679 ts_tablet_manager.cc:1403] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.003s
I20260709 13:09:20.223881 25679 raft_consensus.cc:359] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.224807 25679 raft_consensus.cc:385] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.225152 25679 raft_consensus.cc:740] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.226154 25679 consensus_queue.cc:260] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.229081 25707 raft_consensus.cc:493] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.229733 25707 raft_consensus.cc:515] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.230451 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:20.233361 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "286c130c14624caebfd7c7255d8517b6" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:20.233609 25707 leader_election.cc:290] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.233827 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.234190 25490 raft_consensus.cc:2468] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:20.234721 25639 raft_consensus.cc:3060] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.235688 25529 leader_election.cc:304] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.237134 25707 raft_consensus.cc:2804] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.237528 25707 raft_consensus.cc:493] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.237900 25707 raft_consensus.cc:3060] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.241415 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "286c130c14624caebfd7c7255d8517b6" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:20.242616 25638 raft_consensus.cc:2468] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:20.215350 25682 tablet_bootstrap.cc:492] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:20.247315 25679 ts_tablet_manager.cc:1434] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:09:20.248726 25679 tablet_bootstrap.cc:492] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:20.249085 25707 raft_consensus.cc:515] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.245057 25684 leader_election.cc:290] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.226737 25722 raft_consensus.cc:515] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.252979 25489 raft_consensus.cc:2393] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in current term 1: Already voted for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in this term.
I20260709 13:09:20.253631 25680 tablet_bootstrap.cc:492] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:20.253789 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "286c130c14624caebfd7c7255d8517b6" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:20.254460 25680 ts_tablet_manager.cc:1403] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.038s
I20260709 13:09:20.254653 25490 raft_consensus.cc:3060] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.256659 25679 tablet_bootstrap.cc:654] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.257941 25680 raft_consensus.cc:359] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.258781 25680 raft_consensus.cc:385] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.259107 25680 raft_consensus.cc:740] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.260131 25680 consensus_queue.cc:260] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.269286 25490 raft_consensus.cc:2468] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:20.269985 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "286c130c14624caebfd7c7255d8517b6" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.270718 25638 raft_consensus.cc:3060] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.271271 25680 ts_tablet_manager.cc:1434] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:20.277241 25529 leader_election.cc:304] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.277856 25684 raft_consensus.cc:493] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.278333 25680 tablet_bootstrap.cc:492] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:20.278472 25684 raft_consensus.cc:515] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.279173 25706 raft_consensus.cc:2804] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.282720 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94350653ad1a4236950446d0b9b145e9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:20.283918 25637 raft_consensus.cc:2468] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:20.284662 25638 raft_consensus.cc:2468] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:20.285516 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94350653ad1a4236950446d0b9b145e9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:20.286491 25489 raft_consensus.cc:2468] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:20.287770 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:20.288666 25565 raft_consensus.cc:2393] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d58a0a13e5c34fb3bf3162e55c0ed08d in current term 1: Already voted for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in this term.
I20260709 13:09:20.289207 25531 leader_election.cc:304] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:20.290481 25707 leader_election.cc:290] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.291343 25684 leader_election.cc:290] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.292073 25684 raft_consensus.cc:2804] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.292522 25684 raft_consensus.cc:493] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.292925 25684 raft_consensus.cc:3060] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.293910 25706 raft_consensus.cc:697] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:20.294940 25706 consensus_queue.cc:237] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.295699 25680 tablet_bootstrap.cc:654] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.295799 25679 tablet_bootstrap.cc:492] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:20.296584 25679 ts_tablet_manager.cc:1403] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.027s
I20260709 13:09:20.296711 25639 raft_consensus.cc:2468] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:20.298518 25531 leader_election.cc:304] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:20.299418 25707 raft_consensus.cc:2804] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.299959 25707 raft_consensus.cc:697] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:20.300417 25679 raft_consensus.cc:359] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.301299 25679 raft_consensus.cc:385] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.301651 25679 raft_consensus.cc:740] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.302718 25679 consensus_queue.cc:260] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.301690 25722 leader_election.cc:290] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.300849 25707 consensus_queue.cc:237] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.306856 25679 ts_tablet_manager.cc:1434] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:09:20.307991 25679 tablet_bootstrap.cc:492] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:20.311990 25682 tablet_bootstrap.cc:654] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.309732 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.320077 25639 raft_consensus.cc:2393] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d58a0a13e5c34fb3bf3162e55c0ed08d in current term 1: Already voted for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in this term.
I20260709 13:09:20.322237 25456 leader_election.cc:304] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033
I20260709 13:09:20.324322 25722 raft_consensus.cc:2749] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.326956 25679 tablet_bootstrap.cc:654] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.326607 25684 raft_consensus.cc:515] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.328528 25387 catalog_manager.cc:5697] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.330322 25680 tablet_bootstrap.cc:492] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:20.330870 25680 ts_tablet_manager.cc:1403] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.019s
I20260709 13:09:20.332847 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94350653ad1a4236950446d0b9b145e9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:20.333871 25490 raft_consensus.cc:3060] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.334340 25680 raft_consensus.cc:359] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.335096 25680 raft_consensus.cc:385] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.335438 25680 raft_consensus.cc:740] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.336772 25680 consensus_queue.cc:260] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.339180 25680 ts_tablet_manager.cc:1434] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:20.356213 25490 raft_consensus.cc:2468] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:20.358235 25529 leader_election.cc:304] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.359285 25707 raft_consensus.cc:2804] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.359355 25684 leader_election.cc:290] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.359948 25707 raft_consensus.cc:697] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:20.360662 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94350653ad1a4236950446d0b9b145e9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.361538 25639 raft_consensus.cc:3060] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.361056 25707 consensus_queue.cc:237] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.362954 25682 tablet_bootstrap.cc:492] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:20.363581 25682 ts_tablet_manager.cc:1403] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.149s	user 0.018s	sys 0.000s
I20260709 13:09:20.367213 25679 tablet_bootstrap.cc:492] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:20.366901 25682 raft_consensus.cc:359] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.367707 25682 raft_consensus.cc:385] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.367835 25679 ts_tablet_manager.cc:1403] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.019s
I20260709 13:09:20.368115 25682 raft_consensus.cc:740] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.368999 25682 consensus_queue.cc:260] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.369624 25639 raft_consensus.cc:2468] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:20.359750 25388 catalog_manager.cc:5697] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.371085 25679 raft_consensus.cc:359] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.371865 25679 raft_consensus.cc:385] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.372136 25679 raft_consensus.cc:740] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.372996 25679 consensus_queue.cc:260] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.374137 25682 ts_tablet_manager.cc:1434] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:20.375288 25682 tablet_bootstrap.cc:492] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:20.375465 25679 ts_tablet_manager.cc:1434] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:20.384501 25722 raft_consensus.cc:493] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.385227 25722 raft_consensus.cc:515] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.386607 25682 tablet_bootstrap.cc:654] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.387346 25722 leader_election.cc:290] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.388686 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9d7d5a06304a419681491c70bae21f" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:20.388686 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9d7d5a06304a419681491c70bae21f" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:20.389628 25565 raft_consensus.cc:2468] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
W20260709 13:09:20.390307 25456 leader_election.cc:343] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.389074 25386 catalog_manager.cc:5697] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.392128 25453 leader_election.cc:304] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32
I20260709 13:09:20.392910 25722 raft_consensus.cc:2804] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.393352 25722 raft_consensus.cc:493] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.393746 25722 raft_consensus.cc:3060] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.396037 25682 tablet_bootstrap.cc:492] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:20.396703 25682 ts_tablet_manager.cc:1403] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 13:09:20.400028 25682 raft_consensus.cc:359] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.400758 25682 raft_consensus.cc:385] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.401008 25682 raft_consensus.cc:740] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.401813 25682 consensus_queue.cc:260] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.402491 25722 raft_consensus.cc:515] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.404096 25682 ts_tablet_manager.cc:1434] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:20.405593 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9d7d5a06304a419681491c70bae21f" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:20.405988 25688 raft_consensus.cc:493] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.406296 25565 raft_consensus.cc:3060] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.406555 25688 raft_consensus.cc:515] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.408847 25688 leader_election.cc:290] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.410187 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:20.410960 25639 raft_consensus.cc:2468] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:20.411038 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:20.411767 25564 raft_consensus.cc:2468] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:20.412380 25722 leader_election.cc:290] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.413046 25456 leader_election.cc:304] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.413192 25707 consensus_queue.cc:1048] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.414930 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9d7d5a06304a419681491c70bae21f" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.415577 25638 raft_consensus.cc:3060] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.417704 25722 raft_consensus.cc:2804] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.418325 25722 raft_consensus.cc:493] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.418777 25722 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.421824 25638 raft_consensus.cc:2468] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 1.
I20260709 13:09:20.422333 25565 raft_consensus.cc:2468] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 1.
I20260709 13:09:20.423210 25456 leader_election.cc:304] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.424575 25688 raft_consensus.cc:2804] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.427796 25688 raft_consensus.cc:697] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:20.428895 25688 consensus_queue.cc:237] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.431303 25722 raft_consensus.cc:515] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.435168 25722 leader_election.cc:290] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.435195 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:20.436092 25565 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.436511 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.437187 25638 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.445472 25565 raft_consensus.cc:2468] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 1.
I20260709 13:09:20.447365 25453 leader_election.cc:304] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.448483 25722 raft_consensus.cc:2804] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.449040 25722 raft_consensus.cc:697] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:20.447070 25684 consensus_queue.cc:1048] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.450029 25722 consensus_queue.cc:237] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.454766 25638 raft_consensus.cc:2468] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 1.
I20260709 13:09:20.455317 25388 catalog_manager.cc:5697] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 0 to 1, leader changed from <none> to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 1 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.480381 25388 catalog_manager.cc:5697] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 0 to 1, leader changed from <none> to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 1 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.482928 25722 raft_consensus.cc:493] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.483505 25722 raft_consensus.cc:515] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.486137 25722 leader_election.cc:290] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.486701 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3eef16b7f34533bfeb162c201d9f28" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:20.486835 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3eef16b7f34533bfeb162c201d9f28" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:20.487680 25565 raft_consensus.cc:2468] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:20.487725 25638 raft_consensus.cc:2468] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:20.489123 25453 leader_election.cc:304] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.489971 25722 raft_consensus.cc:2804] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.490338 25722 raft_consensus.cc:493] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.490656 25722 raft_consensus.cc:3060] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.496793 25722 raft_consensus.cc:515] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.498652 25722 leader_election.cc:290] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.499534 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3eef16b7f34533bfeb162c201d9f28" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:20.500154 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3eef16b7f34533bfeb162c201d9f28" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.500288 25565 raft_consensus.cc:3060] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.500821 25638 raft_consensus.cc:3060] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.502957 25686 consensus_queue.cc:1048] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.509214 25638 raft_consensus.cc:2468] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 1.
I20260709 13:09:20.510429 25565 raft_consensus.cc:2468] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 1.
I20260709 13:09:20.511101 25456 leader_election.cc:304] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:20.512182 25722 raft_consensus.cc:2804] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.512712 25722 raft_consensus.cc:697] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:20.512595 25684 consensus_queue.cc:1048] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.513754 25722 consensus_queue.cc:237] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.523355 25565 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.527789 25388 catalog_manager.cc:5697] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 0 to 1, leader changed from <none> to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 1 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.542092 25727 consensus_queue.cc:1048] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.542351 25703 consensus_queue.cc:1048] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.588411 25565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dec1a6107acf495cb824d25638aa6148"
dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
mode: GRACEFUL
new_leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:09:20.589005 25565 raft_consensus.cc:606] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Received request to transfer leadership to TS d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:20.594521 25565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea"
dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
mode: GRACEFUL
new_leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:09:20.595075 25565 raft_consensus.cc:606] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Received request to transfer leadership to TS d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:20.609110 25638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af165e01f8f7422598570900708e8fc8"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
mode: GRACEFUL
new_leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:49470
I20260709 13:09:20.609741 25638 raft_consensus.cc:606] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Received request to transfer leadership to TS d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:20.632661 25490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
mode: GRACEFUL
new_leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
 from {username='slave'} at 127.0.0.1:38338
I20260709 13:09:20.633296 25490 raft_consensus.cc:606] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Received request to transfer leadership to TS bcf2a1dc6ce04cb3a50346ca1e9d4033
I20260709 13:09:20.641705 25490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9d7d5a06304a419681491c70bae21f"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
mode: GRACEFUL
new_leader_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:38338
I20260709 13:09:20.642316 25490 raft_consensus.cc:606] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Received request to transfer leadership to TS 873884a5b5414a60a19e0032108cef32
I20260709 13:09:20.707650 25727 consensus_queue.cc:1048] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.721047 25728 consensus_queue.cc:1048] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.786573 25728 consensus_queue.cc:1048] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.794245 25727 raft_consensus.cc:993] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033: : Instructing follower d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:20.794853 25707 raft_consensus.cc:1081] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Signalling peer d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:20.796881 25489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:40926
I20260709 13:09:20.797521 25489 raft_consensus.cc:493] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:20.797956 25489 raft_consensus.cc:3060] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.801514 25707 consensus_queue.cc:1048] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.806284 25489 raft_consensus.cc:515] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.807364 25490 raft_consensus.cc:1240] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Rejecting Update request from peer bcf2a1dc6ce04cb3a50346ca1e9d4033 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:20.809917 25489 leader_election.cc:290] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:20.810640 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:20.809737 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13f8e46642b463aaf81f7fd18b371ea" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:20.811834 25565 raft_consensus.cc:3055] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:20.812181 25565 raft_consensus.cc:740] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:20.813206 25565 consensus_queue.cc:260] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.814265 25565 raft_consensus.cc:3060] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.822319 25565 raft_consensus.cc:2468] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:20.823395 25453 leader_election.cc:304] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32
I20260709 13:09:20.824294 25722 raft_consensus.cc:2804] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.824836 25722 raft_consensus.cc:697] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:20.825631 25722 consensus_queue.cc:237] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.832696 25388 catalog_manager.cc:5697] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 1 to 2, leader changed from bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66) to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 2 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.851332 25707 consensus_queue.cc:1048] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.863801 25727 consensus_queue.cc:1048] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.896031 25722 consensus_queue.cc:1048] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.904660 25737 consensus_queue.cc:1048] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.910126 25737 consensus_queue.cc:1048] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.931969 25761 consensus_queue.cc:1048] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.941872 25737 raft_consensus.cc:993] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d: : Instructing follower 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:20.942466 25761 raft_consensus.cc:1081] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Signalling peer 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:20.944430 25638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a9d7d5a06304a419681491c70bae21f"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:09:20.945108 25638 raft_consensus.cc:493] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:20.945689 25638 raft_consensus.cc:3060] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.952584 25638 raft_consensus.cc:515] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.955432 25638 leader_election.cc:290] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 2 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:20.955690 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9d7d5a06304a419681491c70bae21f" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:20.956018 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9d7d5a06304a419681491c70bae21f" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:20.956499 25490 raft_consensus.cc:3055] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:20.956718 25565 raft_consensus.cc:3060] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.956928 25490 raft_consensus.cc:740] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:20.957917 25490 consensus_queue.cc:260] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.958602 25761 consensus_queue.cc:1048] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.959438 25490 raft_consensus.cc:3060] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.967612 25565 raft_consensus.cc:2468] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 2.
I20260709 13:09:20.969599 25602 leader_election.cc:304] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:20.971058 25703 raft_consensus.cc:2804] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.971805 25703 raft_consensus.cc:697] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 2 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:20.972899 25703 consensus_queue.cc:237] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:20.973906 25490 raft_consensus.cc:2468] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 2.
I20260709 13:09:20.981947 25761 consensus_queue.cc:1048] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.985880 25388 catalog_manager.cc:5697] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 1 to 2, leader changed from d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65) to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.991012 25688 raft_consensus.cc:993] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: : Instructing follower bcf2a1dc6ce04cb3a50346ca1e9d4033 to start an election
I20260709 13:09:20.991681 25761 raft_consensus.cc:1081] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Signalling peer bcf2a1dc6ce04cb3a50346ca1e9d4033 to start an election
I20260709 13:09:20.993388 25565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9"
dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:09:20.994016 25565 raft_consensus.cc:493] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:20.994419 25565 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.002207 25565 raft_consensus.cc:515] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:21.004648 25565 leader_election.cc:290] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 2 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:21.005718 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:21.005990 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:21.006567 25490 raft_consensus.cc:3055] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:21.006672 25638 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.006943 25490 raft_consensus.cc:740] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:21.007885 25490 consensus_queue.cc:260] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:21.008981 25490 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.013592 25638 raft_consensus.cc:2468] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 2.
I20260709 13:09:21.014881 25490 raft_consensus.cc:2468] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 2.
I20260709 13:09:21.014958 25531 leader_election.cc:304] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:21.015937 25728 raft_consensus.cc:2804] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.016449 25728 raft_consensus.cc:697] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:21.017225 25728 consensus_queue.cc:237] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:21.024106 25388 catalog_manager.cc:5697] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 1 to 2, leader changed from d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65) to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.035969 25727 raft_consensus.cc:993] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033: : Instructing follower d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:21.036460 25728 raft_consensus.cc:1081] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Signalling peer d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:21.037904 25490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dec1a6107acf495cb824d25638aa6148"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:40926
I20260709 13:09:21.038417 25490 raft_consensus.cc:493] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.038741 25490 raft_consensus.cc:3060] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.045082 25490 raft_consensus.cc:515] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:21.047329 25490 leader_election.cc:290] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:21.048628 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec1a6107acf495cb824d25638aa6148" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:21.048985 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec1a6107acf495cb824d25638aa6148" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:21.049384 25638 raft_consensus.cc:3060] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.049697 25565 raft_consensus.cc:3055] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:21.050065 25565 raft_consensus.cc:740] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:21.050944 25565 consensus_queue.cc:260] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:21.052259 25565 raft_consensus.cc:3060] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.056609 25638 raft_consensus.cc:2468] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:21.057987 25456 leader_election.cc:304] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:21.058081 25565 raft_consensus.cc:2468] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:21.058951 25761 raft_consensus.cc:2804] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.059572 25761 raft_consensus.cc:697] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:21.060596 25761 consensus_queue.cc:237] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } }
I20260709 13:09:21.067880 25388 catalog_manager.cc:5697] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 1 to 2, leader changed from bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66) to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 2 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.074678 25686 raft_consensus.cc:993] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32: : Instructing follower d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:21.075281 25686 raft_consensus.cc:1081] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Signalling peer d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:21.076994 25490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af165e01f8f7422598570900708e8fc8"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:40940
I20260709 13:09:21.077610 25490 raft_consensus.cc:493] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.077929 25490 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.083776 25490 raft_consensus.cc:515] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:21.085593 25490 leader_election.cc:290] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:21.086577 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af165e01f8f7422598570900708e8fc8" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:21.086699 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af165e01f8f7422598570900708e8fc8" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:21.087383 25565 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.087425 25638 raft_consensus.cc:3055] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:21.088002 25638 raft_consensus.cc:740] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:21.088850 25638 consensus_queue.cc:260] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:21.090016 25638 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.093571 25565 raft_consensus.cc:2468] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:21.094980 25453 leader_election.cc:304] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:21.095842 25761 raft_consensus.cc:2804] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.096057 25638 raft_consensus.cc:2468] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:21.096378 25761 raft_consensus.cc:697] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:21.097354 25761 consensus_queue.cc:237] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:21.104542 25388 catalog_manager.cc:5697] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 1 to 2, leader changed from 873884a5b5414a60a19e0032108cef32 (127.13.245.67) to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 2 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.312089 25565 raft_consensus.cc:1275] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.313591 25761 consensus_queue.cc:1048] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.322322 25638 raft_consensus.cc:3060] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.331825 25638 raft_consensus.cc:1275] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.333528 25761 consensus_queue.cc:1048] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.411172 25638 raft_consensus.cc:1275] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Refusing update from remote peer bcf2a1dc6ce04cb3a50346ca1e9d4033: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.412664 25728 consensus_queue.cc:1048] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.422811 25490 raft_consensus.cc:1275] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Refusing update from remote peer bcf2a1dc6ce04cb3a50346ca1e9d4033: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.424235 25727 consensus_queue.cc:1048] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.565091 25565 raft_consensus.cc:1275] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.567019 25686 consensus_queue.cc:1048] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.577693 25490 raft_consensus.cc:1275] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.579487 25766 consensus_queue.cc:1048] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.598307 25638 raft_consensus.cc:1275] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.599704 25761 consensus_queue.cc:1048] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.609004 25565 raft_consensus.cc:1275] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.611135 25737 consensus_queue.cc:1048] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.630982 25565 raft_consensus.cc:1275] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.632579 25737 consensus_queue.cc:1048] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.636830 25638 raft_consensus.cc:1275] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.638375 25737 consensus_queue.cc:1048] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.671108 25386 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48708:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:23.673533 25386 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:23.727180 25474 tablet_service.cc:1511] Processing CreateTablet for tablet 78238d850a7c48c797f1928f229dae9e (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:23.728524 25474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78238d850a7c48c797f1928f229dae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.728210 25555 tablet_service.cc:1511] Processing CreateTablet for tablet 78238d850a7c48c797f1928f229dae9e (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:23.729746 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78238d850a7c48c797f1928f229dae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.730552 25621 tablet_service.cc:1511] Processing CreateTablet for tablet 78238d850a7c48c797f1928f229dae9e (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:23.731879 25621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78238d850a7c48c797f1928f229dae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.733229 25549 tablet_service.cc:1511] Processing CreateTablet for tablet d3bf3db834064004b021f0ac26b3c7fc (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:23.734488 25549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bf3db834064004b021f0ac26b3c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.735355 25622 tablet_service.cc:1511] Processing CreateTablet for tablet d3bf3db834064004b021f0ac26b3c7fc (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:23.736639 25622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bf3db834064004b021f0ac26b3c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.736752 25472 tablet_service.cc:1511] Processing CreateTablet for tablet d3bf3db834064004b021f0ac26b3c7fc (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:23.737993 25472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bf3db834064004b021f0ac26b3c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.740526 25475 tablet_service.cc:1511] Processing CreateTablet for tablet 46d9f0eb428743e2a186d4fd71f3502c (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:23.740872 25629 tablet_service.cc:1511] Processing CreateTablet for tablet 46d9f0eb428743e2a186d4fd71f3502c (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:23.741780 25475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d9f0eb428743e2a186d4fd71f3502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.742058 25629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d9f0eb428743e2a186d4fd71f3502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.743918 25550 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc99f1300144e7e8dce0459149c2e4e (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:23.744503 25552 tablet_service.cc:1511] Processing CreateTablet for tablet 46d9f0eb428743e2a186d4fd71f3502c (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:23.745379 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc99f1300144e7e8dce0459149c2e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.746378 25552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d9f0eb428743e2a186d4fd71f3502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.747772 25473 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc99f1300144e7e8dce0459149c2e4e (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:23.747933 25477 tablet_service.cc:1511] Processing CreateTablet for tablet d153051ca1bc4e949231cd0b48969dde (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:23.749012 25473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc99f1300144e7e8dce0459149c2e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.749658 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d153051ca1bc4e949231cd0b48969dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.762548 25553 tablet_service.cc:1511] Processing CreateTablet for tablet d153051ca1bc4e949231cd0b48969dde (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:23.764201 25553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d153051ca1bc4e949231cd0b48969dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.767532 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc99f1300144e7e8dce0459149c2e4e (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:23.777521 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc99f1300144e7e8dce0459149c2e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.780431 25478 tablet_service.cc:1511] Processing CreateTablet for tablet 4b57060f797f422989f2547b9e683c1b (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:23.781764 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b57060f797f422989f2547b9e683c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.781412 25623 tablet_service.cc:1511] Processing CreateTablet for tablet d153051ca1bc4e949231cd0b48969dde (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:23.782905 25623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d153051ca1bc4e949231cd0b48969dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.799715 25550 tablet_service.cc:1511] Processing CreateTablet for tablet 4b57060f797f422989f2547b9e683c1b (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:23.801818 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b57060f797f422989f2547b9e683c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.804188 25628 tablet_service.cc:1511] Processing CreateTablet for tablet 4b57060f797f422989f2547b9e683c1b (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:23.806018 25628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b57060f797f422989f2547b9e683c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.811201 25480 tablet_service.cc:1511] Processing CreateTablet for tablet 60781c14a1c749638b56f96a316323d9 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:23.812914 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60781c14a1c749638b56f96a316323d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.836225 25554 tablet_service.cc:1511] Processing CreateTablet for tablet 60781c14a1c749638b56f96a316323d9 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:23.839349 25554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60781c14a1c749638b56f96a316323d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.840358 25788 tablet_bootstrap.cc:492] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:23.856724 25787 tablet_bootstrap.cc:492] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:23.860517 25475 tablet_service.cc:1511] Processing CreateTablet for tablet 93aaf58a9c614de79eb2d13aaf9d2f93 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:23.866961 25555 tablet_service.cc:1511] Processing CreateTablet for tablet 93aaf58a9c614de79eb2d13aaf9d2f93 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:23.868824 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93aaf58a9c614de79eb2d13aaf9d2f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.870294 25629 tablet_service.cc:1511] Processing CreateTablet for tablet 93aaf58a9c614de79eb2d13aaf9d2f93 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:23.871744 25629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93aaf58a9c614de79eb2d13aaf9d2f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.872488 25788 tablet_bootstrap.cc:654] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:23.875032 25787 tablet_bootstrap.cc:654] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:23.866978 25475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93aaf58a9c614de79eb2d13aaf9d2f93. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:23.885939 25436 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:23.893435 25529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:42365, user_credentials={real_user=slave}} blocked reactor thread for 61544.6us
I20260709 13:09:23.900488 25622 tablet_service.cc:1511] Processing CreateTablet for tablet 60781c14a1c749638b56f96a316323d9 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:23.902459 25622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60781c14a1c749638b56f96a316323d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.909209 25787 tablet_bootstrap.cc:492] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:23.909943 25787 ts_tablet_manager.cc:1403] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.005s
I20260709 13:09:23.912760 25621 tablet_service.cc:1511] Processing CreateTablet for tablet f4044f6e219b4e5c899f9b76eeb96a63 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:23.914358 25621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4044f6e219b4e5c899f9b76eeb96a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.907277 25549 tablet_service.cc:1511] Processing CreateTablet for tablet f4044f6e219b4e5c899f9b76eeb96a63 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:23.917268 25549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4044f6e219b4e5c899f9b76eeb96a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.939524 25474 tablet_service.cc:1511] Processing CreateTablet for tablet f4044f6e219b4e5c899f9b76eeb96a63 (DEFAULT_TABLE table=soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:23.940958 25474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4044f6e219b4e5c899f9b76eeb96a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.949458 25787 raft_consensus.cc:359] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:23.950309 25787 raft_consensus.cc:385] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:23.950598 25787 raft_consensus.cc:740] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:23.951483 25787 consensus_queue.cc:260] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:23.956398 25787 ts_tablet_manager.cc:1434] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:09:23.957316 25787 tablet_bootstrap.cc:492] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:23.963129 25787 tablet_bootstrap.cc:654] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:23.965240 25791 tablet_bootstrap.cc:492] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:23.970521 25788 tablet_bootstrap.cc:492] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:23.971228 25788 ts_tablet_manager.cc:1403] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.131s	user 0.020s	sys 0.000s
I20260709 13:09:23.974694 25788 raft_consensus.cc:359] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:23.975610 25788 raft_consensus.cc:385] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:23.975315 25791 tablet_bootstrap.cc:654] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:23.976015 25788 raft_consensus.cc:740] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:23.977380 25788 consensus_queue.cc:260] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:23.985961 25788 ts_tablet_manager.cc:1434] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:23.986232 25791 tablet_bootstrap.cc:492] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:23.986572 25787 tablet_bootstrap.cc:492] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:23.986783 25791 ts_tablet_manager.cc:1403] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:09:23.987241 25787 ts_tablet_manager.cc:1403] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.030s	user 0.003s	sys 0.008s
I20260709 13:09:23.987592 25788 tablet_bootstrap.cc:492] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:23.990289 25791 raft_consensus.cc:359] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:23.991043 25791 raft_consensus.cc:385] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:23.991356 25791 raft_consensus.cc:740] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:23.991595 25787 raft_consensus.cc:359] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:23.992583 25787 raft_consensus.cc:385] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:23.992955 25787 raft_consensus.cc:740] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:23.993741 25787 consensus_queue.cc:260] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:23.995445 25788 tablet_bootstrap.cc:654] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:23.996152 25787 ts_tablet_manager.cc:1434] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:09:23.997275 25787 tablet_bootstrap.cc:492] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:23.992131 25791 consensus_queue.cc:260] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.003901 25791 ts_tablet_manager.cc:1434] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:09:24.005055 25791 tablet_bootstrap.cc:492] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:24.005921 25787 tablet_bootstrap.cc:654] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.012992 25787 tablet_bootstrap.cc:492] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:24.013703 25787 ts_tablet_manager.cc:1403] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:09:24.014551 25791 tablet_bootstrap.cc:654] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.016525 25788 tablet_bootstrap.cc:492] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:24.017141 25788 ts_tablet_manager.cc:1403] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.009s
I20260709 13:09:24.017196 25787 raft_consensus.cc:359] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.018085 25787 raft_consensus.cc:385] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.018394 25787 raft_consensus.cc:740] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.019217 25787 consensus_queue.cc:260] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.021999 25787 ts_tablet_manager.cc:1434] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:09:24.023653 25787 tablet_bootstrap.cc:492] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:24.023337 25788 raft_consensus.cc:359] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.024364 25788 raft_consensus.cc:385] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.024715 25788 raft_consensus.cc:740] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.025498 25788 consensus_queue.cc:260] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.028002 25788 ts_tablet_manager.cc:1434] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:09:24.028770 25791 tablet_bootstrap.cc:492] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:24.029306 25791 ts_tablet_manager.cc:1403] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:09:24.031054 25787 tablet_bootstrap.cc:654] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.031067 25788 tablet_bootstrap.cc:492] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:24.032320 25791 raft_consensus.cc:359] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.036043 25791 raft_consensus.cc:385] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.036393 25791 raft_consensus.cc:740] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.037292 25791 consensus_queue.cc:260] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.039737 25791 ts_tablet_manager.cc:1434] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:09:24.040357 25788 tablet_bootstrap.cc:654] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.048647 25791 tablet_bootstrap.cc:492] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:24.058503 25791 tablet_bootstrap.cc:654] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.102365 25788 tablet_bootstrap.cc:492] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:24.102851 25788 ts_tablet_manager.cc:1403] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.044s
I20260709 13:09:24.102984 25787 tablet_bootstrap.cc:492] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:24.103109 25791 tablet_bootstrap.cc:492] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:24.103912 25787 ts_tablet_manager.cc:1403] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.081s	user 0.031s	sys 0.041s
I20260709 13:09:24.104008 25791 ts_tablet_manager.cc:1403] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.035s
I20260709 13:09:24.105914 25788 raft_consensus.cc:359] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.106704 25788 raft_consensus.cc:385] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.106417 25787 raft_consensus.cc:359] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.107084 25788 raft_consensus.cc:740] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.107227 25787 raft_consensus.cc:385] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.107767 25787 raft_consensus.cc:740] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.107281 25791 raft_consensus.cc:359] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.108462 25791 raft_consensus.cc:385] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.108054 25788 consensus_queue.cc:260] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.108785 25791 raft_consensus.cc:740] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.108806 25787 consensus_queue.cc:260] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.110554 25788 ts_tablet_manager.cc:1434] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:24.111724 25787 ts_tablet_manager.cc:1434] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:09:24.111789 25788 tablet_bootstrap.cc:492] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:24.109704 25791 consensus_queue.cc:260] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.113127 25787 tablet_bootstrap.cc:492] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:24.114475 25791 ts_tablet_manager.cc:1434] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:24.115662 25791 tablet_bootstrap.cc:492] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:24.119529 25788 tablet_bootstrap.cc:654] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.121519 25787 tablet_bootstrap.cc:654] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.122484 25791 tablet_bootstrap.cc:654] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.123241 25775 raft_consensus.cc:493] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.132247 25788 tablet_bootstrap.cc:492] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:24.132387 25791 tablet_bootstrap.cc:492] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:24.132011 25775 raft_consensus.cc:515] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.132933 25788 ts_tablet_manager.cc:1403] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:09:24.132964 25791 ts_tablet_manager.cc:1403] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:09:24.136556 25788 raft_consensus.cc:359] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.137390 25788 raft_consensus.cc:385] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.137706 25788 raft_consensus.cc:740] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.136520 25791 raft_consensus.cc:359] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.138450 25791 raft_consensus.cc:385] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.138795 25791 raft_consensus.cc:740] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.138521 25788 consensus_queue.cc:260] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.140439 25787 tablet_bootstrap.cc:492] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:24.139753 25791 consensus_queue.cc:260] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.141110 25787 ts_tablet_manager.cc:1403] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.005s
I20260709 13:09:24.143244 25791 ts_tablet_manager.cc:1434] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:24.144877 25791 tablet_bootstrap.cc:492] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:24.152253 25787 raft_consensus.cc:359] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.153098 25787 raft_consensus.cc:385] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.153409 25787 raft_consensus.cc:740] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.154091 25791 tablet_bootstrap.cc:654] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.154161 25787 consensus_queue.cc:260] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.165539 25787 ts_tablet_manager.cc:1434] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:09:24.166648 25787 tablet_bootstrap.cc:492] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:24.169905 25775 leader_election.cc:290] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.161168 25805 raft_consensus.cc:493] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.171427 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:24.171838 25805 raft_consensus.cc:515] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.174052 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.175050 25805 leader_election.cc:290] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.175505 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc99f1300144e7e8dce0459149c2e4e" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
W20260709 13:09:24.176301 25603 leader_election.cc:343] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.176642 25565 raft_consensus.cc:2468] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 0.
I20260709 13:09:24.172267 25564 raft_consensus.cc:2468] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 0.
I20260709 13:09:24.177749 25787 tablet_bootstrap.cc:654] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.178588 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc99f1300144e7e8dce0459149c2e4e" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.179075 25602 leader_election.cc:304] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:24.180223 25805 raft_consensus.cc:2804] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.180671 25805 raft_consensus.cc:493] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.180477 25602 leader_election.cc:304] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:24.181195 25805 raft_consensus.cc:3060] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.183635 25775 raft_consensus.cc:2804] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.184348 25775 raft_consensus.cc:493] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.184772 25775 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.192202 25805 raft_consensus.cc:515] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
W20260709 13:09:24.180361 25603 leader_election.cc:343] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.195338 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc99f1300144e7e8dce0459149c2e4e" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
W20260709 13:09:24.196848 25603 leader_election.cc:343] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.199458 25805 leader_election.cc:290] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.201072 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc99f1300144e7e8dce0459149c2e4e" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:24.202039 25564 raft_consensus.cc:3060] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.211076 25776 raft_consensus.cc:493] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.211903 25776 raft_consensus.cc:515] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.213250 25564 raft_consensus.cc:2468] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 1.
I20260709 13:09:24.215723 25602 leader_election.cc:304] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:24.217031 25805 raft_consensus.cc:2804] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.217521 25805 raft_consensus.cc:697] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:24.218400 25805 consensus_queue.cc:237] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.218889 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57060f797f422989f2547b9e683c1b" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:24.220077 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57060f797f422989f2547b9e683c1b" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
W20260709 13:09:24.220593 25456 leader_election.cc:343] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.221330 25776 leader_election.cc:290] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
W20260709 13:09:24.221911 25453 leader_election.cc:343] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.222637 25453 leader_election.cc:304] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033
I20260709 13:09:24.225942 25776 raft_consensus.cc:2749] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:24.235952 25789 raft_consensus.cc:493] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.236797 25789 raft_consensus.cc:515] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.239851 25789 leader_election.cc:290] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.241636 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d153051ca1bc4e949231cd0b48969dde" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.242365 25490 raft_consensus.cc:2468] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:24.243436 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d153051ca1bc4e949231cd0b48969dde" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:24.245455 25529 leader_election.cc:304] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:24.246769 25789 raft_consensus.cc:2804] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.247222 25789 raft_consensus.cc:493] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.247705 25789 raft_consensus.cc:3060] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:24.257825 25531 leader_election.cc:343] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.272559 25383 catalog_manager.cc:5697] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.294278 25775 raft_consensus.cc:515] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.290923 25789 raft_consensus.cc:515] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.298818 25787 tablet_bootstrap.cc:492] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:24.299398 25787 ts_tablet_manager.cc:1403] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.133s	user 0.031s	sys 0.039s
I20260709 13:09:24.300479 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d153051ca1bc4e949231cd0b48969dde" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:24.301131 25490 raft_consensus.cc:3060] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.302946 25787 raft_consensus.cc:359] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.303735 25787 raft_consensus.cc:385] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.308488 25787 raft_consensus.cc:740] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.309561 25787 consensus_queue.cc:260] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.313583 25787 ts_tablet_manager.cc:1434] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:24.314898 25787 tablet_bootstrap.cc:492] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:24.326860 25787 tablet_bootstrap.cc:654] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.332935 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d153051ca1bc4e949231cd0b48969dde" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
W20260709 13:09:24.334712 25531 leader_election.cc:343] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.336983 25789 leader_election.cc:290] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.342026 25775 leader_election.cc:290] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.338403 25490 raft_consensus.cc:2468] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:24.342705 25809 raft_consensus.cc:493] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.343956 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:24.344588 25809 raft_consensus.cc:515] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
W20260709 13:09:24.346467 25603 leader_election.cc:343] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.343896 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:24.347256 25788 ts_tablet_manager.cc:1434] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.214s	user 0.037s	sys 0.111s
I20260709 13:09:24.349668 25529 leader_election.cc:304] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32
I20260709 13:09:24.349891 25788 tablet_bootstrap.cc:492] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:24.349882 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78238d850a7c48c797f1928f229dae9e" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:24.350796 25565 raft_consensus.cc:2468] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 0.
I20260709 13:09:24.352476 25602 leader_election.cc:304] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:24.347234 25809 leader_election.cc:290] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.353648 25564 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.354539 25787 tablet_bootstrap.cc:492] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:24.355193 25787 ts_tablet_manager.cc:1403] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.000s
I20260709 13:09:24.356649 25776 raft_consensus.cc:493] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.357218 25776 raft_consensus.cc:515] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.359716 25788 tablet_bootstrap.cc:654] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.359241 25787 raft_consensus.cc:359] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.361809 25787 raft_consensus.cc:385] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.362257 25787 raft_consensus.cc:740] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.361609 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d9f0eb428743e2a186d4fd71f3502c" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:24.363431 25565 raft_consensus.cc:2468] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:24.364960 25453 leader_election.cc:304] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:24.365948 25773 raft_consensus.cc:2804] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.366024 25776 leader_election.cc:290] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.366458 25773 raft_consensus.cc:493] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.366858 25773 raft_consensus.cc:3060] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.367434 25791 tablet_bootstrap.cc:492] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:24.368448 25791 ts_tablet_manager.cc:1403] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.224s	user 0.075s	sys 0.101s
I20260709 13:09:24.367479 25789 raft_consensus.cc:2804] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.370864 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78238d850a7c48c797f1928f229dae9e" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.371655 25490 raft_consensus.cc:2468] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 0.
I20260709 13:09:24.373845 25789 raft_consensus.cc:697] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:24.373716 25791 raft_consensus.cc:359] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.375790 25564 raft_consensus.cc:2468] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 1.
I20260709 13:09:24.375381 25789 consensus_queue.cc:237] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.375075 25791 raft_consensus.cc:385] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.376866 25791 raft_consensus.cc:740] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.377331 25809 raft_consensus.cc:2804] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.377447 25804 raft_consensus.cc:493] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.377861 25809 raft_consensus.cc:493] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.378260 25809 raft_consensus.cc:3060] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.378029 25804 raft_consensus.cc:515] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.378544 25602 leader_election.cc:304] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:24.379765 25805 raft_consensus.cc:2804] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.380373 25805 raft_consensus.cc:697] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:24.381731 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d9f0eb428743e2a186d4fd71f3502c" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:24.382630 25638 raft_consensus.cc:2468] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:24.383796 25791 consensus_queue.cc:260] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.386668 25804 leader_election.cc:290] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.387939 25805 consensus_queue.cc:237] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.390832 25791 ts_tablet_manager.cc:1434] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.005s
I20260709 13:09:24.391505 25809 raft_consensus.cc:515] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.392086 25791 tablet_bootstrap.cc:492] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:24.395325 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d9f0eb428743e2a186d4fd71f3502c" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:24.396080 25564 raft_consensus.cc:2468] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 0.
I20260709 13:09:24.397065 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78238d850a7c48c797f1928f229dae9e" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:24.398277 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78238d850a7c48c797f1928f229dae9e" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:24.398393 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d9f0eb428743e2a186d4fd71f3502c" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.397406 25602 leader_election.cc:304] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:24.399160 25488 raft_consensus.cc:3060] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.398358 25565 raft_consensus.cc:3060] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.400003 25775 raft_consensus.cc:2804] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.400460 25775 raft_consensus.cc:493] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.401299 25775 raft_consensus.cc:3060] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.407790 25565 raft_consensus.cc:2468] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 1.
I20260709 13:09:24.396683 25809 leader_election.cc:290] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.409315 25602 leader_election.cc:304] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:24.409776 25488 raft_consensus.cc:2468] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 1.
I20260709 13:09:24.410311 25809 raft_consensus.cc:2804] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.410830 25809 raft_consensus.cc:697] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:24.411763 25809 consensus_queue.cc:237] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.413679 25791 tablet_bootstrap.cc:654] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.417054 25386 catalog_manager.cc:5697] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.418169 25788 tablet_bootstrap.cc:492] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:24.419875 25791 tablet_bootstrap.cc:492] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:24.420131 25788 ts_tablet_manager.cc:1403] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.006s
I20260709 13:09:24.420367 25791 ts_tablet_manager.cc:1403] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 13:09:24.399003 25787 consensus_queue.cc:260] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.423633 25788 raft_consensus.cc:359] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.423211 25388 catalog_manager.cc:5697] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.424427 25788 raft_consensus.cc:385] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.424302 25773 raft_consensus.cc:515] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.424834 25788 raft_consensus.cc:740] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.425776 25788 consensus_queue.cc:260] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.427393 25787 ts_tablet_manager.cc:1434] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:09:24.432129 25489 raft_consensus.cc:2393] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 873884a5b5414a60a19e0032108cef32 in current term 1: Already voted for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in this term.
I20260709 13:09:24.440408 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d9f0eb428743e2a186d4fd71f3502c" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:24.430837 25788 ts_tablet_manager.cc:1434] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:09:24.437126 25775 raft_consensus.cc:515] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.441255 25565 raft_consensus.cc:3060] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.434126 25791 raft_consensus.cc:359] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.443704 25788 tablet_bootstrap.cc:492] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:24.444068 25791 raft_consensus.cc:385] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.444394 25791 raft_consensus.cc:740] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.440434 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d9f0eb428743e2a186d4fd71f3502c" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:24.445269 25638 raft_consensus.cc:2393] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d58a0a13e5c34fb3bf3162e55c0ed08d in current term 1: Already voted for candidate 873884a5b5414a60a19e0032108cef32 in this term.
I20260709 13:09:24.445155 25791 consensus_queue.cc:260] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.447095 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d9f0eb428743e2a186d4fd71f3502c" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:24.428563 25787 tablet_bootstrap.cc:492] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:24.447899 25489 raft_consensus.cc:2393] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 873884a5b5414a60a19e0032108cef32 in current term 1: Already voted for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in this term.
I20260709 13:09:24.448230 25791 ts_tablet_manager.cc:1434] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:09:24.449374 25791 tablet_bootstrap.cc:492] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:24.439321 25773 leader_election.cc:290] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.451279 25775 leader_election.cc:290] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.452215 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d9f0eb428743e2a186d4fd71f3502c" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:24.454032 25602 leader_election.cc:304] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873884a5b5414a60a19e0032108cef32; no voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:24.455353 25775 raft_consensus.cc:2749] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:24.456141 25791 tablet_bootstrap.cc:654] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.459818 25788 tablet_bootstrap.cc:654] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.463478 25787 tablet_bootstrap.cc:654] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.469015 25774 raft_consensus.cc:493] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.469724 25774 raft_consensus.cc:515] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.466885 25384 catalog_manager.cc:5697] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.489885 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60781c14a1c749638b56f96a316323d9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.490866 25489 raft_consensus.cc:2468] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:24.492676 25529 leader_election.cc:304] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:24.494156 25789 raft_consensus.cc:2804] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.494663 25789 raft_consensus.cc:493] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.495064 25789 raft_consensus.cc:3060] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.500811 25565 raft_consensus.cc:2468] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 1.
I20260709 13:09:24.506325 25453 leader_election.cc:304] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32
I20260709 13:09:24.508432 25773 raft_consensus.cc:2804] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.509102 25773 raft_consensus.cc:697] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:24.510808 25773 consensus_queue.cc:237] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.521736 25787 tablet_bootstrap.cc:492] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:24.522382 25787 ts_tablet_manager.cc:1403] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.094s	user 0.005s	sys 0.030s
I20260709 13:09:24.524775 25791 tablet_bootstrap.cc:492] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:24.525482 25788 tablet_bootstrap.cc:492] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:24.526170 25788 ts_tablet_manager.cc:1403] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.018s
I20260709 13:09:24.525427 25791 ts_tablet_manager.cc:1403] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.076s	user 0.040s	sys 0.032s
I20260709 13:09:24.527802 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60781c14a1c749638b56f96a316323d9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:24.525449 25787 raft_consensus.cc:359] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.528645 25787 raft_consensus.cc:385] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.528991 25787 raft_consensus.cc:740] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
W20260709 13:09:24.529348 25531 leader_election.cc:343] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.529620 25788 raft_consensus.cc:359] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.530434 25788 raft_consensus.cc:385] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.530750 25788 raft_consensus.cc:740] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.531097 25815 raft_consensus.cc:493] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.529820 25787 consensus_queue.cc:260] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.531684 25815 raft_consensus.cc:515] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.526104 25774 leader_election.cc:290] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.532994 25791 raft_consensus.cc:359] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.534096 25791 raft_consensus.cc:385] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.531221 25789 raft_consensus.cc:515] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.534535 25791 raft_consensus.cc:740] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.534965 25815 leader_election.cc:290] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.535435 25791 consensus_queue.cc:260] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.536058 25789 leader_election.cc:290] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.536739 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:24.537128 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60781c14a1c749638b56f96a316323d9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:24.537663 25565 raft_consensus.cc:2393] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d58a0a13e5c34fb3bf3162e55c0ed08d in current term 1: Already voted for candidate 873884a5b5414a60a19e0032108cef32 in this term.
I20260709 13:09:24.537772 25489 raft_consensus.cc:3060] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.537740 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60781c14a1c749638b56f96a316323d9" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:24.538590 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:24.538920 25791 ts_tablet_manager.cc:1434] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:24.531670 25788 consensus_queue.cc:260] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
W20260709 13:09:24.540004 25531 leader_election.cc:343] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.540274 25791 tablet_bootstrap.cc:492] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:24.541340 25787 ts_tablet_manager.cc:1434] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:09:24.543182 25788 ts_tablet_manager.cc:1434] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:09:24.545295 25787 tablet_bootstrap.cc:492] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Bootstrap starting.
I20260709 13:09:24.545463 25788 tablet_bootstrap.cc:492] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:24.533896 25385 catalog_manager.cc:5697] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 0 to 1, leader changed from <none> to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 1 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.540109 25456 leader_election.cc:304] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033
I20260709 13:09:24.547991 25773 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.548691 25791 tablet_bootstrap.cc:654] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.553058 25788 tablet_bootstrap.cc:654] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.558591 25773 raft_consensus.cc:2749] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:24.560396 25791 tablet_bootstrap.cc:492] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:24.561024 25791 ts_tablet_manager.cc:1403] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:09:24.568868 25787 tablet_bootstrap.cc:654] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.569458 25791 raft_consensus.cc:359] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.570303 25791 raft_consensus.cc:385] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.570580 25791 raft_consensus.cc:740] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.571348 25791 consensus_queue.cc:260] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.574162 25791 ts_tablet_manager.cc:1434] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:24.575380 25791 tablet_bootstrap.cc:492] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d: Bootstrap starting.
I20260709 13:09:24.592428 25489 raft_consensus.cc:2468] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:24.594410 25529 leader_election.cc:304] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32
I20260709 13:09:24.595607 25789 raft_consensus.cc:2804] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.596271 25789 raft_consensus.cc:697] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:24.597321 25789 consensus_queue.cc:237] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.607079 25788 tablet_bootstrap.cc:492] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:24.607961 25791 tablet_bootstrap.cc:654] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.611706 25787 tablet_bootstrap.cc:492] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033: No bootstrap required, opened a new log
I20260709 13:09:24.612375 25787 ts_tablet_manager.cc:1403] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent bootstrapping tablet: real 0.067s	user 0.031s	sys 0.017s
I20260709 13:09:24.614523 25788 ts_tablet_manager.cc:1403] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.069s	user 0.029s	sys 0.031s
I20260709 13:09:24.622339 25788 raft_consensus.cc:359] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.623134 25788 raft_consensus.cc:385] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.623453 25788 raft_consensus.cc:740] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.624271 25788 consensus_queue.cc:260] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.625664 25387 catalog_manager.cc:5697] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.626904 25788 ts_tablet_manager.cc:1434] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:24.626000 25787 raft_consensus.cc:359] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.627713 25787 raft_consensus.cc:385] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.628062 25788 tablet_bootstrap.cc:492] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:24.628132 25787 raft_consensus.cc:740] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.629454 25787 consensus_queue.cc:260] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.632350 25787 ts_tablet_manager.cc:1434] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:09:24.633355 25815 raft_consensus.cc:493] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.633948 25815 raft_consensus.cc:515] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.635449 25791 tablet_bootstrap.cc:492] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d: No bootstrap required, opened a new log
I20260709 13:09:24.636628 25791 ts_tablet_manager.cc:1403] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.007s
I20260709 13:09:24.636987 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:24.637414 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:24.637904 25565 raft_consensus.cc:2468] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 0.
I20260709 13:09:24.635520 25788 tablet_bootstrap.cc:654] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:24.638952 25456 leader_election.cc:343] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.639655 25815 leader_election.cc:290] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.639643 25453 leader_election.cc:304] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32
I20260709 13:09:24.640691 25815 raft_consensus.cc:2804] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.641122 25815 raft_consensus.cc:493] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.641446 25815 raft_consensus.cc:3060] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.645771 25791 raft_consensus.cc:359] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.646615 25791 raft_consensus.cc:385] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.646872 25791 raft_consensus.cc:740] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.647598 25791 consensus_queue.cc:260] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.649808 25791 ts_tablet_manager.cc:1434] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:09:24.650704 25789 raft_consensus.cc:493] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.651290 25789 raft_consensus.cc:515] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.653612 25789 leader_election.cc:290] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.654970 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57060f797f422989f2547b9e683c1b" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:24.655632 25638 raft_consensus.cc:2468] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:24.655874 25788 tablet_bootstrap.cc:492] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
I20260709 13:09:24.656420 25788 ts_tablet_manager.cc:1403] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.001s
I20260709 13:09:24.656742 25531 leader_election.cc:304] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:24.657483 25789 raft_consensus.cc:2804] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.657902 25789 raft_consensus.cc:493] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.658308 25789 raft_consensus.cc:3060] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.658263 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57060f797f422989f2547b9e683c1b" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.659114 25489 raft_consensus.cc:2468] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:24.659380 25788 raft_consensus.cc:359] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.660144 25788 raft_consensus.cc:385] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.660440 25788 raft_consensus.cc:740] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.661275 25788 consensus_queue.cc:260] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.666877 25788 ts_tablet_manager.cc:1434] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:09:24.667176 25789 raft_consensus.cc:515] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.667847 25788 tablet_bootstrap.cc:492] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32: Bootstrap starting.
I20260709 13:09:24.668857 25774 raft_consensus.cc:493] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.669390 25789 leader_election.cc:290] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.669375 25774 raft_consensus.cc:515] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.670491 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57060f797f422989f2547b9e683c1b" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:24.671145 25638 raft_consensus.cc:3060] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.672369 25774 leader_election.cc:290] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.674387 25788 tablet_bootstrap.cc:654] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.674579 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4044f6e219b4e5c899f9b76eeb96a63" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32" is_pre_election: true
I20260709 13:09:24.675259 25639 raft_consensus.cc:2468] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:24.680027 25638 raft_consensus.cc:2468] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:24.661448 25815 raft_consensus.cc:515] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.681315 25531 leader_election.cc:304] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:24.682616 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57060f797f422989f2547b9e683c1b" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:24.683216 25815 leader_election.cc:290] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.683334 25489 raft_consensus.cc:3060] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.684069 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:24.684625 25565 raft_consensus.cc:3060] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.682582 25531 leader_election.cc:304] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:24.686822 25789 raft_consensus.cc:2804] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.687400 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4044f6e219b4e5c899f9b76eeb96a63" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.686602 25774 raft_consensus.cc:2804] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:24.688597 25774 raft_consensus.cc:493] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.688153 25488 raft_consensus.cc:2468] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 0.
I20260709 13:09:24.689174 25774 raft_consensus.cc:3060] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.694308 25489 raft_consensus.cc:2468] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:24.694866 25565 raft_consensus.cc:2468] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 1.
I20260709 13:09:24.696403 25453 leader_election.cc:304] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:24.696314 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:24.697508 25815 raft_consensus.cc:2804] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.698133 25815 raft_consensus.cc:697] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:24.697731 25789 raft_consensus.cc:697] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:24.699994 25815 consensus_queue.cc:237] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.701135 25788 tablet_bootstrap.cc:492] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32: No bootstrap required, opened a new log
W20260709 13:09:24.698843 25456 leader_election.cc:343] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:24.701566 25788 ts_tablet_manager.cc:1403] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.000s
I20260709 13:09:24.702776 25774 raft_consensus.cc:515] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.703606 25789 consensus_queue.cc:237] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.703895 25788 raft_consensus.cc:359] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.704576 25788 raft_consensus.cc:385] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.704864 25788 raft_consensus.cc:740] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.705683 25788 consensus_queue.cc:260] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.706079 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4044f6e219b4e5c899f9b76eeb96a63" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:24.706558 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4044f6e219b4e5c899f9b76eeb96a63" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:24.706806 25489 raft_consensus.cc:3060] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.707209 25638 raft_consensus.cc:3060] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.714042 25788 ts_tablet_manager.cc:1434] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:09:24.715193 25489 raft_consensus.cc:2468] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:24.716464 25529 leader_election.cc:304] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:24.717495 25831 raft_consensus.cc:2804] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.721122 25638 raft_consensus.cc:2468] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 1.
I20260709 13:09:24.722203 25774 leader_election.cc:290] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 1 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:24.724256 25775 raft_consensus.cc:493] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.724686 25489 raft_consensus.cc:3060] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.725003 25775 raft_consensus.cc:515] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.728685 25831 raft_consensus.cc:697] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:24.730108 25831 consensus_queue.cc:237] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:24.734838 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60781c14a1c749638b56f96a316323d9" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:24.736364 25775 leader_election.cc:290] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:24.740484 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60781c14a1c749638b56f96a316323d9" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:24.741861 25488 raft_consensus.cc:2393] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 873884a5b5414a60a19e0032108cef32 in current term 1: Already voted for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in this term.
I20260709 13:09:24.744313 25603 leader_election.cc:304] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873884a5b5414a60a19e0032108cef32; no voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:24.747763 25775 raft_consensus.cc:3060] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.755833 25387 catalog_manager.cc:5697] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.762250 25775 raft_consensus.cc:2749] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:24.762081 25809 consensus_queue.cc:1048] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:24.765543 25385 catalog_manager.cc:5697] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 0 to 1, leader changed from <none> to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 1 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.767282 25775 consensus_queue.cc:1048] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:24.779089 25387 catalog_manager.cc:5697] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.817061 25775 consensus_queue.cc:1048] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:24.828018 25804 consensus_queue.cc:1048] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:24.906435 25638 raft_consensus.cc:3060] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.913053 25831 consensus_queue.cc:1048] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:24.927153 25774 consensus_queue.cc:1048] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:24.981801 25809 consensus_queue.cc:1048] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:24.984273 25809 consensus_queue.cc:1048] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:25.014294 25638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78238d850a7c48c797f1928f229dae9e"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
mode: GRACEFUL
new_leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:49470
I20260709 13:09:25.014801 25638 raft_consensus.cc:606] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Received request to transfer leadership to TS d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:25.019830 25638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
mode: GRACEFUL
new_leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:49470
I20260709 13:09:25.020364 25638 raft_consensus.cc:606] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Received request to transfer leadership to TS d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:25.027944 25638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bc99f1300144e7e8dce0459149c2e4e"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
mode: GRACEFUL
new_leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:49470
I20260709 13:09:25.028504 25638 raft_consensus.cc:606] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Received request to transfer leadership to TS d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:25.041292 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
mode: GRACEFUL
new_leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
 from {username='slave'} at 127.0.0.1:38338
I20260709 13:09:25.041996 25489 raft_consensus.cc:606] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Received request to transfer leadership to TS bcf2a1dc6ce04cb3a50346ca1e9d4033
I20260709 13:09:25.044572 25815 consensus_queue.cc:1048] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:25.047981 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4044f6e219b4e5c899f9b76eeb96a63"
dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
mode: GRACEFUL
new_leader_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:09:25.048673 25564 raft_consensus.cc:606] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Received request to transfer leadership to TS 873884a5b5414a60a19e0032108cef32
I20260709 13:09:25.057843 25773 consensus_queue.cc:1048] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:25.081959 25775 raft_consensus.cc:493] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.082445 25775 raft_consensus.cc:515] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.084298 25775 leader_election.cc:290] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:25.085074 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" is_pre_election: true
I20260709 13:09:25.085337 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" is_pre_election: true
I20260709 13:09:25.086089 25564 raft_consensus.cc:2393] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 873884a5b5414a60a19e0032108cef32 in current term 1: Already voted for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in this term.
I20260709 13:09:25.087090 25602 leader_election.cc:304] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873884a5b5414a60a19e0032108cef32; no voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d
I20260709 13:09:25.087837 25775 raft_consensus.cc:3060] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:25.093266 25775 raft_consensus.cc:2749] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:25.098903 25773 consensus_queue.cc:1048] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:25.106293 25848 raft_consensus.cc:993] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d: : Instructing follower bcf2a1dc6ce04cb3a50346ca1e9d4033 to start an election
I20260709 13:09:25.107995 25773 raft_consensus.cc:1081] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Signalling peer bcf2a1dc6ce04cb3a50346ca1e9d4033 to start an election
I20260709 13:09:25.109906 25565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93"
dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:09:25.110525 25565 raft_consensus.cc:493] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.111001 25565 raft_consensus.cc:3060] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.115899 25848 consensus_queue.cc:1048] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:25.121546 25565 raft_consensus.cc:515] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.122424 25774 consensus_queue.cc:1048] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:25.124790 25565 leader_election.cc:290] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 2 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:25.125809 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:25.126669 25489 raft_consensus.cc:3055] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.126736 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93aaf58a9c614de79eb2d13aaf9d2f93" candidate_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:25.127161 25489 raft_consensus.cc:740] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:25.128189 25489 consensus_queue.cc:260] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.129385 25489 raft_consensus.cc:3060] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.144508 25489 raft_consensus.cc:2468] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf2a1dc6ce04cb3a50346ca1e9d4033 in term 2.
I20260709 13:09:25.146404 25529 leader_election.cc:304] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 873884a5b5414a60a19e0032108cef32
I20260709 13:09:25.148067 25831 raft_consensus.cc:2804] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.148598 25831 raft_consensus.cc:697] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 LEADER]: Becoming Leader. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:25.149507 25831 consensus_queue.cc:237] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.158058 25774 consensus_queue.cc:1048] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:25.158720 25789 consensus_queue.cc:1048] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:25.163856 25387 catalog_manager.cc:5697] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 reported cstate change: term changed from 1 to 2, leader changed from d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65) to bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.172410 25774 consensus_queue.cc:1048] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:25.180032 25789 raft_consensus.cc:993] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033: : Instructing follower 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:25.180596 25774 raft_consensus.cc:1081] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Signalling peer 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:25.182696 25639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4044f6e219b4e5c899f9b76eeb96a63"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:39752
I20260709 13:09:25.183318 25639 raft_consensus.cc:493] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.183806 25639 raft_consensus.cc:3060] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.188753 25774 consensus_queue.cc:1048] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:25.203892 25639 raft_consensus.cc:515] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.214556 25831 consensus_queue.cc:1048] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:25.215936 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4044f6e219b4e5c899f9b76eeb96a63" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:25.216642 25489 raft_consensus.cc:3060] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.218012 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4044f6e219b4e5c899f9b76eeb96a63" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:25.218618 25565 raft_consensus.cc:3055] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.218921 25565 raft_consensus.cc:740] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:25.219715 25565 consensus_queue.cc:260] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.220790 25565 raft_consensus.cc:3060] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.228694 25639 leader_election.cc:290] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 2 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:25.231952 25489 raft_consensus.cc:2468] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 2.
I20260709 13:09:25.232873 25565 raft_consensus.cc:2468] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 2.
I20260709 13:09:25.234597 25603 leader_election.cc:304] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:25.235788 25805 raft_consensus.cc:2804] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.236439 25805 raft_consensus.cc:697] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 2 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:25.237607 25805 consensus_queue.cc:237] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.254347 25384 catalog_manager.cc:5697] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 1 to 2, leader changed from bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66) to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.288360 25805 raft_consensus.cc:993] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32: : Instructing follower d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:25.288928 25805 raft_consensus.cc:1081] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Signalling peer d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:25.290609 25488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bc99f1300144e7e8dce0459149c2e4e"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:40940
I20260709 13:09:25.291293 25488 raft_consensus.cc:493] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.291723 25488 raft_consensus.cc:3060] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.299826 25488 raft_consensus.cc:515] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.301959 25488 leader_election.cc:290] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:25.302850 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc99f1300144e7e8dce0459149c2e4e" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:25.303283 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc99f1300144e7e8dce0459149c2e4e" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:25.303668 25565 raft_consensus.cc:3060] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.303977 25637 raft_consensus.cc:3055] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.304306 25637 raft_consensus.cc:740] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:25.305240 25637 consensus_queue.cc:260] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.306651 25637 raft_consensus.cc:3060] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.311923 25565 raft_consensus.cc:2468] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:25.313202 25453 leader_election.cc:304] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:25.314136 25773 raft_consensus.cc:2804] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.314667 25773 raft_consensus.cc:697] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:25.315598 25773 consensus_queue.cc:237] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.316282 25637 raft_consensus.cc:2468] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:25.323007 25384 catalog_manager.cc:5697] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 1 to 2, leader changed from 873884a5b5414a60a19e0032108cef32 (127.13.245.67) to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 2 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.412935 25809 raft_consensus.cc:993] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32: : Instructing follower d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:25.413574 25805 raft_consensus.cc:1081] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Signalling peer d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:25.415246 25488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:40940
I20260709 13:09:25.415786 25488 raft_consensus.cc:493] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.416050 25488 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.421710 25488 raft_consensus.cc:515] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.423470 25488 leader_election.cc:290] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:25.424417 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:25.424536 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:25.425316 25565 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.425352 25637 raft_consensus.cc:3055] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.425881 25637 raft_consensus.cc:740] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:25.426795 25637 consensus_queue.cc:260] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.428170 25637 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.433410 25565 raft_consensus.cc:2468] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:25.434827 25453 leader_election.cc:304] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:25.435777 25637 raft_consensus.cc:2468] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:25.435789 25773 raft_consensus.cc:2804] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.436581 25773 raft_consensus.cc:697] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:25.437523 25773 consensus_queue.cc:237] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.445199 25384 catalog_manager.cc:5697] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 1 to 2, leader changed from 873884a5b5414a60a19e0032108cef32 (127.13.245.67) to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 2 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.536623 25809 raft_consensus.cc:993] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32: : Instructing follower d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:25.537209 25805 raft_consensus.cc:1081] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Signalling peer d58a0a13e5c34fb3bf3162e55c0ed08d to start an election
I20260709 13:09:25.538720 25488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78238d850a7c48c797f1928f229dae9e"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
 from {username='slave'} at 127.0.0.1:40940
I20260709 13:09:25.539330 25488 raft_consensus.cc:493] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.539709 25488 raft_consensus.cc:3060] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.545600 25488 raft_consensus.cc:515] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.547469 25488 leader_election.cc:290] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Requested vote from peers bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965), 873884a5b5414a60a19e0032108cef32 (127.13.245.67:32797)
I20260709 13:09:25.548528 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78238d850a7c48c797f1928f229dae9e" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:25.548681 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78238d850a7c48c797f1928f229dae9e" candidate_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "873884a5b5414a60a19e0032108cef32"
I20260709 13:09:25.549248 25565 raft_consensus.cc:3060] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.549770 25637 raft_consensus.cc:3055] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.551015 25637 raft_consensus.cc:740] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:25.552083 25637 consensus_queue.cc:260] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.553730 25637 raft_consensus.cc:3060] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.556483 25565 raft_consensus.cc:2468] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:25.557207 25564 raft_consensus.cc:1240] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Rejecting Update request from peer 873884a5b5414a60a19e0032108cef32 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:25.557673 25453 leader_election.cc:304] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcf2a1dc6ce04cb3a50346ca1e9d4033, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:25.558466 25848 raft_consensus.cc:2804] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.558905 25848 raft_consensus.cc:697] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Becoming Leader. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:25.559783 25848 consensus_queue.cc:237] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:25.560918 25637 raft_consensus.cc:2468] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58a0a13e5c34fb3bf3162e55c0ed08d in term 2.
I20260709 13:09:25.567770 25384 catalog_manager.cc:5697] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d reported cstate change: term changed from 1 to 2, leader changed from 873884a5b5414a60a19e0032108cef32 (127.13.245.67) to d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65). New cstate: current_term: 2 leader_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.572417 25637 raft_consensus.cc:3060] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.580084 25637 raft_consensus.cc:1275] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Refusing update from remote peer bcf2a1dc6ce04cb3a50346ca1e9d4033: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.581516 25831 consensus_queue.cc:1048] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.590075 25488 raft_consensus.cc:1275] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Refusing update from remote peer bcf2a1dc6ce04cb3a50346ca1e9d4033: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.591502 25774 consensus_queue.cc:1048] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.678002 25488 raft_consensus.cc:1275] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.679509 25805 consensus_queue.cc:1048] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.687995 25564 raft_consensus.cc:1275] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.689990 25775 consensus_queue.cc:1048] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.863472 25564 raft_consensus.cc:1275] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.864945 25848 consensus_queue.cc:1048] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.874604 25639 raft_consensus.cc:1275] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.876495 25848 consensus_queue.cc:1048] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.930550 25637 raft_consensus.cc:1275] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.932186 25858 consensus_queue.cc:1048] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.946049 25564 raft_consensus.cc:1275] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.947583 25815 consensus_queue.cc:1048] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.013079 25639 raft_consensus.cc:1275] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:26.014540 25815 consensus_queue.cc:1048] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.024771 25564 raft_consensus.cc:1275] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer d58a0a13e5c34fb3bf3162e55c0ed08d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:26.028903 25848 consensus_queue.cc:1048] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.052258 25387 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48708:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:09:28.072790 25387 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48708:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:09:28.117180 14293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:09:28.360781 25908 tablet.cc:1724] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.363350 25909 tablet.cc:1724] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:28.417344 25591 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:d153051ca1bc4e949231cd0b48969dde)
W20260709 13:09:28.573053 25591 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:d153051ca1bc4e949231cd0b48969dde)
I20260709 13:09:28.584187 25565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60781c14a1c749638b56f96a316323d9"
dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
mode: GRACEFUL
new_leader_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:34168
W20260709 13:09:28.591217 25591 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:d153051ca1bc4e949231cd0b48969dde)
I20260709 13:09:28.615437 25917 tablet.cc:1724] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.611279 25921 tablet.cc:1724] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.626845 25931 tablet.cc:1724] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.632287 25929 tablet.cc:1724] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.588022 25565 raft_consensus.cc:606] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Received request to transfer leadership to TS 873884a5b5414a60a19e0032108cef32
W20260709 13:09:28.653455 25453 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:38965, user_credentials={real_user=slave}} blocked reactor thread for 84209us
I20260709 13:09:28.570513 25924 tablet.cc:1724] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.664227 25928 tablet.cc:1724] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.675496 25930 tablet.cc:1724] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.684939 25932 tablet.cc:1724] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.699879 25899 raft_consensus.cc:993] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: : Instructing follower 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:28.700928 25774 raft_consensus.cc:1081] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Signalling peer 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:28.708518 25639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60781c14a1c749638b56f96a316323d9"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:39752
I20260709 13:09:28.709458 25639 raft_consensus.cc:493] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.710088 25639 raft_consensus.cc:3060] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.703348 25928 tablet.cc:1724] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.703379 25929 tablet.cc:1724] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.741346 25909 tablet.cc:1724] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.753655 25934 tablet.cc:1724] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.763736 25908 tablet.cc:1724] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.767765 25935 tablet.cc:1724] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.777179 25639 raft_consensus.cc:515] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:28.781759 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60781c14a1c749638b56f96a316323d9" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:28.782706 25489 raft_consensus.cc:3060] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.792409 25928 tablet.cc:1724] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.792073 25930 tablet.cc:1724] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.799229 25908 tablet.cc:1724] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.800536 25489 raft_consensus.cc:2468] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 2.
I20260709 13:09:28.807044 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60781c14a1c749638b56f96a316323d9" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:28.807866 25563 raft_consensus.cc:3055] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.808393 25563 raft_consensus.cc:740] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:28.803278 25931 tablet.cc:1724] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.809423 25563 consensus_queue.cc:260] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:28.810964 25563 raft_consensus.cc:3060] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.803445 25639 leader_election.cc:290] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 2 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:28.820916 25603 leader_election.cc:304] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:28.822183 25920 raft_consensus.cc:2804] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.822674 25920 raft_consensus.cc:697] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 2 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:28.824429 25935 tablet.cc:1724] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.825218 25920 consensus_queue.cc:237] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:28.826174 25924 tablet.cc:1724] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.827589 25921 tablet.cc:1724] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.841807 25917 tablet.cc:1724] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.862000 25935 tablet.cc:1724] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.882001 25909 tablet.cc:1724] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.883504 25384 catalog_manager.cc:5697] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 1 to 2, leader changed from bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66) to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.850839 25932 tablet.cc:1724] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:28.894754 25563 raft_consensus.cc:2468] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 2.
I20260709 13:09:28.904767 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
mode: GRACEFUL
new_leader_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:38342
I20260709 13:09:28.905905 25489 raft_consensus.cc:606] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Received request to transfer leadership to TS 873884a5b5414a60a19e0032108cef32
I20260709 13:09:28.914407 14293 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:09:28.916083 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:28.930696 25563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9"
dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
mode: GRACEFUL
new_leader_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:34168
I20260709 13:09:28.931456 25563 raft_consensus.cc:606] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 LEADER]: Received request to transfer leadership to TS 873884a5b5414a60a19e0032108cef32
I20260709 13:09:28.936584 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af165e01f8f7422598570900708e8fc8"
dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
mode: GRACEFUL
new_leader_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:38342
I20260709 13:09:28.937314 25489 raft_consensus.cc:606] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Received request to transfer leadership to TS 873884a5b5414a60a19e0032108cef32
I20260709 13:09:28.939334 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:28.940132 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:28.950160 25384 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b: soft_deleted_table [id=5e057a548ad24bbca6e8549102aa26fa] alter complete (version 1)
I20260709 13:09:29.203030 25933 raft_consensus.cc:993] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: : Instructing follower 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:29.203707 25789 raft_consensus.cc:1081] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 LEADER]: Signalling peer 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:29.205889 25639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:39752
I20260709 13:09:29.206512 25639 raft_consensus.cc:493] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.206970 25639 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.213914 25639 raft_consensus.cc:515] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.216099 25639 leader_election.cc:290] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 3 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:29.216934 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:29.217244 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f18a2be6fc41258827f2e4b55264e9" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:29.217660 25489 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.218103 25563 raft_consensus.cc:3055] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.218436 25563 raft_consensus.cc:740] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcf2a1dc6ce04cb3a50346ca1e9d4033, State: Running, Role: LEADER
I20260709 13:09:29.219316 25563 consensus_queue.cc:260] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.220628 25563 raft_consensus.cc:3060] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.223667 25489 raft_consensus.cc:2468] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 3.
I20260709 13:09:29.225003 25603 leader_election.cc:304] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, d58a0a13e5c34fb3bf3162e55c0ed08d; no voters: 
I20260709 13:09:29.225752 25920 raft_consensus.cc:2804] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.226215 25920 raft_consensus.cc:697] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 3 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:29.227138 25920 consensus_queue.cc:237] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.228046 25563 raft_consensus.cc:2468] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 3.
I20260709 13:09:29.236485 25489 raft_consensus.cc:1275] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:29.238380 25920 consensus_queue.cc:1048] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.239853 25387 catalog_manager.cc:5697] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 2 to 3, leader changed from bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66) to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.248378 25563 raft_consensus.cc:1275] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:29.250556 25920 consensus_queue.cc:1048] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:29.395226 25891 raft_consensus.cc:993] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d: : Instructing follower 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:29.395809 25915 raft_consensus.cc:1081] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Signalling peer 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:29.397445 25636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:09:29.398016 25636 raft_consensus.cc:493] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.398380 25636 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.404361 25636 raft_consensus.cc:515] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.406309 25636 leader_election.cc:290] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 3 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:29.407087 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:29.407446 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bf3db834064004b021f0ac26b3c7fc" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:29.407913 25487 raft_consensus.cc:3055] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.408036 25563 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.408315 25487 raft_consensus.cc:740] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:29.409268 25487 consensus_queue.cc:260] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.410738 25487 raft_consensus.cc:3060] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.417989 25563 raft_consensus.cc:2468] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 3.
I20260709 13:09:29.419651 25602 leader_election.cc:304] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:29.420656 25944 raft_consensus.cc:2804] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.421177 25487 raft_consensus.cc:2468] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 3.
I20260709 13:09:29.421190 25944 raft_consensus.cc:697] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 3 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:29.424566 25944 consensus_queue.cc:237] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.436910 25384 catalog_manager.cc:5697] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 2 to 3, leader changed from d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65) to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.464550 25915 raft_consensus.cc:993] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d: : Instructing follower 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:29.465231 25891 raft_consensus.cc:1081] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Signalling peer 873884a5b5414a60a19e0032108cef32 to start an election
I20260709 13:09:29.467275 25639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af165e01f8f7422598570900708e8fc8"
dest_uuid: "873884a5b5414a60a19e0032108cef32"
 from {username='slave'} at 127.0.0.1:39762
I20260709 13:09:29.467806 25639 raft_consensus.cc:493] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.468107 25639 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.473515 25639 raft_consensus.cc:515] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.475220 25639 leader_election.cc:290] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 3 election: Requested vote from peers d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365), bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965)
I20260709 13:09:29.476300 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af165e01f8f7422598570900708e8fc8" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033"
I20260709 13:09:29.476300 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af165e01f8f7422598570900708e8fc8" candidate_uuid: "873884a5b5414a60a19e0032108cef32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d"
I20260709 13:09:29.477324 25563 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.477353 25487 raft_consensus.cc:3055] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.478088 25487 raft_consensus.cc:740] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d58a0a13e5c34fb3bf3162e55c0ed08d, State: Running, Role: LEADER
I20260709 13:09:29.479044 25487 consensus_queue.cc:260] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.480507 25487 raft_consensus.cc:3060] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.485991 25563 raft_consensus.cc:2468] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 3.
I20260709 13:09:29.487478 25602 leader_election.cc:304] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873884a5b5414a60a19e0032108cef32, bcf2a1dc6ce04cb3a50346ca1e9d4033; no voters: 
I20260709 13:09:29.488162 25487 raft_consensus.cc:2468] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873884a5b5414a60a19e0032108cef32 in term 3.
I20260709 13:09:29.488396 25944 raft_consensus.cc:2804] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.489019 25944 raft_consensus.cc:697] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 3 LEADER]: Becoming Leader. State: Replica: 873884a5b5414a60a19e0032108cef32, State: Running, Role: LEADER
I20260709 13:09:29.489993 25944 consensus_queue.cc:237] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } }
I20260709 13:09:29.498008 25384 catalog_manager.cc:5697] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 reported cstate change: term changed from 2 to 3, leader changed from d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65) to 873884a5b5414a60a19e0032108cef32 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "873884a5b5414a60a19e0032108cef32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873884a5b5414a60a19e0032108cef32" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.610631 25563 raft_consensus.cc:1275] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:29.612613 25944 consensus_queue.cc:1048] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:29.628278 25487 raft_consensus.cc:1275] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:29.629668 25920 consensus_queue.cc:1048] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.848964 25487 raft_consensus.cc:1275] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:29.850724 25944 consensus_queue.cc:1048] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:29.860283 25565 raft_consensus.cc:1275] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:29.862316 25920 consensus_queue.cc:1048] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:29.939867 25487 raft_consensus.cc:1275] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:29.941375 25920 consensus_queue.cc:1048] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58a0a13e5c34fb3bf3162e55c0ed08d" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.952805 25563 raft_consensus.cc:1275] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Refusing update from remote peer 873884a5b5414a60a19e0032108cef32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:29.954983 25944 consensus_queue.cc:1048] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf2a1dc6ce04cb3a50346ca1e9d4033" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 38965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.025209 14293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:09:30.031298 14293 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:09:30.031858 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:30.037115 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:09:30.037710 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:31.068779 14293 tablet_server.cc:179] TabletServer@127.13.245.65:0 shutting down...
I20260709 13:09:31.103139 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:31.104112 14293 tablet_replica.cc:333] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.105253 14293 raft_consensus.cc:2243] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.106012 14293 raft_consensus.cc:2272] T f4044f6e219b4e5c899f9b76eeb96a63 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.108384 14293 tablet_replica.cc:333] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.109072 14293 raft_consensus.cc:2243] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.109962 14293 raft_consensus.cc:2272] T 8bc99f1300144e7e8dce0459149c2e4e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.112494 14293 tablet_replica.cc:333] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.113190 14293 raft_consensus.cc:2243] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.113651 14293 raft_consensus.cc:2272] T 94350653ad1a4236950446d0b9b145e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.116101 14293 tablet_replica.cc:333] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.116792 14293 raft_consensus.cc:2243] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.117301 14293 raft_consensus.cc:2272] T 6a9d7d5a06304a419681491c70bae21f P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.119499 14293 tablet_replica.cc:333] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.120217 14293 raft_consensus.cc:2243] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.120728 14293 raft_consensus.cc:2272] T 4b57060f797f422989f2547b9e683c1b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.123061 14293 tablet_replica.cc:333] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.123710 14293 raft_consensus.cc:2243] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.124190 14293 raft_consensus.cc:2272] T 286c130c14624caebfd7c7255d8517b6 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.126600 14293 tablet_replica.cc:333] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.127357 14293 raft_consensus.cc:2243] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.128481 14293 raft_consensus.cc:2272] T 46d9f0eb428743e2a186d4fd71f3502c P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.130740 14293 tablet_replica.cc:333] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.131369 14293 raft_consensus.cc:2243] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.131878 14293 raft_consensus.cc:2272] T 49f18a2be6fc41258827f2e4b55264e9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.134598 14293 tablet_replica.cc:333] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.135439 14293 raft_consensus.cc:2243] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.136001 14293 raft_consensus.cc:2272] T 93aaf58a9c614de79eb2d13aaf9d2f93 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.138603 14293 tablet_replica.cc:333] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.139333 14293 raft_consensus.cc:2243] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.139925 14293 raft_consensus.cc:2272] T d153051ca1bc4e949231cd0b48969dde P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.142329 14293 tablet_replica.cc:333] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.142937 14293 raft_consensus.cc:2243] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.143373 14293 raft_consensus.cc:2272] T af165e01f8f7422598570900708e8fc8 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.145823 14293 tablet_replica.cc:333] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.146534 14293 raft_consensus.cc:2243] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.147496 14293 raft_consensus.cc:2272] T f13f8e46642b463aaf81f7fd18b371ea P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.150225 14293 tablet_replica.cc:333] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.151078 14293 raft_consensus.cc:2243] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.152251 14293 raft_consensus.cc:2272] T 78238d850a7c48c797f1928f229dae9e P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:31.152730 25529 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:09:31.155977 14293 tablet_replica.cc:333] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
W20260709 13:09:31.156678 25529 consensus_peers.cc:597] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.157102 14293 raft_consensus.cc:2243] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.158223 14293 raft_consensus.cc:2272] T dec1a6107acf495cb824d25638aa6148 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.160948 14293 tablet_replica.cc:333] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.161654 14293 raft_consensus.cc:2243] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.162142 14293 raft_consensus.cc:2272] T d3bf3db834064004b021f0ac26b3c7fc P d58a0a13e5c34fb3bf3162e55c0ed08d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.165244 14293 tablet_replica.cc:333] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.166062 14293 raft_consensus.cc:2243] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.166767 14293 raft_consensus.cc:2272] T 862fe6740c45420ba63831327761332b P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:31.168833 25603 consensus_peers.cc:597] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.170177 14293 tablet_replica.cc:333] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.171029 14293 raft_consensus.cc:2243] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:31.171134 25529 consensus_peers.cc:597] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.171787 14293 raft_consensus.cc:2272] T 60781c14a1c749638b56f96a316323d9 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.174052 14293 tablet_replica.cc:333] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d: stopping tablet replica
I20260709 13:09:31.174568 14293 raft_consensus.cc:2243] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.175459 14293 raft_consensus.cc:2272] T fe3eef16b7f34533bfeb162c201d9f28 P d58a0a13e5c34fb3bf3162e55c0ed08d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:31.183701 25529 consensus_peers.cc:597] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:31.197662 25529 consensus_peers.cc:597] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:31.198796 25603 consensus_peers.cc:597] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.225520 14293 tablet_server.cc:196] TabletServer@127.13.245.65:0 shutdown complete.
I20260709 13:09:31.270954 14293 tablet_server.cc:179] TabletServer@127.13.245.66:0 shutting down...
I20260709 13:09:31.306185 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:31.307122 14293 tablet_replica.cc:333] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.308053 14293 raft_consensus.cc:2243] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.309125 14293 raft_consensus.cc:2272] T 94350653ad1a4236950446d0b9b145e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.312252 14293 tablet_replica.cc:333] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.313416 14293 raft_consensus.cc:2243] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.314049 14293 raft_consensus.cc:2272] T 6a9d7d5a06304a419681491c70bae21f P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.317217 14293 tablet_replica.cc:333] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.317901 14293 raft_consensus.cc:2243] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.318475 14293 raft_consensus.cc:2272] T 60781c14a1c749638b56f96a316323d9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.322044 14293 tablet_replica.cc:333] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.322891 14293 raft_consensus.cc:2243] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.323400 14293 raft_consensus.cc:2272] T fe3eef16b7f34533bfeb162c201d9f28 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.325819 14293 tablet_replica.cc:333] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.326463 14293 raft_consensus.cc:2243] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.327603 14293 raft_consensus.cc:2272] T 4b57060f797f422989f2547b9e683c1b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.330174 14293 tablet_replica.cc:333] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.330840 14293 raft_consensus.cc:2243] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.331856 14293 raft_consensus.cc:2272] T 286c130c14624caebfd7c7255d8517b6 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.334318 14293 tablet_replica.cc:333] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.334988 14293 raft_consensus.cc:2243] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.335523 14293 raft_consensus.cc:2272] T f4044f6e219b4e5c899f9b76eeb96a63 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.337855 14293 tablet_replica.cc:333] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.338459 14293 raft_consensus.cc:2243] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.338999 14293 raft_consensus.cc:2272] T 8bc99f1300144e7e8dce0459149c2e4e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:31.341773 25602 consensus_peers.cc:597] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 -> Peer bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965): Couldn't send request to peer bcf2a1dc6ce04cb3a50346ca1e9d4033. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.342080 14293 tablet_replica.cc:333] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.342912 14293 raft_consensus.cc:2243] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.343458 14293 raft_consensus.cc:2272] T 46d9f0eb428743e2a186d4fd71f3502c P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:31.345613 25603 consensus_peers.cc:597] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:42365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.346478 14293 tablet_replica.cc:333] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.347155 14293 raft_consensus.cc:2243] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.347664 14293 raft_consensus.cc:2272] T 49f18a2be6fc41258827f2e4b55264e9 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.349897 14293 tablet_replica.cc:333] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.350703 14293 raft_consensus.cc:2243] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.351276 14293 raft_consensus.cc:2272] T dec1a6107acf495cb824d25638aa6148 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.353724 14293 tablet_replica.cc:333] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.354389 14293 raft_consensus.cc:2243] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.354877 14293 raft_consensus.cc:2272] T 78238d850a7c48c797f1928f229dae9e P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.357185 14293 tablet_replica.cc:333] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.357986 14293 raft_consensus.cc:2243] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.359062 14293 raft_consensus.cc:2272] T 93aaf58a9c614de79eb2d13aaf9d2f93 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.361714 14293 tablet_replica.cc:333] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.362378 14293 raft_consensus.cc:2243] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.363371 14293 raft_consensus.cc:2272] T d153051ca1bc4e949231cd0b48969dde P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.365849 14293 tablet_replica.cc:333] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.366524 14293 raft_consensus.cc:2243] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.367071 14293 raft_consensus.cc:2272] T af165e01f8f7422598570900708e8fc8 P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.369781 14293 tablet_replica.cc:333] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.370471 14293 raft_consensus.cc:2243] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.371084 14293 raft_consensus.cc:2272] T f13f8e46642b463aaf81f7fd18b371ea P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.373857 14293 tablet_replica.cc:333] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.374670 14293 raft_consensus.cc:2243] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.375248 14293 raft_consensus.cc:2272] T d3bf3db834064004b021f0ac26b3c7fc P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.377799 14293 tablet_replica.cc:333] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033: stopping tablet replica
I20260709 13:09:31.378410 14293 raft_consensus.cc:2243] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.379575 14293 raft_consensus.cc:2272] T 862fe6740c45420ba63831327761332b P bcf2a1dc6ce04cb3a50346ca1e9d4033 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:31.407595 25603 consensus_peers.cc:597] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:42365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.427393 14293 tablet_server.cc:196] TabletServer@127.13.245.66:0 shutdown complete.
W20260709 13:09:31.466902 25602 consensus_peers.cc:597] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 -> Peer bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965): Couldn't send request to peer bcf2a1dc6ce04cb3a50346ca1e9d4033. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:38965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.470515 14293 tablet_server.cc:179] TabletServer@127.13.245.67:0 shutting down...
I20260709 13:09:31.503509 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:31.504328 14293 tablet_replica.cc:333] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.505100 14293 raft_consensus.cc:2243] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.505635 14293 raft_consensus.cc:2272] T 94350653ad1a4236950446d0b9b145e9 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.508106 14293 tablet_replica.cc:333] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.508749 14293 raft_consensus.cc:2243] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.509686 14293 raft_consensus.cc:2272] T 6a9d7d5a06304a419681491c70bae21f P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.512039 14293 tablet_replica.cc:333] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.512735 14293 raft_consensus.cc:2243] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.513700 14293 raft_consensus.cc:2272] T f4044f6e219b4e5c899f9b76eeb96a63 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.516184 14293 tablet_replica.cc:333] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.516759 14293 raft_consensus.cc:2243] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.517266 14293 raft_consensus.cc:2272] T 8bc99f1300144e7e8dce0459149c2e4e P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.519382 14293 tablet_replica.cc:333] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.520001 14293 raft_consensus.cc:2243] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.520506 14293 raft_consensus.cc:2272] T 46d9f0eb428743e2a186d4fd71f3502c P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.522753 14293 tablet_replica.cc:333] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.523576 14293 raft_consensus.cc:2243] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:09:31.524176 25603 consensus_peers.cc:597] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:42365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.524598 14293 raft_consensus.cc:2272] T 49f18a2be6fc41258827f2e4b55264e9 P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.527369 14293 tablet_replica.cc:333] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.528190 14293 raft_consensus.cc:2243] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.528787 14293 raft_consensus.cc:2272] T 4b57060f797f422989f2547b9e683c1b P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:31.529619 25603 consensus_peers.cc:597] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 -> Peer d58a0a13e5c34fb3bf3162e55c0ed08d (127.13.245.65:42365): Couldn't send request to peer d58a0a13e5c34fb3bf3162e55c0ed08d. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:42365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.531260 14293 tablet_replica.cc:333] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.531944 14293 raft_consensus.cc:2243] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.532423 14293 raft_consensus.cc:2272] T 286c130c14624caebfd7c7255d8517b6 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.534612 14293 tablet_replica.cc:333] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.535172 14293 raft_consensus.cc:2243] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.535678 14293 raft_consensus.cc:2272] T 78238d850a7c48c797f1928f229dae9e P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.537729 14293 tablet_replica.cc:333] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.538375 14293 raft_consensus.cc:2243] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.538833 14293 raft_consensus.cc:2272] T dec1a6107acf495cb824d25638aa6148 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.541435 14293 tablet_replica.cc:333] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.542021 14293 raft_consensus.cc:2243] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.543040 14293 raft_consensus.cc:2272] T d3bf3db834064004b021f0ac26b3c7fc P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.545745 14293 tablet_replica.cc:333] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.546486 14293 raft_consensus.cc:2243] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:31.546490 25602 consensus_peers.cc:597] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 -> Peer bcf2a1dc6ce04cb3a50346ca1e9d4033 (127.13.245.66:38965): Couldn't send request to peer bcf2a1dc6ce04cb3a50346ca1e9d4033. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:38965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.547115 14293 raft_consensus.cc:2272] T 862fe6740c45420ba63831327761332b P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.549551 14293 tablet_replica.cc:333] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.550086 14293 raft_consensus.cc:2243] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.551014 14293 raft_consensus.cc:2272] T 60781c14a1c749638b56f96a316323d9 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.553341 14293 tablet_replica.cc:333] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.553865 14293 raft_consensus.cc:2243] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.554268 14293 raft_consensus.cc:2272] T fe3eef16b7f34533bfeb162c201d9f28 P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.556548 14293 tablet_replica.cc:333] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.557104 14293 raft_consensus.cc:2243] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.557518 14293 raft_consensus.cc:2272] T f13f8e46642b463aaf81f7fd18b371ea P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.559623 14293 tablet_replica.cc:333] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.560091 14293 raft_consensus.cc:2243] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.560487 14293 raft_consensus.cc:2272] T 93aaf58a9c614de79eb2d13aaf9d2f93 P 873884a5b5414a60a19e0032108cef32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.562647 14293 tablet_replica.cc:333] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.563109 14293 raft_consensus.cc:2243] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:31.563494 14293 raft_consensus.cc:2272] T d153051ca1bc4e949231cd0b48969dde P 873884a5b5414a60a19e0032108cef32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.565606 14293 tablet_replica.cc:333] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32: stopping tablet replica
I20260709 13:09:31.566071 14293 raft_consensus.cc:2243] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.566872 14293 raft_consensus.cc:2272] T af165e01f8f7422598570900708e8fc8 P 873884a5b5414a60a19e0032108cef32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.608466 14293 tablet_server.cc:196] TabletServer@127.13.245.67:0 shutdown complete.
I20260709 13:09:31.650743 14293 master.cc:562] Master@127.13.245.126:39679 shutting down...
I20260709 13:09:31.678541 14293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.679217 14293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.679625 14293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 44a0029952ea4b06b29aff5b0e441b2b: stopping tablet replica
I20260709 13:09:31.702036 14293 master.cc:584] Master@127.13.245.126:39679 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13109 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:09:31.772063 14293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.245.126:41493
I20260709 13:09:31.773402 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.780258 25960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.780726 25962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.780586 25959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.781809 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:31.782819 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.783007 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.783198 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602571783180 us; error 0 us; skew 500 ppm
I20260709 13:09:31.783880 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.786494 14293 webserver.cc:533] Webserver started at http://127.13.245.126:41311/ using document root <none> and password file <none>
I20260709 13:09:31.787006 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.787209 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.787511 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.788780 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/master-0-root/instance:
uuid: "399a22f2bfb444d3b4d2b6b337a11b3c"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-fc6v"
I20260709 13:09:31.793529 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:31.797291 25967 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.798242 14293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:31.798599 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/master-0-root
uuid: "399a22f2bfb444d3b4d2b6b337a11b3c"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-fc6v"
I20260709 13:09:31.798925 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.813184 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.815212 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.863190 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.126:41493
I20260709 13:09:31.863297 26018 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.126:41493 every 8 connection(s)
I20260709 13:09:31.867509 26019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.879786 26019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c: Bootstrap starting.
I20260709 13:09:31.885363 26019 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.890067 26019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c: No bootstrap required, opened a new log
I20260709 13:09:31.892560 26019 raft_consensus.cc:359] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "399a22f2bfb444d3b4d2b6b337a11b3c" member_type: VOTER }
I20260709 13:09:31.893278 26019 raft_consensus.cc:385] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.893563 26019 raft_consensus.cc:740] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 399a22f2bfb444d3b4d2b6b337a11b3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.894306 26019 consensus_queue.cc:260] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "399a22f2bfb444d3b4d2b6b337a11b3c" member_type: VOTER }
I20260709 13:09:31.894857 26019 raft_consensus.cc:399] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:31.895130 26019 raft_consensus.cc:493] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:31.895469 26019 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.901930 26019 raft_consensus.cc:515] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "399a22f2bfb444d3b4d2b6b337a11b3c" member_type: VOTER }
I20260709 13:09:31.902567 26019 leader_election.cc:304] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 399a22f2bfb444d3b4d2b6b337a11b3c; no voters: 
I20260709 13:09:31.904014 26019 leader_election.cc:290] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:31.904404 26022 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.906033 26022 raft_consensus.cc:697] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 1 LEADER]: Becoming Leader. State: Replica: 399a22f2bfb444d3b4d2b6b337a11b3c, State: Running, Role: LEADER
I20260709 13:09:31.906775 26022 consensus_queue.cc:237] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "399a22f2bfb444d3b4d2b6b337a11b3c" member_type: VOTER }
I20260709 13:09:31.907833 26019 sys_catalog.cc:565] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:31.911993 26024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 399a22f2bfb444d3b4d2b6b337a11b3c. Latest consensus state: current_term: 1 leader_uuid: "399a22f2bfb444d3b4d2b6b337a11b3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "399a22f2bfb444d3b4d2b6b337a11b3c" member_type: VOTER } }
I20260709 13:09:31.912739 26024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:31.911850 26023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "399a22f2bfb444d3b4d2b6b337a11b3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "399a22f2bfb444d3b4d2b6b337a11b3c" member_type: VOTER } }
I20260709 13:09:31.913695 26023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:31.922312 26029 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:31.928462 26029 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:31.930224 14293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:31.938719 26029 catalog_manager.cc:1383] Generated new cluster ID: 493ad1edc9a945cfa32597f759a19205
I20260709 13:09:31.939002 26029 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:31.958458 26029 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:31.959975 26029 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:31.972990 26029 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c: Generated new TSK 0
I20260709 13:09:31.973670 26029 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:31.997377 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:32.004154 26040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.005389 26041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.006990 26043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.008002 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:32.008949 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:32.009131 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:32.009346 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602572009310 us; error 0 us; skew 500 ppm
I20260709 13:09:32.009992 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:32.012537 14293 webserver.cc:533] Webserver started at http://127.13.245.65:38173/ using document root <none> and password file <none>
I20260709 13:09:32.013057 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:32.013253 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:32.013545 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:32.014770 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-0-root/instance:
uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-fc6v"
I20260709 13:09:32.019847 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:09:32.023588 26048 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.024446 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:32.024763 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-0-root
uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-fc6v"
I20260709 13:09:32.025022 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:32.043016 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:32.044471 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:32.046109 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:32.048732 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:32.048969 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.049226 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:32.049436 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.095679 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.65:33083
I20260709 13:09:32.095788 26110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.65:33083 every 8 connection(s)
I20260709 13:09:32.101239 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:32.110321 26115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.110680 26116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.116487 26111 heartbeater.cc:344] Connected to a master server at 127.13.245.126:41493
I20260709 13:09:32.117214 26111 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:32.117480 26119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.116639 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:32.118330 26111 heartbeater.cc:507] Master 127.13.245.126:41493 requested a full tablet report, sending...
I20260709 13:09:32.119146 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:32.119472 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:32.119735 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602572119690 us; error 0 us; skew 500 ppm
I20260709 13:09:32.120608 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:32.121151 25984 ts_manager.cc:194] Registered new tserver with Master: e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083)
I20260709 13:09:32.123608 25984 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38154
I20260709 13:09:32.124255 14293 webserver.cc:533] Webserver started at http://127.13.245.66:34715/ using document root <none> and password file <none>
I20260709 13:09:32.124974 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:32.125252 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:32.125628 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:32.127374 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-1-root/instance:
uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-fc6v"
I20260709 13:09:32.133402 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:32.137136 26123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.138046 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:32.138417 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-1-root
uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-fc6v"
I20260709 13:09:32.138751 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:32.156456 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:32.157945 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:32.160043 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:32.162739 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:32.162990 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.163266 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:32.163450 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.211275 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.66:41025
I20260709 13:09:32.211414 26185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.66:41025 every 8 connection(s)
I20260709 13:09:32.216722 14293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:32.225749 26189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.228125 26190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.231230 26186 heartbeater.cc:344] Connected to a master server at 127.13.245.126:41493
I20260709 13:09:32.231784 26186 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:32.231935 26192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.232729 26186 heartbeater.cc:507] Master 127.13.245.126:41493 requested a full tablet report, sending...
I20260709 13:09:32.235056 25984 ts_manager.cc:194] Registered new tserver with Master: c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:32.236495 14293 server_base.cc:1061] running on GCE node
I20260709 13:09:32.236658 25984 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38160
I20260709 13:09:32.237720 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:32.238029 14293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:32.238255 14293 hybrid_clock.cc:648] HybridClock initialized: now 1783602572238238 us; error 0 us; skew 500 ppm
I20260709 13:09:32.238837 14293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:32.241798 14293 webserver.cc:533] Webserver started at http://127.13.245.67:35165/ using document root <none> and password file <none>
I20260709 13:09:32.242558 14293 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:32.242817 14293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:32.243196 14293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:32.245082 14293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-2-root/instance:
uuid: "eabde53de26b4615bb9e2eebc36d78e9"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-fc6v"
I20260709 13:09:32.251487 14293 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:32.256618 26197 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.257692 14293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:09:32.258199 14293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-2-root
uuid: "eabde53de26b4615bb9e2eebc36d78e9"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-fc6v"
I20260709 13:09:32.258632 14293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCpTOg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602214968311-14293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:32.292305 14293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:32.293625 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:32.295164 14293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:32.297525 14293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:32.297703 14293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.298007 14293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:32.298156 14293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.348569 14293 rpc_server.cc:307] RPC server started. Bound to: 127.13.245.67:33705
I20260709 13:09:32.348691 26259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.245.67:33705 every 8 connection(s)
I20260709 13:09:32.364960 26260 heartbeater.cc:344] Connected to a master server at 127.13.245.126:41493
I20260709 13:09:32.365551 26260 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:32.366429 26260 heartbeater.cc:507] Master 127.13.245.126:41493 requested a full tablet report, sending...
I20260709 13:09:32.368683 25984 ts_manager.cc:194] Registered new tserver with Master: eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:32.369612 14293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017419323s
I20260709 13:09:32.370200 25984 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38172
I20260709 13:09:32.399891 25984 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38178:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:32.403084 25984 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:32.474797 26151 tablet_service.cc:1511] Processing CreateTablet for tablet 94f7609a5a854e47968736437c22b439 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:32.476013 26150 tablet_service.cc:1511] Processing CreateTablet for tablet 35d098ba726f4a1b932215a321920f5e (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:32.476560 26151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f7609a5a854e47968736437c22b439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.477619 26150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d098ba726f4a1b932215a321920f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.502708 26149 tablet_service.cc:1511] Processing CreateTablet for tablet 29b9c0becd104cabbc39a94a6dc96559 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:32.504956 26149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b9c0becd104cabbc39a94a6dc96559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.514420 26148 tablet_service.cc:1511] Processing CreateTablet for tablet 452a78d7dcc5496e9ea65721e4e06717 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:32.516304 26148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452a78d7dcc5496e9ea65721e4e06717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.517745 26275 tablet_bootstrap.cc:492] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:32.528836 26275 tablet_bootstrap.cc:654] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.528702 26076 tablet_service.cc:1511] Processing CreateTablet for tablet 94f7609a5a854e47968736437c22b439 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:32.530459 26076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f7609a5a854e47968736437c22b439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.532912 26075 tablet_service.cc:1511] Processing CreateTablet for tablet 35d098ba726f4a1b932215a321920f5e (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:32.534596 26075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d098ba726f4a1b932215a321920f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.537153 26074 tablet_service.cc:1511] Processing CreateTablet for tablet 29b9c0becd104cabbc39a94a6dc96559 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:32.538942 26074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b9c0becd104cabbc39a94a6dc96559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.541054 26073 tablet_service.cc:1511] Processing CreateTablet for tablet 452a78d7dcc5496e9ea65721e4e06717 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:32.542768 26073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452a78d7dcc5496e9ea65721e4e06717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.545046 26072 tablet_service.cc:1511] Processing CreateTablet for tablet c1e81f92fda44698906a47c3de450d01 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:32.546865 26072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e81f92fda44698906a47c3de450d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.549275 26223 tablet_service.cc:1511] Processing CreateTablet for tablet 29b9c0becd104cabbc39a94a6dc96559 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:32.551059 26223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b9c0becd104cabbc39a94a6dc96559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.552681 26225 tablet_service.cc:1511] Processing CreateTablet for tablet 94f7609a5a854e47968736437c22b439 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:32.554214 26225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f7609a5a854e47968736437c22b439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.550630 26222 tablet_service.cc:1511] Processing CreateTablet for tablet 452a78d7dcc5496e9ea65721e4e06717 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:32.549307 26224 tablet_service.cc:1511] Processing CreateTablet for tablet 35d098ba726f4a1b932215a321920f5e (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:32.556478 26222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452a78d7dcc5496e9ea65721e4e06717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.577162 26224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d098ba726f4a1b932215a321920f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.585880 26277 tablet_bootstrap.cc:492] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:32.594314 26277 tablet_bootstrap.cc:654] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.603351 26275 tablet_bootstrap.cc:492] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:32.604108 26275 ts_tablet_manager.cc:1403] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.043s
I20260709 13:09:32.607462 26151 tablet_service.cc:1511] Processing CreateTablet for tablet c1e81f92fda44698906a47c3de450d01 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:32.609103 26151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e81f92fda44698906a47c3de450d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.618357 26277 tablet_bootstrap.cc:492] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:32.619060 26277 ts_tablet_manager.cc:1403] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.011s
I20260709 13:09:32.622388 26277 raft_consensus.cc:359] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.623133 26277 raft_consensus.cc:385] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.624692 26279 tablet_bootstrap.cc:492] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:32.623443 26277 raft_consensus.cc:740] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.631640 26277 consensus_queue.cc:260] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.635576 26224 tablet_service.cc:1511] Processing CreateTablet for tablet c1e81f92fda44698906a47c3de450d01 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:32.635844 26275 raft_consensus.cc:359] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.637173 26224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e81f92fda44698906a47c3de450d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.637494 26275 raft_consensus.cc:385] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.637956 26275 raft_consensus.cc:740] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.637724 26072 tablet_service.cc:1511] Processing CreateTablet for tablet 40deffc154474fcb83c0238539dec4aa (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:32.639246 26072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40deffc154474fcb83c0238539dec4aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.644397 26279 tablet_bootstrap.cc:654] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.639122 26275 consensus_queue.cc:260] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.667707 26277 ts_tablet_manager.cc:1434] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.048s	user 0.025s	sys 0.007s
I20260709 13:09:32.667407 26111 heartbeater.cc:499] Master 127.13.245.126:41493 was elected leader, sending a full tablet report...
I20260709 13:09:32.681497 26275 ts_tablet_manager.cc:1434] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.004s
I20260709 13:09:32.685598 26149 tablet_service.cc:1511] Processing CreateTablet for tablet 40deffc154474fcb83c0238539dec4aa (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:32.687140 26149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40deffc154474fcb83c0238539dec4aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.692332 26186 heartbeater.cc:499] Master 127.13.245.126:41493 was elected leader, sending a full tablet report...
I20260709 13:09:32.694582 26275 tablet_bootstrap.cc:492] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:32.704694 26224 tablet_service.cc:1511] Processing CreateTablet for tablet 40deffc154474fcb83c0238539dec4aa (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:32.706677 26224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40deffc154474fcb83c0238539dec4aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.710897 26277 tablet_bootstrap.cc:492] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:32.726717 26076 tablet_service.cc:1511] Processing CreateTablet for tablet cf43b9c70995461ba3cb7d1fe30eb930 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:32.728546 26076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf43b9c70995461ba3cb7d1fe30eb930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.735442 26277 tablet_bootstrap.cc:654] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.732815 26151 tablet_service.cc:1511] Processing CreateTablet for tablet cf43b9c70995461ba3cb7d1fe30eb930 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:32.736790 26151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf43b9c70995461ba3cb7d1fe30eb930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.744524 26223 tablet_service.cc:1511] Processing CreateTablet for tablet cf43b9c70995461ba3cb7d1fe30eb930 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:32.746594 26223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf43b9c70995461ba3cb7d1fe30eb930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.757377 26275 tablet_bootstrap.cc:654] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.758282 26279 tablet_bootstrap.cc:492] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:32.759037 26279 ts_tablet_manager.cc:1403] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.135s	user 0.043s	sys 0.035s
I20260709 13:09:32.763010 26279 raft_consensus.cc:359] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.764047 26279 raft_consensus.cc:385] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.764453 26279 raft_consensus.cc:740] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.770594 26076 tablet_service.cc:1511] Processing CreateTablet for tablet 6aecf57a23cb46209619dea0ea937271 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:32.773018 26076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aecf57a23cb46209619dea0ea937271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.772452 26279 consensus_queue.cc:260] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.783680 26277 tablet_bootstrap.cc:492] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:32.784775 26277 ts_tablet_manager.cc:1403] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.026s
I20260709 13:09:32.784432 26151 tablet_service.cc:1511] Processing CreateTablet for tablet 6aecf57a23cb46209619dea0ea937271 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:32.786316 26151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aecf57a23cb46209619dea0ea937271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.786847 26275 tablet_bootstrap.cc:492] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:32.791244 26223 tablet_service.cc:1511] Processing CreateTablet for tablet 6aecf57a23cb46209619dea0ea937271 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:32.792699 26223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aecf57a23cb46209619dea0ea937271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.787422 26275 ts_tablet_manager.cc:1403] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.020s
I20260709 13:09:32.802153 26279 ts_tablet_manager.cc:1434] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.019s
I20260709 13:09:32.802922 26260 heartbeater.cc:499] Master 127.13.245.126:41493 was elected leader, sending a full tablet report...
I20260709 13:09:32.803439 26279 tablet_bootstrap.cc:492] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:32.803776 26076 tablet_service.cc:1511] Processing CreateTablet for tablet e51974e2c8c34be5baf208e164d85548 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:32.805171 26076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51974e2c8c34be5baf208e164d85548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.802446 26277 raft_consensus.cc:359] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.809604 26277 raft_consensus.cc:385] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.809988 26277 raft_consensus.cc:740] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.810607 26279 tablet_bootstrap.cc:654] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.811902 26277 consensus_queue.cc:260] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.812108 26275 raft_consensus.cc:359] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:32.815860 26275 raft_consensus.cc:385] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.816283 26275 raft_consensus.cc:740] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.817353 26275 consensus_queue.cc:260] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:32.817857 26149 tablet_service.cc:1511] Processing CreateTablet for tablet e51974e2c8c34be5baf208e164d85548 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:32.819411 26149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51974e2c8c34be5baf208e164d85548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.824751 26223 tablet_service.cc:1511] Processing CreateTablet for tablet e51974e2c8c34be5baf208e164d85548 (DEFAULT_TABLE table=test-workload [id=6e80243723eb4a2fa9783568a9033e23]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:32.826027 26275 ts_tablet_manager.cc:1434] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:09:32.827832 26275 tablet_bootstrap.cc:492] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:32.826293 26223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51974e2c8c34be5baf208e164d85548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.834784 26277 ts_tablet_manager.cc:1434] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:09:32.835944 26277 tablet_bootstrap.cc:492] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:32.855687 26275 tablet_bootstrap.cc:654] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.864181 26279 tablet_bootstrap.cc:492] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:32.864773 26279 ts_tablet_manager.cc:1403] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.034s
I20260709 13:09:32.865870 26277 tablet_bootstrap.cc:654] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.868053 26279 raft_consensus.cc:359] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:32.868999 26279 raft_consensus.cc:385] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.869310 26279 raft_consensus.cc:740] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.870193 26279 consensus_queue.cc:260] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:32.872397 26280 raft_consensus.cc:493] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.872519 26275 tablet_bootstrap.cc:492] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:32.873037 26279 ts_tablet_manager.cc:1434] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:09:32.873332 26275 ts_tablet_manager.cc:1403] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.000s
I20260709 13:09:32.873056 26280 raft_consensus.cc:515] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.874231 26279 tablet_bootstrap.cc:492] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:32.877110 26282 raft_consensus.cc:493] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.877287 26275 raft_consensus.cc:359] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.878165 26275 raft_consensus.cc:385] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.877804 26282 raft_consensus.cc:515] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:32.878495 26275 raft_consensus.cc:740] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.879685 26275 consensus_queue.cc:260] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.883029 26279 tablet_bootstrap.cc:654] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.885833 26280 leader_election.cc:290] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:32.893356 26282 leader_election.cc:290] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705), e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083)
I20260709 13:09:32.899837 26280 raft_consensus.cc:493] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.900982 26280 raft_consensus.cc:515] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.925072 26280 leader_election.cc:290] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
W20260709 13:09:32.930516 26032 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:32.938571 26275 ts_tablet_manager.cc:1434] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.065s	user 0.025s	sys 0.033s
I20260709 13:09:32.942163 26279 tablet_bootstrap.cc:492] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:32.942957 26279 ts_tablet_manager.cc:1403] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.069s	user 0.033s	sys 0.028s
I20260709 13:09:32.946628 26279 raft_consensus.cc:359] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.947713 26279 raft_consensus.cc:385] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.948077 26279 raft_consensus.cc:740] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.949376 26279 consensus_queue.cc:260] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.952860 26279 ts_tablet_manager.cc:1434] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.009s
I20260709 13:09:32.954402 26279 tablet_bootstrap.cc:492] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:32.955090 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40deffc154474fcb83c0238539dec4aa" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:32.958209 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e81f92fda44698906a47c3de450d01" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
W20260709 13:09:32.960382 26051 leader_election.cc:343] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:32.961934 26051 leader_election.cc:343] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.964759 26279 tablet_bootstrap.cc:654] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.981151 26279 tablet_bootstrap.cc:492] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:32.981801 26279 ts_tablet_manager.cc:1403] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.012s
I20260709 13:09:32.983129 26277 tablet_bootstrap.cc:492] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:32.983865 26277 ts_tablet_manager.cc:1403] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.148s	user 0.022s	sys 0.033s
I20260709 13:09:32.985239 26279 raft_consensus.cc:359] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.986127 26279 raft_consensus.cc:385] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.986452 26279 raft_consensus.cc:740] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.987530 26277 raft_consensus.cc:359] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.987608 26279 consensus_queue.cc:260] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.990263 26279 ts_tablet_manager.cc:1434] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:09:32.991459 26279 tablet_bootstrap.cc:492] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:32.988616 26277 raft_consensus.cc:385] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.997035 26277 raft_consensus.cc:740] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.997560 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40deffc154474fcb83c0238539dec4aa" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:32.998292 26277 consensus_queue.cc:260] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:32.999104 26279 tablet_bootstrap.cc:654] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:32.999492 26050 leader_election.cc:343] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.000049 26050 leader_election.cc:304] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b; no voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:33.002262 26280 raft_consensus.cc:2749] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.003283 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e81f92fda44698906a47c3de450d01" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:33.004143 26275 tablet_bootstrap.cc:492] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:33.005151 26277 ts_tablet_manager.cc:1434] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:09:33.006773 26277 tablet_bootstrap.cc:492] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:33.011813 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f7609a5a854e47968736437c22b439" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.012193 26279 tablet_bootstrap.cc:492] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:33.012650 26235 raft_consensus.cc:2468] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.012895 26279 ts_tablet_manager.cc:1403] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:09:33.014189 26126 leader_election.cc:304] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
W20260709 13:09:33.015163 26050 leader_election.cc:343] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.015281 26291 raft_consensus.cc:2804] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.015983 26291 raft_consensus.cc:493] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.016404 26291 raft_consensus.cc:3060] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.016731 26277 tablet_bootstrap.cc:654] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.016721 26279 raft_consensus.cc:359] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.017689 26279 raft_consensus.cc:385] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.018021 26279 raft_consensus.cc:740] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.018719 26275 tablet_bootstrap.cc:654] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.019096 26279 consensus_queue.cc:260] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.022639 26279 ts_tablet_manager.cc:1434] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:33.023598 26050 leader_election.cc:304] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b; no voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:33.024276 26279 tablet_bootstrap.cc:492] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:33.024926 26297 raft_consensus.cc:2749] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.029651 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f7609a5a854e47968736437c22b439" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:33.031193 26277 tablet_bootstrap.cc:492] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:33.031875 26277 ts_tablet_manager.cc:1403] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.011s
I20260709 13:09:33.032815 26279 tablet_bootstrap.cc:654] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:33.032676 26127 leader_election.cc:343] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.035578 26277 raft_consensus.cc:359] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:33.036619 26277 raft_consensus.cc:385] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.037088 26277 raft_consensus.cc:740] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.038425 26277 consensus_queue.cc:260] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:33.042182 26277 ts_tablet_manager.cc:1434] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:33.043682 26277 tablet_bootstrap.cc:492] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:33.052884 26277 tablet_bootstrap.cc:654] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.053627 26282 raft_consensus.cc:493] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.054270 26282 raft_consensus.cc:515] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.062222 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d098ba726f4a1b932215a321920f5e" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.062273 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d098ba726f4a1b932215a321920f5e" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:33.063186 26235 raft_consensus.cc:2468] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
W20260709 13:09:33.064275 26127 leader_election.cc:343] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.064833 26282 leader_election.cc:290] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.064975 26126 leader_election.cc:304] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:33.066054 26282 raft_consensus.cc:2804] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.066619 26282 raft_consensus.cc:493] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.067106 26282 raft_consensus.cc:3060] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.067286 26277 tablet_bootstrap.cc:492] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:33.068373 26277 ts_tablet_manager.cc:1403] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:09:33.072966 26277 raft_consensus.cc:359] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.074206 26277 raft_consensus.cc:385] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.074654 26277 raft_consensus.cc:740] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.075691 26277 consensus_queue.cc:260] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.079490 26277 ts_tablet_manager.cc:1434] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:33.081171 26277 tablet_bootstrap.cc:492] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:33.085878 26297 raft_consensus.cc:493] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.086768 26297 raft_consensus.cc:515] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.091627 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d098ba726f4a1b932215a321920f5e" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.092553 26235 raft_consensus.cc:2468] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:33.094507 26051 leader_election.cc:304] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:33.095896 26280 raft_consensus.cc:2804] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.096431 26280 raft_consensus.cc:493] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.096905 26280 raft_consensus.cc:3060] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:33.102140 26112 tablet.cc:2406] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:33.101909 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d098ba726f4a1b932215a321920f5e" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:33.096627 26291 raft_consensus.cc:515] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:33.102782 26297 leader_election.cc:290] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.106235 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f7609a5a854e47968736437c22b439" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.107115 26235 raft_consensus.cc:3060] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.113607 26280 raft_consensus.cc:515] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.120945 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f7609a5a854e47968736437c22b439" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:33.120234 26277 tablet_bootstrap.cc:654] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.121935 26086 raft_consensus.cc:3060] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.128784 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d098ba726f4a1b932215a321920f5e" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:33.134312 26234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d098ba726f4a1b932215a321920f5e" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.135315 26234 raft_consensus.cc:3060] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.143843 26280 leader_election.cc:290] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.146057 26282 raft_consensus.cc:515] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.147985 26160 raft_consensus.cc:2393] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e54cde55a7eb4cafaa86877bae1f1f4b in current term 1: Already voted for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in this term.
I20260709 13:09:33.149863 26234 raft_consensus.cc:2468] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:33.140523 26291 leader_election.cc:290] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705), e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083)
I20260709 13:09:33.158931 26051 leader_election.cc:304] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: c716eacc10c54db9b4c6ba82c8a81ee9
I20260709 13:09:33.159875 26291 raft_consensus.cc:493] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.156749 26277 tablet_bootstrap.cc:492] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:33.161016 26280 raft_consensus.cc:2804] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.161563 26277 ts_tablet_manager.cc:1403] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.004s
I20260709 13:09:33.163343 26280 raft_consensus.cc:697] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:33.164845 26280 consensus_queue.cc:237] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.160657 26291 raft_consensus.cc:515] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.176105 26279 tablet_bootstrap.cc:492] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:33.177057 26279 ts_tablet_manager.cc:1403] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.153s	user 0.050s	sys 0.092s
I20260709 13:09:33.177042 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452a78d7dcc5496e9ea65721e4e06717" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:33.178364 26085 raft_consensus.cc:2468] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.180456 26127 leader_election.cc:304] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.182039 26279 raft_consensus.cc:359] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.183200 26279 raft_consensus.cc:385] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.183600 26279 raft_consensus.cc:740] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.184027 26234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452a78d7dcc5496e9ea65721e4e06717" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.185003 26234 raft_consensus.cc:2468] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.184851 26279 consensus_queue.cc:260] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.189049 26235 raft_consensus.cc:2468] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.190719 26275 tablet_bootstrap.cc:492] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:33.191277 26275 ts_tablet_manager.cc:1403] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.187s	user 0.041s	sys 0.089s
I20260709 13:09:33.191442 26126 leader_election.cc:304] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:33.192121 26279 ts_tablet_manager.cc:1434] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:09:33.166664 26277 raft_consensus.cc:359] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.193735 26277 raft_consensus.cc:385] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.194061 26277 raft_consensus.cc:740] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.195061 26279 tablet_bootstrap.cc:492] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:33.194900 26277 consensus_queue.cc:260] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.196715 26275 raft_consensus.cc:359] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.197557 26275 raft_consensus.cc:385] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.197762 26277 ts_tablet_manager.cc:1434] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:09:33.197934 26275 raft_consensus.cc:740] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.198972 26277 tablet_bootstrap.cc:492] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:33.199064 26275 consensus_queue.cc:260] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.192553 26086 raft_consensus.cc:2468] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.206290 26282 leader_election.cc:290] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.207288 26282 raft_consensus.cc:2804] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.189793 26291 leader_election.cc:290] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.207787 26282 raft_consensus.cc:493] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.208673 26304 raft_consensus.cc:2804] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.216169 26275 ts_tablet_manager.cc:1434] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.001s
I20260709 13:09:33.216621 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d098ba726f4a1b932215a321920f5e" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.217525 26235 raft_consensus.cc:2393] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c716eacc10c54db9b4c6ba82c8a81ee9 in current term 1: Already voted for candidate e54cde55a7eb4cafaa86877bae1f1f4b in this term.
I20260709 13:09:33.208714 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d098ba726f4a1b932215a321920f5e" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:33.218528 26275 tablet_bootstrap.cc:492] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:33.210754 26282 raft_consensus.cc:3060] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.212445 26304 raft_consensus.cc:697] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:33.224373 26304 consensus_queue.cc:237] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:33.225066 25983 catalog_manager.cc:5697] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 1 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.227185 26275 tablet_bootstrap.cc:654] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.232570 26126 leader_election.cc:304] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9; no voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:33.234381 26291 raft_consensus.cc:2749] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.236629 26306 raft_consensus.cc:493] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.239724 26306 raft_consensus.cc:515] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.242883 26306 leader_election.cc:290] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.244365 26279 tablet_bootstrap.cc:654] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.244491 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.245203 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:33.245329 26235 raft_consensus.cc:2468] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.245934 26086 raft_consensus.cc:2468] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.246834 26126 leader_election.cc:304] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:33.248001 26275 tablet_bootstrap.cc:492] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:33.248572 26275 ts_tablet_manager.cc:1403] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.002s
I20260709 13:09:33.248679 26306 raft_consensus.cc:2804] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.249210 26306 raft_consensus.cc:493] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.249598 26306 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.250299 26282 raft_consensus.cc:515] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.250449 25981 catalog_manager.cc:5697] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.252135 26275 raft_consensus.cc:359] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.252875 26282 leader_election.cc:290] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.253679 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452a78d7dcc5496e9ea65721e4e06717" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:33.254333 26086 raft_consensus.cc:3060] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.255066 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452a78d7dcc5496e9ea65721e4e06717" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.255947 26235 raft_consensus.cc:3060] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.265873 26277 tablet_bootstrap.cc:654] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.252964 26275 raft_consensus.cc:385] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.271786 26275 raft_consensus.cc:740] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.272188 26086 raft_consensus.cc:2468] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.272862 26275 consensus_queue.cc:260] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.273715 26127 leader_election.cc:304] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.274008 26279 tablet_bootstrap.cc:492] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:33.274770 26279 ts_tablet_manager.cc:1403] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.014s
I20260709 13:09:33.277290 26304 raft_consensus.cc:2804] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.278064 26304 raft_consensus.cc:697] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:33.278380 26279 raft_consensus.cc:359] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.279464 26279 raft_consensus.cc:385] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.279919 26279 raft_consensus.cc:740] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.279233 26304 consensus_queue.cc:237] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.274770 26235 raft_consensus.cc:2468] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.284049 26306 raft_consensus.cc:515] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.284844 26279 consensus_queue.cc:260] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.288527 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.289229 26235 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.289723 26279 ts_tablet_manager.cc:1434] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:09:33.291030 26279 tablet_bootstrap.cc:492] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:33.279223 26275 ts_tablet_manager.cc:1434] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:09:33.292868 26275 tablet_bootstrap.cc:492] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:33.295995 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:33.296793 26306 leader_election.cc:290] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.300535 26235 raft_consensus.cc:2468] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.301317 26275 tablet_bootstrap.cc:654] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.302363 26126 leader_election.cc:304] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:33.303565 26306 raft_consensus.cc:2804] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.304206 26306 raft_consensus.cc:697] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:33.305296 26306 consensus_queue.cc:237] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.306991 26279 tablet_bootstrap.cc:654] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.318749 26279 tablet_bootstrap.cc:492] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:33.319306 26279 ts_tablet_manager.cc:1403] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 13:09:33.296829 26086 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.322264 26279 raft_consensus.cc:359] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.323011 26279 raft_consensus.cc:385] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.323282 26279 raft_consensus.cc:740] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.324050 26279 consensus_queue.cc:260] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.318184 25984 catalog_manager.cc:5697] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.328316 26277 tablet_bootstrap.cc:492] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:33.328909 26277 ts_tablet_manager.cc:1403] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.006s
I20260709 13:09:33.332155 26277 raft_consensus.cc:359] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.332876 26277 raft_consensus.cc:385] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.333159 26277 raft_consensus.cc:740] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.333425 26279 ts_tablet_manager.cc:1434] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:09:33.334489 26279 tablet_bootstrap.cc:492] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:33.335687 26086 raft_consensus.cc:2468] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.336719 26277 consensus_queue.cc:260] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.339241 26277 ts_tablet_manager.cc:1434] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:33.340288 26277 tablet_bootstrap.cc:492] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:33.342236 26279 tablet_bootstrap.cc:654] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.345657 26275 tablet_bootstrap.cc:492] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:33.346249 26275 ts_tablet_manager.cc:1403] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.012s
I20260709 13:09:33.349658 26277 tablet_bootstrap.cc:654] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.350260 26275 raft_consensus.cc:359] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.351225 26275 raft_consensus.cc:385] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.351599 26275 raft_consensus.cc:740] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.352542 26275 consensus_queue.cc:260] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.359763 26275 ts_tablet_manager.cc:1434] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.005s
I20260709 13:09:33.361183 26275 tablet_bootstrap.cc:492] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:33.365622 25984 catalog_manager.cc:5697] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.369796 26275 tablet_bootstrap.cc:654] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.380863 26277 tablet_bootstrap.cc:492] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:33.381286 26275 tablet_bootstrap.cc:492] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:33.381307 26279 tablet_bootstrap.cc:492] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:33.381819 26277 ts_tablet_manager.cc:1403] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.009s
I20260709 13:09:33.382022 26275 ts_tablet_manager.cc:1403] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:09:33.382112 26279 ts_tablet_manager.cc:1403] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.017s
I20260709 13:09:33.385277 26277 raft_consensus.cc:359] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.385521 26279 raft_consensus.cc:359] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.386183 26277 raft_consensus.cc:385] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.386200 26279 raft_consensus.cc:385] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.386003 26275 raft_consensus.cc:359] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.386822 26279 raft_consensus.cc:740] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.386950 26275 raft_consensus.cc:385] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.386864 26277 raft_consensus.cc:740] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.387589 26275 raft_consensus.cc:740] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.388025 26279 consensus_queue.cc:260] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.388441 26275 consensus_queue.cc:260] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.390657 26279 ts_tablet_manager.cc:1434] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:33.391019 26275 ts_tablet_manager.cc:1434] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:33.388437 26277 consensus_queue.cc:260] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.392198 26275 tablet_bootstrap.cc:492] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:33.399690 26275 tablet_bootstrap.cc:654] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.402047 26277 ts_tablet_manager.cc:1434] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:33.403285 26277 tablet_bootstrap.cc:492] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:33.409875 26275 tablet_bootstrap.cc:492] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:33.410578 26275 ts_tablet_manager.cc:1403] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.001s
I20260709 13:09:33.411116 26277 tablet_bootstrap.cc:654] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.412917 26275 raft_consensus.cc:359] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.413487 26275 raft_consensus.cc:385] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.413741 26275 raft_consensus.cc:740] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.414366 26275 consensus_queue.cc:260] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.416030 26277 tablet_bootstrap.cc:492] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:33.416201 26275 ts_tablet_manager.cc:1434] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:33.416458 26277 ts_tablet_manager.cc:1403] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 13:09:33.417469 26275 tablet_bootstrap.cc:492] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:33.419286 26277 raft_consensus.cc:359] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.420038 26277 raft_consensus.cc:385] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.420321 26277 raft_consensus.cc:740] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.421167 26277 consensus_queue.cc:260] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.422781 26306 raft_consensus.cc:493] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.423318 26275 tablet_bootstrap.cc:654] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.423606 26277 ts_tablet_manager.cc:1434] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:33.423333 26306 raft_consensus.cc:515] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.426728 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e81f92fda44698906a47c3de450d01" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:33.427140 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e81f92fda44698906a47c3de450d01" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.427444 26086 raft_consensus.cc:2468] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.427839 26235 raft_consensus.cc:2468] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.428974 26127 leader_election.cc:304] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.429347 26306 leader_election.cc:290] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.429891 26304 raft_consensus.cc:2804] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.430290 26304 raft_consensus.cc:493] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.430716 26304 raft_consensus.cc:3060] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.437696 26275 tablet_bootstrap.cc:492] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:33.438369 26275 ts_tablet_manager.cc:1403] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:09:33.440847 26304 raft_consensus.cc:515] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.441535 26275 raft_consensus.cc:359] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.442307 26275 raft_consensus.cc:385] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.442574 26275 raft_consensus.cc:740] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.443332 26275 consensus_queue.cc:260] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.444334 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e81f92fda44698906a47c3de450d01" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:33.444545 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e81f92fda44698906a47c3de450d01" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.445024 26086 raft_consensus.cc:3060] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.445084 26235 raft_consensus.cc:3060] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.445713 26275 ts_tablet_manager.cc:1434] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:33.443357 26304 leader_election.cc:290] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.452692 26086 raft_consensus.cc:2468] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.453198 26235 raft_consensus.cc:2468] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.454406 26127 leader_election.cc:304] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.455250 26304 raft_consensus.cc:2804] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.455781 26304 raft_consensus.cc:697] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:33.456563 26304 consensus_queue.cc:237] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.465306 25983 catalog_manager.cc:5697] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.528669 26304 raft_consensus.cc:493] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.529348 26304 raft_consensus.cc:515] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.531236 26304 leader_election.cc:290] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.532250 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aecf57a23cb46209619dea0ea937271" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:33.532363 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aecf57a23cb46209619dea0ea937271" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.532955 26086 raft_consensus.cc:2468] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.533052 26235 raft_consensus.cc:2468] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.534186 26127 leader_election.cc:304] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.535014 26304 raft_consensus.cc:2804] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.535351 26304 raft_consensus.cc:493] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.535652 26304 raft_consensus.cc:3060] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.541785 26304 raft_consensus.cc:515] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.543594 26304 leader_election.cc:290] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.544690 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aecf57a23cb46209619dea0ea937271" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.544672 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aecf57a23cb46209619dea0ea937271" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:33.545634 26235 raft_consensus.cc:3060] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.545734 26086 raft_consensus.cc:3060] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.551357 26235 raft_consensus.cc:2468] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.551359 26086 raft_consensus.cc:2468] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.552690 26127 leader_election.cc:304] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.553474 26304 raft_consensus.cc:2804] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.554059 26304 raft_consensus.cc:697] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:33.555050 26304 consensus_queue.cc:237] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.563853 25983 catalog_manager.cc:5697] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.602113 26280 consensus_queue.cc:1048] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.622334 26280 consensus_queue.cc:1048] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.627617 26304 raft_consensus.cc:493] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.628263 26304 raft_consensus.cc:515] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.631489 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40deffc154474fcb83c0238539dec4aa" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:33.631484 26304 leader_election.cc:290] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.631664 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40deffc154474fcb83c0238539dec4aa" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.632313 26086 raft_consensus.cc:2468] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.632725 26235 raft_consensus.cc:2468] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:33.633512 26127 leader_election.cc:304] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.634359 26304 raft_consensus.cc:2804] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.634884 26304 raft_consensus.cc:493] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.635181 26304 raft_consensus.cc:3060] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.636368 26285 raft_consensus.cc:493] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.636943 26285 raft_consensus.cc:515] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.639724 26285 leader_election.cc:290] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:33.644189 26280 raft_consensus.cc:493] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.645135 26280 raft_consensus.cc:515] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.661549 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:33.661849 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.662592 26160 raft_consensus.cc:2468] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:33.662828 26235 raft_consensus.cc:2468] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:33.664111 26050 leader_election.cc:304] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.664726 26280 leader_election.cc:290] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.665141 26297 raft_consensus.cc:2804] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.665627 26297 raft_consensus.cc:493] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.665975 26297 raft_consensus.cc:3060] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.668476 26304 raft_consensus.cc:515] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.672098 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40deffc154474fcb83c0238539dec4aa" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:33.672788 26086 raft_consensus.cc:3060] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.675956 26297 raft_consensus.cc:515] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.676664 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40deffc154474fcb83c0238539dec4aa" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.677449 26235 raft_consensus.cc:3060] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.679319 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:33.680037 26160 raft_consensus.cc:3060] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.681375 26086 raft_consensus.cc:2468] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.683000 26127 leader_election.cc:304] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.683701 26304 leader_election.cc:290] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.683902 26306 raft_consensus.cc:2804] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.684567 26306 raft_consensus.cc:697] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:33.685518 26306 consensus_queue.cc:237] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.686525 26235 raft_consensus.cc:2468] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:33.688755 26160 raft_consensus.cc:2468] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:33.690300 26050 leader_election.cc:304] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.691411 26280 raft_consensus.cc:2804] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.692787 26297 leader_election.cc:290] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.691183 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.694196 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:33.694759 26235 raft_consensus.cc:3060] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.697636 26280 raft_consensus.cc:697] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:33.697054 25982 catalog_manager.cc:5697] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.698637 26280 consensus_queue.cc:237] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.704860 26235 raft_consensus.cc:2468] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:33.707410 26337 raft_consensus.cc:493] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.707967 26337 raft_consensus.cc:515] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.709674 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:33.710657 26160 raft_consensus.cc:2393] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eabde53de26b4615bb9e2eebc36d78e9 in current term 1: Already voted for candidate e54cde55a7eb4cafaa86877bae1f1f4b in this term.
I20260709 13:09:33.712314 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51974e2c8c34be5baf208e164d85548" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:33.712509 26337 leader_election.cc:290] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.713135 26160 raft_consensus.cc:2468] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:33.714411 26201 leader_election.cc:304] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eabde53de26b4615bb9e2eebc36d78e9; no voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:33.714357 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51974e2c8c34be5baf208e164d85548" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:33.715184 26050 leader_election.cc:304] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:33.715646 26235 raft_consensus.cc:2468] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:33.715857 26285 raft_consensus.cc:2749] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.716272 26337 raft_consensus.cc:2804] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.716784 26337 raft_consensus.cc:493] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.717192 26337 raft_consensus.cc:3060] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.719321 25982 catalog_manager.cc:5697] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 1 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.723726 26337 raft_consensus.cc:515] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.726444 26337 leader_election.cc:290] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:33.726960 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51974e2c8c34be5baf208e164d85548" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:33.727221 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51974e2c8c34be5baf208e164d85548" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:33.727711 26160 raft_consensus.cc:3060] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.727875 26235 raft_consensus.cc:3060] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.734206 26235 raft_consensus.cc:2468] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:33.734454 26160 raft_consensus.cc:2468] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:33.735435 26051 leader_election.cc:304] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:33.736296 26337 raft_consensus.cc:2804] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.736764 26337 raft_consensus.cc:697] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:33.737747 26337 consensus_queue.cc:237] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:33.746064 25982 catalog_manager.cc:5697] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 1 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.755396 26306 consensus_queue.cc:1048] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.769522 26341 consensus_queue.cc:1048] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.792779 26341 consensus_queue.cc:1048] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.805328 26304 consensus_queue.cc:1048] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.835805 26304 consensus_queue.cc:1048] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.847730 26341 consensus_queue.cc:1048] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.876823 26160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94f7609a5a854e47968736437c22b439"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
mode: GRACEFUL
new_leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:57612
I20260709 13:09:33.877429 26160 raft_consensus.cc:606] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Received request to transfer leadership to TS e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:33.887321 26160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
mode: GRACEFUL
new_leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:57612
I20260709 13:09:33.887967 26160 raft_consensus.cc:606] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Received request to transfer leadership to TS e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:33.894357 26160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "452a78d7dcc5496e9ea65721e4e06717"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
mode: GRACEFUL
new_leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:57612
I20260709 13:09:33.895007 26160 raft_consensus.cc:606] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Received request to transfer leadership to TS e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:33.916327 26086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
mode: GRACEFUL
new_leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:52234
I20260709 13:09:33.916951 26086 raft_consensus.cc:606] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Received request to transfer leadership to TS c716eacc10c54db9b4c6ba82c8a81ee9
I20260709 13:09:33.926059 26086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e51974e2c8c34be5baf208e164d85548"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
mode: GRACEFUL
new_leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
 from {username='slave'} at 127.0.0.1:52234
I20260709 13:09:33.926712 26086 raft_consensus.cc:606] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Received request to transfer leadership to TS eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:33.938516 26341 consensus_queue.cc:1048] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.949297 26304 consensus_queue.cc:1048] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.088668 26337 consensus_queue.cc:1048] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.095950 26280 raft_consensus.cc:993] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b: : Instructing follower c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:34.096562 26297 raft_consensus.cc:1081] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Signalling peer c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:34.099900 26160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:57598
I20260709 13:09:34.100589 26160 raft_consensus.cc:493] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.101032 26160 raft_consensus.cc:3060] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.103305 26280 consensus_queue.cc:1048] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.109592 26160 raft_consensus.cc:515] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.112764 26160 leader_election.cc:290] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:34.114305 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:34.115016 26235 raft_consensus.cc:3060] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.115459 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b9c70995461ba3cb7d1fe30eb930" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:34.116184 26086 raft_consensus.cc:3055] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.116523 26086 raft_consensus.cc:740] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:34.117358 26086 consensus_queue.cc:260] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.118842 26086 raft_consensus.cc:3060] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.123015 26235 raft_consensus.cc:2468] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:34.124701 26126 leader_election.cc:304] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:34.125691 26304 raft_consensus.cc:2804] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.126272 26304 raft_consensus.cc:697] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:34.127220 26304 consensus_queue.cc:237] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.128180 26086 raft_consensus.cc:2468] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:34.130015 26341 consensus_queue.cc:1048] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.136102 25983 catalog_manager.cc:5697] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 1 to 2, leader changed from e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65) to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.142163 26306 consensus_queue.cc:1048] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.193332 26280 consensus_queue.cc:1048] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.201046 26297 raft_consensus.cc:993] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b: : Instructing follower eabde53de26b4615bb9e2eebc36d78e9 to start an election
I20260709 13:09:34.201645 26337 raft_consensus.cc:1081] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Signalling peer eabde53de26b4615bb9e2eebc36d78e9 to start an election
I20260709 13:09:34.203841 26234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e51974e2c8c34be5baf208e164d85548"
dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
 from {username='slave'} at 127.0.0.1:37704
I20260709 13:09:34.205775 26234 raft_consensus.cc:493] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.206234 26234 raft_consensus.cc:3060] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.207707 26337 consensus_queue.cc:1048] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.212244 26304 consensus_queue.cc:1048] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.216537 26234 raft_consensus.cc:515] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.225337 26234 leader_election.cc:290] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 2 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:34.227407 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51974e2c8c34be5baf208e164d85548" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:34.228237 26086 raft_consensus.cc:3055] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.228663 26086 raft_consensus.cc:740] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:34.230746 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51974e2c8c34be5baf208e164d85548" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:34.231472 26160 raft_consensus.cc:3060] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.229492 26086 consensus_queue.cc:260] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.233855 26086 raft_consensus.cc:3060] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.234771 26304 consensus_queue.cc:1048] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.240109 26160 raft_consensus.cc:2468] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 2.
I20260709 13:09:34.243990 26199 leader_election.cc:304] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:34.249611 26285 raft_consensus.cc:2804] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.249851 26086 raft_consensus.cc:2468] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 2.
I20260709 13:09:34.256927 26341 raft_consensus.cc:993] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9: : Instructing follower e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:34.257625 26341 raft_consensus.cc:1081] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Signalling peer e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:34.260185 26085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:52210
I20260709 13:09:34.261188 26085 raft_consensus.cc:493] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.262738 26085 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.267416 26285 raft_consensus.cc:697] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 LEADER]: Becoming Leader. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:34.268586 26285 consensus_queue.cc:237] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.269079 26341 raft_consensus.cc:993] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9: : Instructing follower e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:34.269672 26341 raft_consensus.cc:1081] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Signalling peer e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:34.271813 26086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "452a78d7dcc5496e9ea65721e4e06717"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:52210
I20260709 13:09:34.272460 26086 raft_consensus.cc:493] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.272900 26086 raft_consensus.cc:3060] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.272940 26085 raft_consensus.cc:515] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.275450 26085 leader_election.cc:290] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:34.276168 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:34.276623 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:34.276942 26160 raft_consensus.cc:3055] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.277266 26233 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.277300 26160 raft_consensus.cc:740] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:34.278327 26160 consensus_queue.cc:260] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.279589 26160 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.279726 25983 catalog_manager.cc:5697] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 reported cstate change: term changed from 1 to 2, leader changed from e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65) to eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.282413 26086 raft_consensus.cc:515] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.285792 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452a78d7dcc5496e9ea65721e4e06717" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:34.286079 26233 raft_consensus.cc:2468] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:34.286438 26161 raft_consensus.cc:3055] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.286849 26161 raft_consensus.cc:740] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:34.287397 26160 raft_consensus.cc:2468] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:34.287787 26161 consensus_queue.cc:260] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.288416 26051 leader_election.cc:304] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:34.289064 26161 raft_consensus.cc:3060] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.289328 26337 raft_consensus.cc:2804] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.289861 26337 raft_consensus.cc:697] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:34.290751 26337 consensus_queue.cc:237] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.293860 26086 leader_election.cc:290] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:34.295583 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452a78d7dcc5496e9ea65721e4e06717" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:34.296223 26233 raft_consensus.cc:3060] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.299348 26161 raft_consensus.cc:2468] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:34.299260 25983 catalog_manager.cc:5697] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 1 to 2, leader changed from c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66) to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.300678 26050 leader_election.cc:304] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:34.301548 26337 raft_consensus.cc:2804] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.302309 26337 raft_consensus.cc:697] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:34.303184 26337 consensus_queue.cc:237] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:34.304365 26233 raft_consensus.cc:2468] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:34.313490 25983 catalog_manager.cc:5697] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 1 to 2, leader changed from c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66) to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.386545 26282 raft_consensus.cc:993] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9: : Instructing follower e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:34.387157 26304 raft_consensus.cc:1081] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Signalling peer e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:34.388883 26086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94f7609a5a854e47968736437c22b439"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:52210
I20260709 13:09:34.389477 26086 raft_consensus.cc:493] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.389873 26086 raft_consensus.cc:3060] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.396101 26086 raft_consensus.cc:515] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:34.397993 26086 leader_election.cc:290] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:34.399165 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f7609a5a854e47968736437c22b439" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:34.399319 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f7609a5a854e47968736437c22b439" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:34.400020 26161 raft_consensus.cc:3055] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.400065 26233 raft_consensus.cc:3060] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.400424 26161 raft_consensus.cc:740] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:34.401460 26161 consensus_queue.cc:260] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:34.402686 26161 raft_consensus.cc:3060] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.408020 26233 raft_consensus.cc:2468] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:34.409508 26051 leader_election.cc:304] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:34.409619 26161 raft_consensus.cc:2468] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:34.410394 26337 raft_consensus.cc:2804] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.410923 26337 raft_consensus.cc:697] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:34.411787 26337 consensus_queue.cc:237] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } }
I20260709 13:09:34.418948 25983 catalog_manager.cc:5697] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 1 to 2, leader changed from c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66) to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.594380 26086 raft_consensus.cc:1275] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.595830 26304 consensus_queue.cc:1048] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.604450 26233 raft_consensus.cc:1275] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.606307 26304 consensus_queue.cc:1048] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.716938 26161 raft_consensus.cc:1275] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.718453 26337 consensus_queue.cc:1048] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.726524 26233 raft_consensus.cc:1275] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.728551 26297 consensus_queue.cc:1048] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.791620 26161 raft_consensus.cc:1275] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.793267 26297 consensus_queue.cc:1048] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.804455 26233 raft_consensus.cc:1275] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.806046 26360 consensus_queue.cc:1048] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.841751 26086 raft_consensus.cc:1275] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Refusing update from remote peer eabde53de26b4615bb9e2eebc36d78e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.843204 26285 consensus_queue.cc:1048] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.848780 26161 raft_consensus.cc:1275] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer eabde53de26b4615bb9e2eebc36d78e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.850980 26362 consensus_queue.cc:1048] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.864943 26161 raft_consensus.cc:1275] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.866266 26360 consensus_queue.cc:1048] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.875870 26233 raft_consensus.cc:1275] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.878159 26297 consensus_queue.cc:1048] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.956336 25983 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38182:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:36.958878 25983 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:37.017452 26076 tablet_service.cc:1511] Processing CreateTablet for tablet 73501c4aa4f949b9b5e32ae31d1272fa (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:37.018541 26149 tablet_service.cc:1511] Processing CreateTablet for tablet 73501c4aa4f949b9b5e32ae31d1272fa (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:37.018967 26076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73501c4aa4f949b9b5e32ae31d1272fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.019439 26223 tablet_service.cc:1511] Processing CreateTablet for tablet 73501c4aa4f949b9b5e32ae31d1272fa (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:37.019969 26149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73501c4aa4f949b9b5e32ae31d1272fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.020774 26223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73501c4aa4f949b9b5e32ae31d1272fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.024287 26151 tablet_service.cc:1511] Processing CreateTablet for tablet 146032353ea94e93b465e6643bd50d55 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:37.025717 26151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146032353ea94e93b465e6643bd50d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.025456 26224 tablet_service.cc:1511] Processing CreateTablet for tablet 146032353ea94e93b465e6643bd50d55 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:37.026916 26224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146032353ea94e93b465e6643bd50d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.028509 26075 tablet_service.cc:1511] Processing CreateTablet for tablet b1480893a51f4292b7091d9523110a63 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:37.029867 26075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1480893a51f4292b7091d9523110a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.029784 26074 tablet_service.cc:1511] Processing CreateTablet for tablet 146032353ea94e93b465e6643bd50d55 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:37.031231 26074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146032353ea94e93b465e6643bd50d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.032579 26222 tablet_service.cc:1511] Processing CreateTablet for tablet b1480893a51f4292b7091d9523110a63 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:37.033903 26222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1480893a51f4292b7091d9523110a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.037107 26073 tablet_service.cc:1511] Processing CreateTablet for tablet bef79c5a1ca34a8aa18ee0ee2c124439 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:37.038465 26225 tablet_service.cc:1511] Processing CreateTablet for tablet bef79c5a1ca34a8aa18ee0ee2c124439 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:37.039774 26225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef79c5a1ca34a8aa18ee0ee2c124439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.041320 26072 tablet_service.cc:1511] Processing CreateTablet for tablet 02c9cce115c14133a018cc3b3832af36 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:37.042583 26072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c9cce115c14133a018cc3b3832af36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.043995 26148 tablet_service.cc:1511] Processing CreateTablet for tablet b1480893a51f4292b7091d9523110a63 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:37.044147 26150 tablet_service.cc:1511] Processing CreateTablet for tablet bef79c5a1ca34a8aa18ee0ee2c124439 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:37.045363 26148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1480893a51f4292b7091d9523110a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.045668 26073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef79c5a1ca34a8aa18ee0ee2c124439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.048646 26147 tablet_service.cc:1511] Processing CreateTablet for tablet 02c9cce115c14133a018cc3b3832af36 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:37.050652 26221 tablet_service.cc:1511] Processing CreateTablet for tablet 02c9cce115c14133a018cc3b3832af36 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:37.052093 26221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c9cce115c14133a018cc3b3832af36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.053545 26071 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0da2f44e7c4d39970be7e159175ea8 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:37.055001 26071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0da2f44e7c4d39970be7e159175ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.055454 26069 tablet_service.cc:1511] Processing CreateTablet for tablet 58bbe4baffef485b8f0551607454cd2e (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:37.057034 26069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bbe4baffef485b8f0551607454cd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.056730 26220 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0da2f44e7c4d39970be7e159175ea8 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:37.056865 26146 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0da2f44e7c4d39970be7e159175ea8 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:37.058140 26220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0da2f44e7c4d39970be7e159175ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.053545 26070 tablet_service.cc:1511] Processing CreateTablet for tablet ce6a9d5ac83245179f7c36ac3cfad8d3 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:37.060997 26070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6a9d5ac83245179f7c36ac3cfad8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.060648 26219 tablet_service.cc:1511] Processing CreateTablet for tablet ce6a9d5ac83245179f7c36ac3cfad8d3 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:37.061448 26068 tablet_service.cc:1511] Processing CreateTablet for tablet 73ceeb99171c494190acf7649429e74f (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:37.062083 26219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6a9d5ac83245179f7c36ac3cfad8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.062829 26068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ceeb99171c494190acf7649429e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.063691 26218 tablet_service.cc:1511] Processing CreateTablet for tablet 58bbe4baffef485b8f0551607454cd2e (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:37.065075 26218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bbe4baffef485b8f0551607454cd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.064757 26217 tablet_service.cc:1511] Processing CreateTablet for tablet 73ceeb99171c494190acf7649429e74f (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:37.066109 26217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ceeb99171c494190acf7649429e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.067081 26147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c9cce115c14133a018cc3b3832af36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.059060 26145 tablet_service.cc:1511] Processing CreateTablet for tablet ce6a9d5ac83245179f7c36ac3cfad8d3 (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:37.068830 26145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6a9d5ac83245179f7c36ac3cfad8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.069540 26146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0da2f44e7c4d39970be7e159175ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.072134 26150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef79c5a1ca34a8aa18ee0ee2c124439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.073596 26144 tablet_service.cc:1511] Processing CreateTablet for tablet 58bbe4baffef485b8f0551607454cd2e (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:37.075004 26144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bbe4baffef485b8f0551607454cd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.077447 26143 tablet_service.cc:1511] Processing CreateTablet for tablet 73ceeb99171c494190acf7649429e74f (DEFAULT_TABLE table=soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:37.078881 26143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ceeb99171c494190acf7649429e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.220568 26376 tablet_bootstrap.cc:492] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.238662 26376 tablet_bootstrap.cc:654] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.247258 26379 tablet_bootstrap.cc:492] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.248417 26378 tablet_bootstrap.cc:492] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.260977 26379 tablet_bootstrap.cc:654] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.262753 26378 tablet_bootstrap.cc:654] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.263182 26376 tablet_bootstrap.cc:492] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.263891 26376 ts_tablet_manager.cc:1403] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.015s
I20260709 13:09:37.267848 26379 tablet_bootstrap.cc:492] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.267668 26376 raft_consensus.cc:359] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.268492 26376 raft_consensus.cc:385] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.268491 26379 ts_tablet_manager.cc:1403] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.002s
I20260709 13:09:37.268959 26376 raft_consensus.cc:740] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.269220 26378 tablet_bootstrap.cc:492] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.269940 26378 ts_tablet_manager.cc:1403] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 13:09:37.270063 26376 consensus_queue.cc:260] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.272173 26379 raft_consensus.cc:359] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.272740 26376 ts_tablet_manager.cc:1434] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:09:37.273001 26379 raft_consensus.cc:385] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.273281 26379 raft_consensus.cc:740] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.273620 26378 raft_consensus.cc:359] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.273964 26379 consensus_queue.cc:260] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.274478 26376 tablet_bootstrap.cc:492] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.274703 26378 raft_consensus.cc:385] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.275141 26378 raft_consensus.cc:740] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.275969 26378 consensus_queue.cc:260] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.278904 26378 ts_tablet_manager.cc:1434] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:09:37.280087 26378 tablet_bootstrap.cc:492] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.283728 26379 ts_tablet_manager.cc:1434] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:09:37.285055 26379 tablet_bootstrap.cc:492] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.296311 26378 tablet_bootstrap.cc:654] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.296653 26376 tablet_bootstrap.cc:654] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.321609 26379 tablet_bootstrap.cc:654] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.325030 26378 tablet_bootstrap.cc:492] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.325609 26378 ts_tablet_manager.cc:1403] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.011s
I20260709 13:09:37.326064 26376 tablet_bootstrap.cc:492] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.326977 26376 ts_tablet_manager.cc:1403] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.016s
I20260709 13:09:37.328696 26378 raft_consensus.cc:359] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.329396 26378 raft_consensus.cc:385] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.329428 26379 tablet_bootstrap.cc:492] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.329708 26378 raft_consensus.cc:740] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.330158 26379 ts_tablet_manager.cc:1403] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.006s
I20260709 13:09:37.330582 26378 consensus_queue.cc:260] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.330706 26376 raft_consensus.cc:359] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.331681 26376 raft_consensus.cc:385] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.332020 26376 raft_consensus.cc:740] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.332965 26378 ts_tablet_manager.cc:1434] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:09:37.332896 26376 consensus_queue.cc:260] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.334040 26378 tablet_bootstrap.cc:492] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.334067 26379 raft_consensus.cc:359] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.335215 26379 raft_consensus.cc:385] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.335848 26376 ts_tablet_manager.cc:1434] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:09:37.338197 26376 tablet_bootstrap.cc:492] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.335597 26379 raft_consensus.cc:740] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.343521 26378 tablet_bootstrap.cc:654] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.346911 26376 tablet_bootstrap.cc:654] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.354884 26379 consensus_queue.cc:260] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.356598 26378 tablet_bootstrap.cc:492] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.357323 26378 ts_tablet_manager.cc:1403] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:09:37.359395 26379 ts_tablet_manager.cc:1434] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 13:09:37.360225 26376 tablet_bootstrap.cc:492] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.360838 26376 ts_tablet_manager.cc:1403] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.002s
I20260709 13:09:37.360875 26379 tablet_bootstrap.cc:492] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.360728 26378 raft_consensus.cc:359] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.361748 26378 raft_consensus.cc:385] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.362083 26378 raft_consensus.cc:740] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.362938 26378 consensus_queue.cc:260] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.365823 26378 ts_tablet_manager.cc:1434] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:09:37.365445 26376 raft_consensus.cc:359] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.366664 26376 raft_consensus.cc:385] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.367126 26378 tablet_bootstrap.cc:492] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.368536 26376 raft_consensus.cc:740] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.369519 26376 consensus_queue.cc:260] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.372164 26376 ts_tablet_manager.cc:1434] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:37.373281 26376 tablet_bootstrap.cc:492] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.375589 26378 tablet_bootstrap.cc:654] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.380892 26376 tablet_bootstrap.cc:654] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.383425 26379 tablet_bootstrap.cc:654] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.394227 26379 tablet_bootstrap.cc:492] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.394585 26376 tablet_bootstrap.cc:492] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.394846 26379 ts_tablet_manager.cc:1403] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
I20260709 13:09:37.395224 26376 ts_tablet_manager.cc:1403] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:09:37.398511 26379 raft_consensus.cc:359] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.399441 26379 raft_consensus.cc:385] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.399786 26379 raft_consensus.cc:740] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.399863 26376 raft_consensus.cc:359] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.400915 26376 raft_consensus.cc:385] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.400610 26379 consensus_queue.cc:260] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.401214 26376 raft_consensus.cc:740] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.402151 26376 consensus_queue.cc:260] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.404980 26376 ts_tablet_manager.cc:1434] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:37.406267 26376 tablet_bootstrap.cc:492] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.406829 26379 ts_tablet_manager.cc:1434] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:09:37.408190 26379 tablet_bootstrap.cc:492] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.414749 26376 tablet_bootstrap.cc:654] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.416525 26379 tablet_bootstrap.cc:654] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.421131 26285 raft_consensus.cc:493] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.421801 26285 raft_consensus.cc:515] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.426277 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceeb99171c494190acf7649429e74f" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
W20260709 13:09:37.428289 26201 leader_election.cc:343] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.434059 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceeb99171c494190acf7649429e74f" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:37.435812 26285 leader_election.cc:290] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
W20260709 13:09:37.439406 26199 leader_election.cc:343] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.440095 26199 leader_election.cc:304] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eabde53de26b4615bb9e2eebc36d78e9; no voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:37.441169 26285 raft_consensus.cc:2749] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.448520 26379 tablet_bootstrap.cc:492] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.449219 26379 ts_tablet_manager.cc:1403] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.003s
I20260709 13:09:37.452309 26376 tablet_bootstrap.cc:492] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.452080 26379 raft_consensus.cc:359] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.452941 26379 raft_consensus.cc:385] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.453174 26376 ts_tablet_manager.cc:1403] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.024s
I20260709 13:09:37.453290 26379 raft_consensus.cc:740] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.454465 26379 consensus_queue.cc:260] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.457139 26379 ts_tablet_manager.cc:1434] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:37.457641 26376 raft_consensus.cc:359] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.458346 26379 tablet_bootstrap.cc:492] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.458527 26376 raft_consensus.cc:385] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.459002 26376 raft_consensus.cc:740] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.460153 26376 consensus_queue.cc:260] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.463444 26376 ts_tablet_manager.cc:1434] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:37.464864 26376 tablet_bootstrap.cc:492] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.467051 26379 tablet_bootstrap.cc:654] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.473848 26376 tablet_bootstrap.cc:654] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.485759 26379 tablet_bootstrap.cc:492] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.486691 26379 ts_tablet_manager.cc:1403] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 13:09:37.491652 26379 raft_consensus.cc:359] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.492877 26379 raft_consensus.cc:385] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.493314 26379 raft_consensus.cc:740] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.494304 26379 consensus_queue.cc:260] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.496199 26285 raft_consensus.cc:493] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.497071 26285 raft_consensus.cc:515] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.498067 26379 ts_tablet_manager.cc:1434] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.003s
I20260709 13:09:37.500379 26379 tablet_bootstrap.cc:492] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.500710 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:37.502156 26285 leader_election.cc:290] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
W20260709 13:09:37.504320 26201 leader_election.cc:343] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.510454 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:37.511641 26379 tablet_bootstrap.cc:654] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:37.514246 26199 leader_election.cc:343] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.515300 26199 leader_election.cc:304] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eabde53de26b4615bb9e2eebc36d78e9; no voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:37.525465 26395 raft_consensus.cc:2749] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.526728 26379 tablet_bootstrap.cc:492] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.527607 26379 ts_tablet_manager.cc:1403] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.011s
I20260709 13:09:37.531508 26378 tablet_bootstrap.cc:492] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.531412 26379 raft_consensus.cc:359] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.532017 26376 tablet_bootstrap.cc:492] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.532178 26378 ts_tablet_manager.cc:1403] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.165s	user 0.035s	sys 0.101s
I20260709 13:09:37.532229 26379 raft_consensus.cc:385] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.532869 26376 ts_tablet_manager.cc:1403] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.038s
I20260709 13:09:37.532824 26379 raft_consensus.cc:740] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.533913 26379 consensus_queue.cc:260] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.534345 26285 raft_consensus.cc:493] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.535118 26285 raft_consensus.cc:515] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.536630 26379 ts_tablet_manager.cc:1434] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:37.537266 26376 raft_consensus.cc:359] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.537772 26379 tablet_bootstrap.cc:492] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.538098 26376 raft_consensus.cc:385] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.538478 26376 raft_consensus.cc:740] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.535892 26378 raft_consensus.cc:359] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.539346 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c9cce115c14133a018cc3b3832af36" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:37.540401 26085 raft_consensus.cc:2468] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 0.
I20260709 13:09:37.540603 26285 leader_election.cc:290] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:37.541249 26378 raft_consensus.cc:385] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.541389 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c9cce115c14133a018cc3b3832af36" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:37.539352 26376 consensus_queue.cc:260] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.542374 26201 leader_election.cc:304] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
W20260709 13:09:37.543200 26199 leader_election.cc:343] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.543826 26395 raft_consensus.cc:2804] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.544080 26376 ts_tablet_manager.cc:1434] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:09:37.544302 26395 raft_consensus.cc:493] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.544602 26395 raft_consensus.cc:3060] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.545331 26376 tablet_bootstrap.cc:492] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.545816 26379 tablet_bootstrap.cc:654] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.541635 26378 raft_consensus.cc:740] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.548527 26378 consensus_queue.cc:260] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.550823 26378 ts_tablet_manager.cc:1434] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:37.552022 26378 tablet_bootstrap.cc:492] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.553689 26376 tablet_bootstrap.cc:654] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.564950 26378 tablet_bootstrap.cc:654] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.578164 26377 raft_consensus.cc:493] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.579128 26377 raft_consensus.cc:515] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.582885 26377 leader_election.cc:290] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.583729 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1480893a51f4292b7091d9523110a63" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:37.584514 26085 raft_consensus.cc:2468] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:37.585690 26234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1480893a51f4292b7091d9523110a63" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:37.587877 26127 leader_election.cc:304] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
W20260709 13:09:37.588949 26126 leader_election.cc:343] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.590147 26377 raft_consensus.cc:2804] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.590710 26377 raft_consensus.cc:493] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.591144 26377 raft_consensus.cc:3060] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.590168 26395 raft_consensus.cc:515] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.607640 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c9cce115c14133a018cc3b3832af36" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:37.608340 26086 raft_consensus.cc:3060] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.629787 26297 raft_consensus.cc:493] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.638628 26395 leader_election.cc:290] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:37.638710 26285 raft_consensus.cc:493] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.639644 26086 raft_consensus.cc:2468] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 1.
I20260709 13:09:37.639678 26285 raft_consensus.cc:515] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.641176 26201 leader_election.cc:304] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.641471 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c9cce115c14133a018cc3b3832af36" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:37.642091 26395 raft_consensus.cc:2804] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:37.644806 26199 leader_election.cc:343] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.645483 26395 raft_consensus.cc:697] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Becoming Leader. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:37.645301 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bbe4baffef485b8f0551607454cd2e" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:37.645964 26285 leader_election.cc:290] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:37.646246 26160 raft_consensus.cc:2468] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 0.
I20260709 13:09:37.646816 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bbe4baffef485b8f0551607454cd2e" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:37.630798 26297 raft_consensus.cc:515] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.647399 26379 tablet_bootstrap.cc:492] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.647562 26086 raft_consensus.cc:2468] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 0.
I20260709 13:09:37.648295 26379 ts_tablet_manager.cc:1403] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.111s	user 0.059s	sys 0.032s
I20260709 13:09:37.647601 26199 leader_election.cc:304] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.649714 26285 raft_consensus.cc:2804] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.650206 26285 raft_consensus.cc:493] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.650588 26285 raft_consensus.cc:3060] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.652194 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:37.652637 26379 raft_consensus.cc:359] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.652715 26395 consensus_queue.cc:237] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.653677 26379 raft_consensus.cc:385] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.654073 26379 raft_consensus.cc:740] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.654923 26379 consensus_queue.cc:260] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
W20260709 13:09:37.654896 26050 leader_election.cc:343] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.657531 26376 tablet_bootstrap.cc:492] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.658093 26376 ts_tablet_manager.cc:1403] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.113s	user 0.031s	sys 0.059s
I20260709 13:09:37.660843 26234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
W20260709 13:09:37.663815 26051 leader_election.cc:343] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.664494 26051 leader_election.cc:304] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b; no voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:37.663800 26376 raft_consensus.cc:359] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.665928 26376 raft_consensus.cc:385] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.666352 26376 raft_consensus.cc:740] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.667044 26297 leader_election.cc:290] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.667428 26376 consensus_queue.cc:260] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.668836 26285 raft_consensus.cc:515] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.670069 26376 ts_tablet_manager.cc:1434] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:09:37.672959 26376 tablet_bootstrap.cc:492] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.677654 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bbe4baffef485b8f0551607454cd2e" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:37.678442 26160 raft_consensus.cc:3060] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.679605 26376 tablet_bootstrap.cc:654] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.685709 26297 raft_consensus.cc:493] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.686489 26285 leader_election.cc:290] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:37.687389 26297 raft_consensus.cc:515] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.691443 26376 tablet_bootstrap.cc:492] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.692970 26376 ts_tablet_manager.cc:1403] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.020s	user 0.000s	sys 0.018s
I20260709 13:09:37.696461 26376 raft_consensus.cc:359] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.697295 26376 raft_consensus.cc:385] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.697577 26376 raft_consensus.cc:740] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.697958 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6a9d5ac83245179f7c36ac3cfad8d3" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:37.698415 26376 consensus_queue.cc:260] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.699263 26404 raft_consensus.cc:2749] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:37.700055 26050 leader_election.cc:343] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.702472 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6a9d5ac83245179f7c36ac3cfad8d3" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:37.703119 26233 raft_consensus.cc:2468] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:37.691479 26378 tablet_bootstrap.cc:492] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.704344 26378 ts_tablet_manager.cc:1403] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.008s
I20260709 13:09:37.706054 26160 raft_consensus.cc:2468] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 1.
I20260709 13:09:37.701239 26297 leader_election.cc:290] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.701050 26376 ts_tablet_manager.cc:1434] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:09:37.708194 26051 leader_election.cc:304] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: c716eacc10c54db9b4c6ba82c8a81ee9
I20260709 13:09:37.709213 26376 tablet_bootstrap.cc:492] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9: Bootstrap starting.
I20260709 13:09:37.709646 26378 raft_consensus.cc:359] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.710057 26199 leader_election.cc:304] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.710940 26297 raft_consensus.cc:2804] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.711375 26297 raft_consensus.cc:493] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.711573 26285 raft_consensus.cc:2804] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.712955 26285 raft_consensus.cc:697] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Becoming Leader. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:37.714367 26285 consensus_queue.cc:237] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.614948 26377 raft_consensus.cc:515] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.710520 26378 raft_consensus.cc:385] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.716904 26376 tablet_bootstrap.cc:654] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.717208 26378 raft_consensus.cc:740] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.711792 26297 raft_consensus.cc:3060] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.718397 26378 consensus_queue.cc:260] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.721035 26378 ts_tablet_manager.cc:1434] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:37.724222 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bbe4baffef485b8f0551607454cd2e" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:37.727344 26086 raft_consensus.cc:3060] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.728075 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1480893a51f4292b7091d9523110a63" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:37.728714 26233 raft_consensus.cc:3060] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.723994 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1480893a51f4292b7091d9523110a63" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:37.729351 26085 raft_consensus.cc:3060] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.723498 25983 catalog_manager.cc:5697] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.735836 26086 raft_consensus.cc:2468] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 1.
I20260709 13:09:37.724927 26378 tablet_bootstrap.cc:492] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.745005 26233 raft_consensus.cc:2468] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:37.723048 26377 leader_election.cc:290] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.749249 26126 leader_election.cc:304] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.753464 26379 ts_tablet_manager.cc:1434] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.105s	user 0.031s	sys 0.052s
I20260709 13:09:37.754824 26379 tablet_bootstrap.cc:492] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.755954 26378 tablet_bootstrap.cc:654] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.751973 26377 raft_consensus.cc:2804] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.758574 26377 raft_consensus.cc:697] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:37.759596 26377 consensus_queue.cc:237] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.767815 26085 raft_consensus.cc:2468] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:37.778330 26304 raft_consensus.cc:493] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.779780 26304 raft_consensus.cc:515] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.789149 26376 tablet_bootstrap.cc:492] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9: No bootstrap required, opened a new log
I20260709 13:09:37.790673 26376 ts_tablet_manager.cc:1403] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.013s
I20260709 13:09:37.790922 26234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:37.789731 26304 leader_election.cc:290] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.791715 26234 raft_consensus.cc:2468] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:37.792982 26126 leader_election.cc:304] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.793926 26304 raft_consensus.cc:2804] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.794320 26285 raft_consensus.cc:493] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.794327 26304 raft_consensus.cc:493] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.795183 26304 raft_consensus.cc:3060] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.795403 26378 tablet_bootstrap.cc:492] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.795969 26378 ts_tablet_manager.cc:1403] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.006s
I20260709 13:09:37.796306 26379 tablet_bootstrap.cc:654] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.794525 26376 raft_consensus.cc:359] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.798461 26376 raft_consensus.cc:385] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.798784 26376 raft_consensus.cc:740] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.799578 26376 consensus_queue.cc:260] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.804405 26304 raft_consensus.cc:515] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.803743 26285 raft_consensus.cc:515] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.799393 26378 raft_consensus.cc:359] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.806346 26378 raft_consensus.cc:385] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.806741 26378 raft_consensus.cc:740] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.807194 26412 raft_consensus.cc:493] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.807751 26285 leader_election.cc:290] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:37.807848 26412 raft_consensus.cc:515] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.808689 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:37.809396 26086 raft_consensus.cc:2468] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:37.809218 26297 raft_consensus.cc:515] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.810302 26412 leader_election.cc:290] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.811460 26234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:37.812188 26234 raft_consensus.cc:2468] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 0.
I20260709 13:09:37.812896 26376 ts_tablet_manager.cc:1434] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:09:37.813467 26297 leader_election.cc:290] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.814071 26126 leader_election.cc:304] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.808530 26378 consensus_queue.cc:260] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.813411 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:37.815457 26234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6a9d5ac83245179f7c36ac3cfad8d3" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:37.815835 26377 raft_consensus.cc:2804] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.816133 26234 raft_consensus.cc:3060] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.816753 26378 ts_tablet_manager.cc:1434] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:09:37.816471 26377 raft_consensus.cc:493] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.817523 26377 raft_consensus.cc:3060] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.817917 26378 tablet_bootstrap.cc:492] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.825728 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:37.827888 26304 leader_election.cc:290] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.829244 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:37.829473 26377 raft_consensus.cc:515] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.829912 26233 raft_consensus.cc:3060] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:37.829725 26201 leader_election.cc:343] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.832485 26377 leader_election.cc:290] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.834187 25981 catalog_manager.cc:5697] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.836789 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:37.837553 26235 raft_consensus.cc:3060] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:37.838475 26127 leader_election.cc:343] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.827474 26234 raft_consensus.cc:2468] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:37.839941 26051 leader_election.cc:304] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.841080 26401 raft_consensus.cc:2804] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.841084 26297 raft_consensus.cc:493] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.841665 26401 raft_consensus.cc:697] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:37.841818 26297 raft_consensus.cc:515] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.842624 26401 consensus_queue.cc:237] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.843096 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6a9d5ac83245179f7c36ac3cfad8d3" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:37.843762 26160 raft_consensus.cc:3060] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.847044 26297 leader_election.cc:290] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.849021 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146032353ea94e93b465e6643bd50d55" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:37.850033 26232 raft_consensus.cc:2468] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:37.851430 26051 leader_election.cc:304] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.852432 26297 raft_consensus.cc:2804] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.853387 26235 raft_consensus.cc:2468] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:37.854157 26160 raft_consensus.cc:2468] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:37.857298 26378 tablet_bootstrap.cc:654] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.852833 26297 raft_consensus.cc:493] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.859860 26297 raft_consensus.cc:3060] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.862560 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:37.865630 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146032353ea94e93b465e6643bd50d55" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
W20260709 13:09:37.865928 26127 leader_election.cc:343] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.866323 26161 raft_consensus.cc:2468] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:37.867322 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:37.867960 26085 raft_consensus.cc:3060] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.870754 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:37.870597 26126 leader_election.cc:304] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:37.871652 26160 raft_consensus.cc:2393] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eabde53de26b4615bb9e2eebc36d78e9 in current term 1: Already voted for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in this term.
I20260709 13:09:37.873915 25981 catalog_manager.cc:5697] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 1 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.876052 26377 raft_consensus.cc:2804] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.875864 25983 catalog_manager.cc:5697] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.877426 26199 leader_election.cc:304] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eabde53de26b4615bb9e2eebc36d78e9; no voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:37.878337 26285 raft_consensus.cc:2749] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.876641 26377 raft_consensus.cc:697] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:37.879370 26377 consensus_queue.cc:237] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.881155 26378 tablet_bootstrap.cc:492] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.881345 26233 raft_consensus.cc:2468] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:37.881790 26378 ts_tablet_manager.cc:1403] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.000s
I20260709 13:09:37.882784 26126 leader_election.cc:304] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.883874 26412 raft_consensus.cc:2804] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.884356 26412 raft_consensus.cc:697] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:37.884574 26379 tablet_bootstrap.cc:492] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.885078 26378 raft_consensus.cc:359] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.885272 26412 consensus_queue.cc:237] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.886113 26378 raft_consensus.cc:385] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.885159 26379 ts_tablet_manager.cc:1403] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.131s	user 0.022s	sys 0.014s
I20260709 13:09:37.886485 26378 raft_consensus.cc:740] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.887593 26378 consensus_queue.cc:260] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.885654 26085 raft_consensus.cc:2468] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 1.
I20260709 13:09:37.890401 26379 raft_consensus.cc:359] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.893157 26379 raft_consensus.cc:385] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.893872 26379 raft_consensus.cc:740] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.895350 26379 consensus_queue.cc:260] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.901372 26379 ts_tablet_manager.cc:1434] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:37.902266 26379 tablet_bootstrap.cc:492] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b: Bootstrap starting.
I20260709 13:09:37.907367 25982 catalog_manager.cc:5697] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.914633 26379 tablet_bootstrap.cc:654] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.897154 26297 raft_consensus.cc:515] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.920662 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146032353ea94e93b465e6643bd50d55" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:37.921583 26160 raft_consensus.cc:3060] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.924296 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146032353ea94e93b465e6643bd50d55" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:37.924984 26233 raft_consensus.cc:3060] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.927685 26297 leader_election.cc:290] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.934748 26233 raft_consensus.cc:2468] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:37.936430 26051 leader_election.cc:304] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:37.937376 26297 raft_consensus.cc:2804] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.937870 26297 raft_consensus.cc:697] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:37.938757 26297 consensus_queue.cc:237] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.934875 25983 catalog_manager.cc:5697] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 1 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.946859 26160 raft_consensus.cc:2468] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:37.953411 26378 ts_tablet_manager.cc:1434] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.071s	user 0.015s	sys 0.021s
I20260709 13:09:37.955192 26378 tablet_bootstrap.cc:492] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.957324 25982 catalog_manager.cc:5697] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 1 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.962774 26379 tablet_bootstrap.cc:492] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b: No bootstrap required, opened a new log
I20260709 13:09:37.963346 26379 ts_tablet_manager.cc:1403] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.020s
I20260709 13:09:37.965699 26379 raft_consensus.cc:359] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.966426 26379 raft_consensus.cc:385] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.966704 26379 raft_consensus.cc:740] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.967460 26379 consensus_queue.cc:260] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.969369 26378 tablet_bootstrap.cc:654] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.969715 26379 ts_tablet_manager.cc:1434] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:37.974705 26378 tablet_bootstrap.cc:492] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.975258 26378 ts_tablet_manager.cc:1403] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 13:09:37.978159 26378 raft_consensus.cc:359] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.978865 26378 raft_consensus.cc:385] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.979132 26378 raft_consensus.cc:740] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.979763 26378 consensus_queue.cc:260] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.981748 26297 raft_consensus.cc:493] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.981926 26378 ts_tablet_manager.cc:1434] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:09:37.982349 26297 raft_consensus.cc:515] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.982998 26378 tablet_bootstrap.cc:492] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9: Bootstrap starting.
I20260709 13:09:37.985185 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceeb99171c494190acf7649429e74f" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
W20260709 13:09:37.986454 26050 leader_election.cc:343] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.986770 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceeb99171c494190acf7649429e74f" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:37.987421 26233 raft_consensus.cc:2468] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 0.
I20260709 13:09:37.987679 26297 leader_election.cc:290] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:37.988544 26051 leader_election.cc:304] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: c716eacc10c54db9b4c6ba82c8a81ee9
I20260709 13:09:37.989287 26297 raft_consensus.cc:2804] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.989684 26297 raft_consensus.cc:493] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.989845 26378 tablet_bootstrap.cc:654] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.990038 26297 raft_consensus.cc:3060] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.994722 26378 tablet_bootstrap.cc:492] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9: No bootstrap required, opened a new log
I20260709 13:09:37.995235 26378 ts_tablet_manager.cc:1403] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:09:37.997279 26297 raft_consensus.cc:515] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.998121 26378 raft_consensus.cc:359] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:37.998842 26378 raft_consensus.cc:385] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.999114 26378 raft_consensus.cc:740] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.999840 26378 consensus_queue.cc:260] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.000342 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceeb99171c494190acf7649429e74f" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:38.000624 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceeb99171c494190acf7649429e74f" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:38.001037 26160 raft_consensus.cc:3060] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.001183 26233 raft_consensus.cc:3060] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:38.002117 26032 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:38.002326 26378 ts_tablet_manager.cc:1434] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:38.003715 26297 leader_election.cc:290] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.009243 26160 raft_consensus.cc:2468] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:38.009243 26233 raft_consensus.cc:2468] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 1.
I20260709 13:09:38.010900 26051 leader_election.cc:304] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:38.011816 26297 raft_consensus.cc:2804] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.012312 26297 raft_consensus.cc:697] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:38.013127 26297 consensus_queue.cc:237] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.020367 26297 raft_consensus.cc:493] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.020968 26297 raft_consensus.cc:515] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.022466 25982 catalog_manager.cc:5697] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 1 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.023358 26297 leader_election.cc:290] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.023949 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:38.024974 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9" is_pre_election: true
I20260709 13:09:38.025887 26233 raft_consensus.cc:2393] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e54cde55a7eb4cafaa86877bae1f1f4b in current term 1: Already voted for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in this term.
I20260709 13:09:38.026865 26051 leader_election.cc:304] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b; no voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:38.027743 26297 raft_consensus.cc:3060] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.036152 26297 raft_consensus.cc:2749] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.142449 26159 raft_consensus.cc:3060] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.151413 26285 consensus_queue.cc:1048] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.167455 26285 consensus_queue.cc:1048] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.178062 26285 raft_consensus.cc:493] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.178623 26285 raft_consensus.cc:515] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.181200 26285 leader_election.cc:290] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:38.181807 26159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" is_pre_election: true
I20260709 13:09:38.181820 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" is_pre_election: true
I20260709 13:09:38.182654 26159 raft_consensus.cc:2468] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 0.
I20260709 13:09:38.182842 26085 raft_consensus.cc:2468] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 0.
I20260709 13:09:38.183871 26199 leader_election.cc:304] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:38.184792 26285 raft_consensus.cc:2804] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.185205 26285 raft_consensus.cc:493] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.185557 26285 raft_consensus.cc:3060] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.193037 26285 raft_consensus.cc:515] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.195000 26285 leader_election.cc:290] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:38.195796 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:38.196224 26159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:38.196523 26085 raft_consensus.cc:3060] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.196934 26159 raft_consensus.cc:3060] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.204293 26085 raft_consensus.cc:2468] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 1.
I20260709 13:09:38.205369 26159 raft_consensus.cc:2468] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 1.
I20260709 13:09:38.205587 26201 leader_election.cc:304] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:38.206576 26285 raft_consensus.cc:2804] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.207037 26285 raft_consensus.cc:697] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Becoming Leader. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:38.207834 26285 consensus_queue.cc:237] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.216264 25982 catalog_manager.cc:5697] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67). New cstate: current_term: 1 leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.222452 26412 consensus_queue.cc:1048] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.234948 26418 consensus_queue.cc:1048] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.243577 26285 consensus_queue.cc:1048] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.248384 26160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
mode: GRACEFUL
new_leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:57612
I20260709 13:09:38.249063 26160 raft_consensus.cc:606] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Received request to transfer leadership to TS e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:38.263127 26161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1480893a51f4292b7091d9523110a63"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
mode: GRACEFUL
new_leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:57612
I20260709 13:09:38.263226 26297 consensus_queue.cc:1048] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.263875 26161 raft_consensus.cc:606] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Received request to transfer leadership to TS e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:38.268899 26400 consensus_queue.cc:1048] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.274029 26418 consensus_queue.cc:1048] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.282526 26159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
mode: GRACEFUL
new_leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:57612
I20260709 13:09:38.283222 26159 raft_consensus.cc:606] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Received request to transfer leadership to TS e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:38.298328 26402 consensus_queue.cc:1048] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.308476 26418 consensus_queue.cc:1048] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.334596 26377 raft_consensus.cc:993] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9: : Instructing follower e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:38.335127 26418 raft_consensus.cc:1081] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Signalling peer e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:38.337177 26085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:52210
I20260709 13:09:38.338265 26085 raft_consensus.cc:493] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.338717 26085 raft_consensus.cc:3060] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.344847 26232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02c9cce115c14133a018cc3b3832af36"
dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
mode: GRACEFUL
new_leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:37722
I20260709 13:09:38.345665 26232 raft_consensus.cc:606] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Received request to transfer leadership to TS c716eacc10c54db9b4c6ba82c8a81ee9
I20260709 13:09:38.349582 26085 raft_consensus.cc:515] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.352576 26085 leader_election.cc:290] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.353565 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:38.354357 26232 raft_consensus.cc:3060] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.355610 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef79c5a1ca34a8aa18ee0ee2c124439" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:38.356371 26161 raft_consensus.cc:3055] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.356686 26161 raft_consensus.cc:740] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:38.357563 26161 consensus_queue.cc:260] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.358582 26161 raft_consensus.cc:3060] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.360496 26234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8"
dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
mode: GRACEFUL
new_leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:37722
I20260709 13:09:38.361235 26234 raft_consensus.cc:606] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Received request to transfer leadership to TS c716eacc10c54db9b4c6ba82c8a81ee9
I20260709 13:09:38.368067 26232 raft_consensus.cc:2468] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:38.369894 26161 raft_consensus.cc:2468] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:38.370945 26085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce6a9d5ac83245179f7c36ac3cfad8d3"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
mode: GRACEFUL
new_leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:52234
I20260709 13:09:38.371459 26051 leader_election.cc:304] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:38.371834 26085 raft_consensus.cc:606] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Received request to transfer leadership to TS c716eacc10c54db9b4c6ba82c8a81ee9
I20260709 13:09:38.372488 26401 raft_consensus.cc:2804] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.373081 26401 raft_consensus.cc:697] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:38.373483 26377 consensus_queue.cc:1048] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.374081 26401 consensus_queue.cc:237] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.380008 26234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58bbe4baffef485b8f0551607454cd2e"
dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
mode: GRACEFUL
new_leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:37722
I20260709 13:09:38.380676 26234 raft_consensus.cc:606] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Received request to transfer leadership to TS c716eacc10c54db9b4c6ba82c8a81ee9
I20260709 13:09:38.386793 26086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ceeb99171c494190acf7649429e74f"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
mode: GRACEFUL
new_leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
 from {username='slave'} at 127.0.0.1:52234
I20260709 13:09:38.387310 26086 raft_consensus.cc:606] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Received request to transfer leadership to TS eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:38.388686 25982 catalog_manager.cc:5697] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 1 to 2, leader changed from c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66) to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.390486 26418 raft_consensus.cc:993] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9: : Instructing follower e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:38.391196 26412 raft_consensus.cc:1081] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Signalling peer e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:38.396351 26085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:52210
I20260709 13:09:38.397017 26085 raft_consensus.cc:493] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.397462 26085 raft_consensus.cc:3060] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.399000 26304 consensus_queue.cc:1048] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.406913 26085 raft_consensus.cc:515] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.410794 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:38.411474 26232 raft_consensus.cc:3060] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.410880 26085 leader_election.cc:290] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.414050 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73501c4aa4f949b9b5e32ae31d1272fa" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:38.414644 26161 raft_consensus.cc:3055] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.414975 26161 raft_consensus.cc:740] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:38.415848 26161 consensus_queue.cc:260] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.417276 26161 raft_consensus.cc:3060] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.421283 26402 consensus_queue.cc:1048] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.423080 26232 raft_consensus.cc:2468] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:38.425135 26161 raft_consensus.cc:2468] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:38.427062 26050 leader_election.cc:304] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:38.428381 26401 raft_consensus.cc:2804] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.428871 26401 raft_consensus.cc:697] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:38.428992 26297 consensus_queue.cc:1048] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.429876 26401 consensus_queue.cc:237] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.440237 26402 raft_consensus.cc:993] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b: : Instructing follower eabde53de26b4615bb9e2eebc36d78e9 to start an election
I20260709 13:09:38.441556 26402 raft_consensus.cc:1081] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Signalling peer eabde53de26b4615bb9e2eebc36d78e9 to start an election
I20260709 13:09:38.441253 25981 catalog_manager.cc:5697] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 1 to 2, leader changed from c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66) to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.445216 26235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ceeb99171c494190acf7649429e74f"
dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
 from {username='slave'} at 127.0.0.1:37704
I20260709 13:09:38.445897 26235 raft_consensus.cc:493] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.446254 26235 raft_consensus.cc:3060] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.458388 26297 consensus_queue.cc:1048] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.461790 26235 raft_consensus.cc:515] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.467208 26234 raft_consensus.cc:1240] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Rejecting Update request from peer e54cde55a7eb4cafaa86877bae1f1f4b for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.477033 26235 leader_election.cc:290] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 2 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:38.478333 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceeb99171c494190acf7649429e74f" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:38.479516 26085 raft_consensus.cc:3055] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.479930 26401 consensus_queue.cc:1059] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.481269 26161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceeb99171c494190acf7649429e74f" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:38.479987 26085 raft_consensus.cc:740] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:38.481969 26161 raft_consensus.cc:3060] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.482671 26085 consensus_queue.cc:260] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.484323 26085 raft_consensus.cc:3060] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.490108 26297 consensus_queue.cc:1048] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.492755 26161 raft_consensus.cc:2468] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 2.
I20260709 13:09:38.494168 26199 leader_election.cc:304] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:38.495287 26400 raft_consensus.cc:2804] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.495966 26400 raft_consensus.cc:697] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 2 LEADER]: Becoming Leader. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:38.496953 26400 consensus_queue.cc:237] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.584872 25982 catalog_manager.cc:5697] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 reported cstate change: term changed from 1 to 2, leader changed from e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65) to eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.598656 26085 raft_consensus.cc:2468] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 2.
W20260709 13:09:38.600270 26401 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:09:38.642552 26285 raft_consensus.cc:993] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9: : Instructing follower c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:38.643688 26400 raft_consensus.cc:1081] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Signalling peer c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:38.646727 26159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02c9cce115c14133a018cc3b3832af36"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:57600
I20260709 13:09:38.647687 26159 raft_consensus.cc:493] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.648190 26159 raft_consensus.cc:3060] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.659389 26159 raft_consensus.cc:515] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.661796 26159 leader_election.cc:290] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.662992 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c9cce115c14133a018cc3b3832af36" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:38.663329 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c9cce115c14133a018cc3b3832af36" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:38.664162 26232 raft_consensus.cc:3055] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.664305 26085 raft_consensus.cc:3060] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.664546 26232 raft_consensus.cc:740] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:38.665870 26232 consensus_queue.cc:260] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.667824 26232 raft_consensus.cc:3060] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.673570 26085 raft_consensus.cc:2468] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:38.676095 26127 leader_election.cc:304] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:38.677384 26412 raft_consensus.cc:2804] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.677918 26232 raft_consensus.cc:2468] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:38.678306 26412 raft_consensus.cc:697] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:38.680090 26304 raft_consensus.cc:993] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9: : Instructing follower e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:38.679915 26412 consensus_queue.cc:237] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.680786 26418 raft_consensus.cc:1081] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Signalling peer e54cde55a7eb4cafaa86877bae1f1f4b to start an election
I20260709 13:09:38.682803 26085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1480893a51f4292b7091d9523110a63"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
 from {username='slave'} at 127.0.0.1:52210
I20260709 13:09:38.683495 26085 raft_consensus.cc:493] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.684080 26085 raft_consensus.cc:3060] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.690038 25981 catalog_manager.cc:5697] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 1 to 2, leader changed from eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67) to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.691776 26085 raft_consensus.cc:515] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.694530 26085 leader_election.cc:290] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Requested vote from peers c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.695506 26159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1480893a51f4292b7091d9523110a63" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:38.696333 26159 raft_consensus.cc:3055] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.696401 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1480893a51f4292b7091d9523110a63" candidate_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:38.696792 26159 raft_consensus.cc:740] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:38.697397 26232 raft_consensus.cc:3060] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.698231 26159 consensus_queue.cc:260] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.701215 26159 raft_consensus.cc:3060] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.705580 26232 raft_consensus.cc:2468] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:38.707046 26051 leader_election.cc:304] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:38.708057 26401 raft_consensus.cc:2804] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.708664 26401 raft_consensus.cc:697] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Becoming Leader. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:38.708736 26159 raft_consensus.cc:2468] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e54cde55a7eb4cafaa86877bae1f1f4b in term 2.
I20260709 13:09:38.710248 26401 consensus_queue.cc:237] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.715281 26400 consensus_queue.cc:1048] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.722596 25981 catalog_manager.cc:5697] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b reported cstate change: term changed from 1 to 2, leader changed from c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66) to e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65). New cstate: current_term: 2 leader_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.742093 26400 raft_consensus.cc:993] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9: : Instructing follower c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:38.742928 26400 raft_consensus.cc:1081] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Signalling peer c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:38.749692 26161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:57600
I20260709 13:09:38.750541 26161 raft_consensus.cc:493] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.750929 26161 raft_consensus.cc:3060] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.756604 26285 consensus_queue.cc:1048] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.764174 26161 raft_consensus.cc:515] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.765699 26159 raft_consensus.cc:1240] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Rejecting Update request from peer eabde53de26b4615bb9e2eebc36d78e9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.767259 26161 leader_election.cc:290] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.769439 26086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:38.769553 26285 consensus_queue.cc:1059] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.770941 26285 raft_consensus.cc:3055] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.771242 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0da2f44e7c4d39970be7e159175ea8" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:38.771406 26285 raft_consensus.cc:740] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:38.773110 26285 consensus_queue.cc:260] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.774507 26285 raft_consensus.cc:3060] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.790642 26235 raft_consensus.cc:2468] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:38.793993 26126 leader_election.cc:304] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: e54cde55a7eb4cafaa86877bae1f1f4b
I20260709 13:09:38.795389 26418 raft_consensus.cc:2804] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.796085 26418 raft_consensus.cc:697] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:38.797206 26418 consensus_queue.cc:237] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.805096 25981 catalog_manager.cc:5697] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 1 to 2, leader changed from eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67) to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.808701 26401 raft_consensus.cc:993] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b: : Instructing follower c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:38.809496 26448 raft_consensus.cc:1081] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Signalling peer c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:38.811571 26161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce6a9d5ac83245179f7c36ac3cfad8d3"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:57598
I20260709 13:09:38.812242 26161 raft_consensus.cc:493] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.812602 26161 raft_consensus.cc:3060] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.821431 26161 raft_consensus.cc:515] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.823292 26161 leader_election.cc:290] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.824513 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6a9d5ac83245179f7c36ac3cfad8d3" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:38.824654 26235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6a9d5ac83245179f7c36ac3cfad8d3" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:38.825299 26085 raft_consensus.cc:3055] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.825369 26235 raft_consensus.cc:3060] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.825637 26085 raft_consensus.cc:740] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:38.826730 26085 consensus_queue.cc:260] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.828156 26085 raft_consensus.cc:3060] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.831820 26235 raft_consensus.cc:2468] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:38.833384 26126 leader_election.cc:304] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:38.834265 26418 raft_consensus.cc:2804] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.834796 26418 raft_consensus.cc:697] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:38.835951 26085 raft_consensus.cc:2468] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:38.836082 26418 consensus_queue.cc:237] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.845901 25981 catalog_manager.cc:5697] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 1 to 2, leader changed from e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65) to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.854866 26161 raft_consensus.cc:1275] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.856890 26448 consensus_queue.cc:1048] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.869486 26235 raft_consensus.cc:1275] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.871449 26402 consensus_queue.cc:1048] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.887250 26235 raft_consensus.cc:1275] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.888813 26400 raft_consensus.cc:993] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9: : Instructing follower c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:38.889499 26285 raft_consensus.cc:1081] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Signalling peer c716eacc10c54db9b4c6ba82c8a81ee9 to start an election
I20260709 13:09:38.889290 26402 consensus_queue.cc:1048] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.892526 26161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58bbe4baffef485b8f0551607454cd2e"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
 from {username='slave'} at 127.0.0.1:57600
I20260709 13:09:38.893262 26161 raft_consensus.cc:493] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.893669 26161 raft_consensus.cc:3060] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.905854 26161 raft_consensus.cc:515] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.908146 26159 raft_consensus.cc:1275] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.909369 26085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bbe4baffef485b8f0551607454cd2e" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:38.910104 26085 raft_consensus.cc:3060] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.909776 26448 consensus_queue.cc:1048] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.910238 26161 leader_election.cc:290] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67:33705)
I20260709 13:09:38.912158 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bbe4baffef485b8f0551607454cd2e" candidate_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
I20260709 13:09:38.912907 26232 raft_consensus.cc:3055] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.913226 26232 raft_consensus.cc:740] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:38.914207 26232 consensus_queue.cc:260] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.919097 26232 raft_consensus.cc:3060] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.923101 26085 raft_consensus.cc:2468] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:38.926402 26127 leader_election.cc:304] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c716eacc10c54db9b4c6ba82c8a81ee9, e54cde55a7eb4cafaa86877bae1f1f4b; no voters: 
I20260709 13:09:38.927309 26418 raft_consensus.cc:2804] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.927891 26418 raft_consensus.cc:697] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Becoming Leader. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:38.929059 26418 consensus_queue.cc:237] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:38.936641 26232 raft_consensus.cc:2468] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716eacc10c54db9b4c6ba82c8a81ee9 in term 2.
I20260709 13:09:38.940867 25983 catalog_manager.cc:5697] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 reported cstate change: term changed from 1 to 2, leader changed from eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67) to c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66). New cstate: current_term: 2 leader_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.956298 26161 raft_consensus.cc:1275] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer eabde53de26b4615bb9e2eebc36d78e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.957835 26285 consensus_queue.cc:1048] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.968690 26085 raft_consensus.cc:1275] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Refusing update from remote peer eabde53de26b4615bb9e2eebc36d78e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.970846 26285 consensus_queue.cc:1048] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.213752 26085 raft_consensus.cc:1275] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.215497 26418 consensus_queue.cc:1048] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.227129 26235 raft_consensus.cc:1275] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.227444 26232 raft_consensus.cc:1275] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.228767 26448 consensus_queue.cc:1048] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.228931 26412 consensus_queue.cc:1048] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.243038 26161 raft_consensus.cc:1275] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer e54cde55a7eb4cafaa86877bae1f1f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.244650 26448 consensus_queue.cc:1048] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.272927 26235 raft_consensus.cc:1275] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.274302 26412 consensus_queue.cc:1048] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.284020 26085 raft_consensus.cc:1275] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.285382 26418 consensus_queue.cc:1048] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.316509 26235 raft_consensus.cc:1275] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.317831 26418 consensus_queue.cc:1048] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.327247 26085 raft_consensus.cc:3060] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.335036 26085 raft_consensus.cc:1275] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.336382 26304 consensus_queue.cc:1048] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.365728 26235 raft_consensus.cc:1275] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.367025 26304 consensus_queue.cc:1048] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.378830 26085 raft_consensus.cc:1275] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Refusing update from remote peer c716eacc10c54db9b4c6ba82c8a81ee9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.380134 26412 consensus_queue.cc:1048] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.391038 25982 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38182:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:09:41.415474 25982 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38182:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:09:41.438122 14293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:41.540151 26498 tablet.cc:1724] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.556983 26082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559"
dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
mode: GRACEFUL
new_leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
 from {username='slave'} at 127.0.0.1:36278
I20260709 13:09:41.557987 26082 raft_consensus.cc:606] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Received request to transfer leadership to TS eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:41.642681 26499 tablet.cc:1724] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.726212 26498 tablet.cc:1724] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.738317 26297 raft_consensus.cc:993] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b: : Instructing follower eabde53de26b4615bb9e2eebc36d78e9 to start an election
I20260709 13:09:41.760327 26516 raft_consensus.cc:1081] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Signalling peer eabde53de26b4615bb9e2eebc36d78e9 to start an election
W20260709 13:09:41.802968 26472 log.cc:927] Time spent T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b: Append to log took a long time: real 0.118s	user 0.006s	sys 0.000s
I20260709 13:09:41.814941 26526 tablet.cc:1724] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.832237 26532 tablet.cc:1724] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.838349 26161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aecf57a23cb46209619dea0ea937271"
dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
mode: GRACEFUL
new_leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
 from {username='slave'} at 127.0.0.1:55362
I20260709 13:09:41.838897 26161 raft_consensus.cc:606] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Received request to transfer leadership to TS eabde53de26b4615bb9e2eebc36d78e9
I20260709 13:09:41.840692 26523 tablet.cc:1724] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:41.837232 26050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.66:41025, user_credentials={real_user=slave}} blocked reactor thread for 88018.4us
I20260709 13:09:41.844524 26529 tablet.cc:1724] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.858522 26530 tablet.cc:1724] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.846458 26498 tablet.cc:1724] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.874207 14293 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:41.875101 14293 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:41.841356 26531 tablet.cc:1724] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.879889 26519 raft_consensus.cc:993] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9: : Instructing follower eabde53de26b4615bb9e2eebc36d78e9 to start an election
I20260709 13:09:41.883504 26519 raft_consensus.cc:1081] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Signalling peer eabde53de26b4615bb9e2eebc36d78e9 to start an election
I20260709 13:09:41.888707 26533 tablet.cc:1724] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:41.899397 26127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.245.65:33083, user_credentials={real_user=slave}} blocked reactor thread for 80599us
I20260709 13:09:41.900327 26231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559"
dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
 from {username='slave'} at 127.0.0.1:37704
I20260709 13:09:41.901080 26231 raft_consensus.cc:493] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.901497 26231 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.916340 26235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6aecf57a23cb46209619dea0ea937271"
dest_uuid: "eabde53de26b4615bb9e2eebc36d78e9"
 from {username='slave'} at 127.0.0.1:37714
I20260709 13:09:41.917232 26235 raft_consensus.cc:493] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.917742 26235 raft_consensus.cc:3060] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.914682 26499 tablet.cc:1724] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.939436 26530 tablet.cc:1724] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.937968 26526 tablet.cc:1724] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.955163 26528 tablet.cc:1724] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.918046 26535 tablet.cc:1724] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.994338 26529 tablet.cc:1724] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:41.991871 26235 raft_consensus.cc:515] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:42.023131 26084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aecf57a23cb46209619dea0ea937271" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:42.024125 26084 raft_consensus.cc:3060] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.024310 26537 tablet.cc:1724] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.018770 26532 tablet.cc:1724] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.034040 26231 raft_consensus.cc:515] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:42.036541 26231 leader_election.cc:290] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 3 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:42.037515 26083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b"
I20260709 13:09:42.038292 26083 raft_consensus.cc:3055] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:42.038702 26083 raft_consensus.cc:740] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e54cde55a7eb4cafaa86877bae1f1f4b, State: Running, Role: LEADER
I20260709 13:09:42.040275 26083 consensus_queue.cc:260] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:42.040807 26160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b9c0becd104cabbc39a94a6dc96559" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:42.041514 26160 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.041824 26083 raft_consensus.cc:3060] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.050927 26159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aecf57a23cb46209619dea0ea937271" candidate_uuid: "eabde53de26b4615bb9e2eebc36d78e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9"
I20260709 13:09:42.051816 26159 raft_consensus.cc:3055] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:42.052234 26159 raft_consensus.cc:740] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c716eacc10c54db9b4c6ba82c8a81ee9, State: Running, Role: LEADER
I20260709 13:09:42.053969 26235 leader_election.cc:290] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 2 election: Requested vote from peers e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083), c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025)
I20260709 13:09:42.054955 26159 consensus_queue.cc:260] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:42.072695 26159 raft_consensus.cc:3060] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.079763 26084 raft_consensus.cc:2468] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 2.
I20260709 13:09:42.094866 26085 raft_consensus.cc:1240] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Rejecting Update request from peer c716eacc10c54db9b4c6ba82c8a81ee9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:42.099851 26201 leader_election.cc:304] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:42.101157 26506 raft_consensus.cc:2804] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:42.101694 26506 raft_consensus.cc:697] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 LEADER]: Becoming Leader. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:42.105710 26506 consensus_queue.cc:237] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:42.066498 26523 tablet.cc:1724] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.104691 26083 raft_consensus.cc:2468] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 3.
I20260709 13:09:42.113886 26160 raft_consensus.cc:2468] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 3.
I20260709 13:09:42.107765 26159 raft_consensus.cc:2468] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eabde53de26b4615bb9e2eebc36d78e9 in term 2.
I20260709 13:09:42.079082 26531 tablet.cc:1724] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.120886 26201 leader_election.cc:304] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e54cde55a7eb4cafaa86877bae1f1f4b, eabde53de26b4615bb9e2eebc36d78e9; no voters: 
I20260709 13:09:42.118330 26535 tablet.cc:1724] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.087591 26533 tablet.cc:1724] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.091768 26532 tablet.cc:1724] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.123118 26457 raft_consensus.cc:2804] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:42.134081 26457 raft_consensus.cc:697] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 3 LEADER]: Becoming Leader. State: Replica: eabde53de26b4615bb9e2eebc36d78e9, State: Running, Role: LEADER
I20260709 13:09:42.135134 26457 consensus_queue.cc:237] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } }
I20260709 13:09:42.122419 26523 tablet.cc:1724] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.098759 26529 tablet.cc:1724] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.148672 25982 catalog_manager.cc:5697] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 reported cstate change: term changed from 1 to 2, leader changed from c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66) to eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67). New cstate: current_term: 2 leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.128412 26537 tablet.cc:1724] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:42.184824 25983 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c: soft_deleted_table [id=8db63b6e340d45e3b923fbf28f5ec6f0] alter complete (version 1)
I20260709 13:09:42.195641 25981 catalog_manager.cc:5697] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 reported cstate change: term changed from 2 to 3, leader changed from e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65) to eabde53de26b4615bb9e2eebc36d78e9 (127.13.245.67). New cstate: current_term: 3 leader_uuid: "eabde53de26b4615bb9e2eebc36d78e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eabde53de26b4615bb9e2eebc36d78e9" member_type: VOTER last_known_addr { host: "127.13.245.67" port: 33705 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.616657 26160 raft_consensus.cc:1275] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 3 FOLLOWER]: Refusing update from remote peer eabde53de26b4615bb9e2eebc36d78e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:42.618325 26457 consensus_queue.cc:1048] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.650259 26084 raft_consensus.cc:1275] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 3 FOLLOWER]: Refusing update from remote peer eabde53de26b4615bb9e2eebc36d78e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:42.651880 26159 raft_consensus.cc:1275] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Refusing update from remote peer eabde53de26b4615bb9e2eebc36d78e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.652024 26506 consensus_queue.cc:1048] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:42.653573 26548 consensus_queue.cc:1048] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716eacc10c54db9b4c6ba82c8a81ee9" member_type: VOTER last_known_addr { host: "127.13.245.66" port: 41025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.696666 26084 raft_consensus.cc:1275] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Refusing update from remote peer eabde53de26b4615bb9e2eebc36d78e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.698100 26457 consensus_queue.cc:1048] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54cde55a7eb4cafaa86877bae1f1f4b" member_type: VOTER last_known_addr { host: "127.13.245.65" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.939324 14293 tablet_server.cc:179] TabletServer@127.13.245.65:0 shutting down...
I20260709 13:09:42.971083 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:42.972054 14293 tablet_replica.cc:333] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:42.973031 14293 raft_consensus.cc:2243] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.973516 14293 raft_consensus.cc:2272] T 3c0da2f44e7c4d39970be7e159175ea8 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.977269 14293 tablet_replica.cc:333] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:42.977952 14293 raft_consensus.cc:2243] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.978400 14293 raft_consensus.cc:2272] T ce6a9d5ac83245179f7c36ac3cfad8d3 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.980737 14293 tablet_replica.cc:333] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:42.981344 14293 raft_consensus.cc:2243] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.981889 14293 raft_consensus.cc:2272] T 02c9cce115c14133a018cc3b3832af36 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.985664 14293 tablet_replica.cc:333] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:42.986349 14293 raft_consensus.cc:2243] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.987201 14293 raft_consensus.cc:2272] T bef79c5a1ca34a8aa18ee0ee2c124439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.989612 14293 tablet_replica.cc:333] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:42.990175 14293 raft_consensus.cc:2243] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.990705 14293 raft_consensus.cc:2272] T e51974e2c8c34be5baf208e164d85548 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:42.993243 26127 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:09:42.993810 14293 tablet_replica.cc:333] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:42.994814 14293 raft_consensus.cc:2243] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.995301 14293 raft_consensus.cc:2272] T 6aecf57a23cb46209619dea0ea937271 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:42.996848 26127 consensus_peers.cc:597] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.998543 14293 tablet_replica.cc:333] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:42.999356 14293 raft_consensus.cc:2243] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.999905 14293 raft_consensus.cc:2272] T 29b9c0becd104cabbc39a94a6dc96559 P e54cde55a7eb4cafaa86877bae1f1f4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.003851 14293 tablet_replica.cc:333] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.004904 14293 raft_consensus.cc:2243] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:43.005017 26127 consensus_peers.cc:597] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.005519 14293 raft_consensus.cc:2272] T 58bbe4baffef485b8f0551607454cd2e P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.008463 14293 tablet_replica.cc:333] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.009064 14293 raft_consensus.cc:2243] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.009572 14293 raft_consensus.cc:2272] T cf43b9c70995461ba3cb7d1fe30eb930 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.011865 14293 tablet_replica.cc:333] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.012428 14293 raft_consensus.cc:2243] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.013276 14293 raft_consensus.cc:2272] T 94f7609a5a854e47968736437c22b439 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.015339 14293 tablet_replica.cc:333] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.015944 14293 raft_consensus.cc:2243] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.016434 14293 raft_consensus.cc:2272] T 73ceeb99171c494190acf7649429e74f P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.018971 14293 tablet_replica.cc:333] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.019692 14293 raft_consensus.cc:2243] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.020556 14293 raft_consensus.cc:2272] T 73501c4aa4f949b9b5e32ae31d1272fa P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.023404 14293 tablet_replica.cc:333] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.024091 14293 raft_consensus.cc:2243] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.024950 14293 raft_consensus.cc:2272] T 35d098ba726f4a1b932215a321920f5e P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.027143 14293 tablet_replica.cc:333] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.027792 14293 raft_consensus.cc:2243] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.028224 14293 raft_consensus.cc:2272] T 40deffc154474fcb83c0238539dec4aa P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.030920 14293 tablet_replica.cc:333] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.031848 14293 raft_consensus.cc:2243] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.033002 14293 raft_consensus.cc:2272] T 452a78d7dcc5496e9ea65721e4e06717 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.036303 14293 tablet_replica.cc:333] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
W20260709 13:09:43.036805 26127 consensus_peers.cc:597] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.036969 14293 raft_consensus.cc:2243] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.038273 14293 raft_consensus.cc:2272] T 146032353ea94e93b465e6643bd50d55 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.042472 14293 tablet_replica.cc:333] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
W20260709 13:09:43.042826 26201 consensus_peers.cc:597] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.043236 14293 raft_consensus.cc:2243] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.044330 14293 raft_consensus.cc:2272] T b1480893a51f4292b7091d9523110a63 P e54cde55a7eb4cafaa86877bae1f1f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.046559 14293 tablet_replica.cc:333] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b: stopping tablet replica
I20260709 13:09:43.047114 14293 raft_consensus.cc:2243] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.047572 14293 raft_consensus.cc:2272] T c1e81f92fda44698906a47c3de450d01 P e54cde55a7eb4cafaa86877bae1f1f4b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.085000 26127 consensus_peers.cc:597] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:33083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.093477 14293 tablet_server.cc:196] TabletServer@127.13.245.65:0 shutdown complete.
I20260709 13:09:43.146437 14293 tablet_server.cc:179] TabletServer@127.13.245.66:0 shutting down...
W20260709 13:09:43.146816 26201 consensus_peers.cc:597] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:33083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.184903 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:43.185974 14293 tablet_replica.cc:333] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.187086 14293 raft_consensus.cc:2243] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:09:43.187705 26127 consensus_peers.cc:597] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:33083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.188185 14293 raft_consensus.cc:2272] T 02c9cce115c14133a018cc3b3832af36 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.189901 26127 consensus_peers.cc:597] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:33083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.190959 14293 tablet_replica.cc:333] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.191740 14293 raft_consensus.cc:2243] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.192555 14293 raft_consensus.cc:2272] T 3c0da2f44e7c4d39970be7e159175ea8 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.194890 14293 tablet_replica.cc:333] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.195523 14293 raft_consensus.cc:2243] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.196416 14293 raft_consensus.cc:2272] T ce6a9d5ac83245179f7c36ac3cfad8d3 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.198566 14293 tablet_replica.cc:333] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.199451 14293 raft_consensus.cc:2243] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.200029 14293 raft_consensus.cc:2272] T 146032353ea94e93b465e6643bd50d55 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.202337 14293 tablet_replica.cc:333] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.202966 14293 raft_consensus.cc:2243] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.203891 14293 raft_consensus.cc:2272] T c1e81f92fda44698906a47c3de450d01 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.206272 14293 tablet_replica.cc:333] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.206880 14293 raft_consensus.cc:2243] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.207334 14293 raft_consensus.cc:2272] T b1480893a51f4292b7091d9523110a63 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.209456 14293 tablet_replica.cc:333] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.210072 14293 raft_consensus.cc:2243] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.210558 14293 raft_consensus.cc:2272] T bef79c5a1ca34a8aa18ee0ee2c124439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.212594 14293 tablet_replica.cc:333] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.213212 14293 raft_consensus.cc:2243] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.213681 14293 raft_consensus.cc:2272] T e51974e2c8c34be5baf208e164d85548 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.216048 14293 tablet_replica.cc:333] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.216668 14293 raft_consensus.cc:2243] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.217176 14293 raft_consensus.cc:2272] T 94f7609a5a854e47968736437c22b439 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.219422 14293 tablet_replica.cc:333] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.220090 14293 raft_consensus.cc:2243] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.220980 14293 raft_consensus.cc:2272] T cf43b9c70995461ba3cb7d1fe30eb930 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.223110 14293 tablet_replica.cc:333] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.223790 14293 raft_consensus.cc:2243] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.224656 14293 raft_consensus.cc:2272] T 58bbe4baffef485b8f0551607454cd2e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.227185 14293 tablet_replica.cc:333] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.227944 14293 raft_consensus.cc:2243] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.228431 14293 raft_consensus.cc:2272] T 6aecf57a23cb46209619dea0ea937271 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.229560 26199 consensus_peers.cc:597] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 -> Peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Couldn't send request to peer c716eacc10c54db9b4c6ba82c8a81ee9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.231221 14293 tablet_replica.cc:333] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.231925 14293 raft_consensus.cc:2243] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.232322 14293 raft_consensus.cc:2272] T 73ceeb99171c494190acf7649429e74f P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.234323 14293 tablet_replica.cc:333] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.234854 14293 raft_consensus.cc:2243] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.235249 14293 raft_consensus.cc:2272] T 73501c4aa4f949b9b5e32ae31d1272fa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.237251 14293 tablet_replica.cc:333] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.237766 14293 raft_consensus.cc:2243] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.238123 14293 raft_consensus.cc:2272] T 35d098ba726f4a1b932215a321920f5e P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.240303 14293 tablet_replica.cc:333] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.241037 14293 raft_consensus.cc:2243] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.241811 14293 raft_consensus.cc:2272] T 40deffc154474fcb83c0238539dec4aa P c716eacc10c54db9b4c6ba82c8a81ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.243906 14293 tablet_replica.cc:333] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.244345 14293 raft_consensus.cc:2243] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.244724 14293 raft_consensus.cc:2272] T 29b9c0becd104cabbc39a94a6dc96559 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.247148 14293 tablet_replica.cc:333] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9: stopping tablet replica
I20260709 13:09:43.247686 14293 raft_consensus.cc:2243] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.248083 14293 raft_consensus.cc:2272] T 452a78d7dcc5496e9ea65721e4e06717 P c716eacc10c54db9b4c6ba82c8a81ee9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.262290 26201 consensus_peers.cc:597] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 -> Peer e54cde55a7eb4cafaa86877bae1f1f4b (127.13.245.65:33083): Couldn't send request to peer e54cde55a7eb4cafaa86877bae1f1f4b. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.65:33083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.293534 14293 tablet_server.cc:196] TabletServer@127.13.245.66:0 shutdown complete.
W20260709 13:09:43.324244 26199 consensus_peers.cc:597] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 -> Peer c716eacc10c54db9b4c6ba82c8a81ee9 (127.13.245.66:41025): Couldn't send request to peer c716eacc10c54db9b4c6ba82c8a81ee9. Status: Network error: Client connection negotiation failed: client connection to 127.13.245.66:41025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.336103 14293 tablet_server.cc:179] TabletServer@127.13.245.67:0 shutting down...
I20260709 13:09:43.369107 14293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:43.369946 14293 tablet_replica.cc:333] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.370740 14293 raft_consensus.cc:2243] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.371417 14293 raft_consensus.cc:2272] T 3c0da2f44e7c4d39970be7e159175ea8 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.374485 14293 tablet_replica.cc:333] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.375418 14293 raft_consensus.cc:2243] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.376092 14293 raft_consensus.cc:2272] T 146032353ea94e93b465e6643bd50d55 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.378288 14293 tablet_replica.cc:333] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.378861 14293 raft_consensus.cc:2243] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.379282 14293 raft_consensus.cc:2272] T 02c9cce115c14133a018cc3b3832af36 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.381409 14293 tablet_replica.cc:333] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.382002 14293 raft_consensus.cc:2243] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.382403 14293 raft_consensus.cc:2272] T ce6a9d5ac83245179f7c36ac3cfad8d3 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.384603 14293 tablet_replica.cc:333] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.385373 14293 raft_consensus.cc:2243] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.385799 14293 raft_consensus.cc:2272] T bef79c5a1ca34a8aa18ee0ee2c124439 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.387823 14293 tablet_replica.cc:333] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.388324 14293 raft_consensus.cc:2243] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.389261 14293 raft_consensus.cc:2272] T e51974e2c8c34be5baf208e164d85548 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.391444 14293 tablet_replica.cc:333] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.392081 14293 raft_consensus.cc:2243] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.392514 14293 raft_consensus.cc:2272] T 73501c4aa4f949b9b5e32ae31d1272fa P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.394438 14293 tablet_replica.cc:333] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.394970 14293 raft_consensus.cc:2243] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.395332 14293 raft_consensus.cc:2272] T 35d098ba726f4a1b932215a321920f5e P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.397565 14293 tablet_replica.cc:333] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.398108 14293 raft_consensus.cc:2243] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.398500 14293 raft_consensus.cc:2272] T 40deffc154474fcb83c0238539dec4aa P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.400673 14293 tablet_replica.cc:333] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.401209 14293 raft_consensus.cc:2243] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.402042 14293 raft_consensus.cc:2272] T 73ceeb99171c494190acf7649429e74f P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.404011 14293 tablet_replica.cc:333] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.404558 14293 raft_consensus.cc:2243] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.404980 14293 raft_consensus.cc:2272] T 94f7609a5a854e47968736437c22b439 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.407102 14293 tablet_replica.cc:333] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.407661 14293 raft_consensus.cc:2243] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.408082 14293 raft_consensus.cc:2272] T cf43b9c70995461ba3cb7d1fe30eb930 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.410111 14293 tablet_replica.cc:333] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.410663 14293 raft_consensus.cc:2243] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.411057 14293 raft_consensus.cc:2272] T 58bbe4baffef485b8f0551607454cd2e P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.413062 14293 tablet_replica.cc:333] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.413574 14293 raft_consensus.cc:2243] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.414381 14293 raft_consensus.cc:2272] T 6aecf57a23cb46209619dea0ea937271 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.417063 14293 tablet_replica.cc:333] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.417547 14293 raft_consensus.cc:2243] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.418326 14293 raft_consensus.cc:2272] T 29b9c0becd104cabbc39a94a6dc96559 P eabde53de26b4615bb9e2eebc36d78e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.421528 14293 tablet_replica.cc:333] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.422044 14293 raft_consensus.cc:2243] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.422438 14293 raft_consensus.cc:2272] T b1480893a51f4292b7091d9523110a63 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.424408 14293 tablet_replica.cc:333] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.424868 14293 raft_consensus.cc:2243] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.425251 14293 raft_consensus.cc:2272] T c1e81f92fda44698906a47c3de450d01 P eabde53de26b4615bb9e2eebc36d78e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.427285 14293 tablet_replica.cc:333] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9: stopping tablet replica
I20260709 13:09:43.427780 14293 raft_consensus.cc:2243] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.428202 14293 raft_consensus.cc:2272] T 452a78d7dcc5496e9ea65721e4e06717 P eabde53de26b4615bb9e2eebc36d78e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.471469 14293 tablet_server.cc:196] TabletServer@127.13.245.67:0 shutdown complete.
I20260709 13:09:43.510597 14293 master.cc:562] Master@127.13.245.126:41493 shutting down...
I20260709 13:09:43.535912 14293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.536592 14293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.536963 14293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 399a22f2bfb444d3b4d2b6b337a11b3c: stopping tablet replica
I20260709 13:09:43.559432 14293 master.cc:584] Master@127.13.245.126:41493 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11844 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24954 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (368446 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:09:43.622066 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 391 messages since previous log ~15 seconds ago
I20260709 13:09:43.622367 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 391 messages since previous log ~15 seconds ago
I20260709 13:09:43.622535 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 386 messages since previous log ~15 seconds ago
I20260709 13:09:43.622797 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:09:43.622978 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:09:43.623230 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~172 seconds ago
I20260709 13:09:43.623440 14293 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~256 seconds ago
I20260709 13:09:43.624140 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~256 seconds ago
I20260709 13:09:43.624440 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:09:43.624608 14293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 47 messages since previous log ~10 seconds ago
ThreadSanitizer: reported 2 warnings
